00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2413 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3674 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.134 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.134 The recommended git tool is: git 00:00:00.134 using credential 00000000-0000-0000-0000-000000000002 00:00:00.136 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.162 Fetching changes from the remote Git repository 00:00:00.164 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.193 Using shallow fetch with depth 1 00:00:00.194 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.194 > git --version # timeout=10 00:00:00.218 > git --version # 'git version 2.39.2' 00:00:00.218 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.243 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.243 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.814 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.825 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.836 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.836 > git config core.sparsecheckout # timeout=10 00:00:05.845 > git read-tree -mu HEAD # timeout=10 00:00:05.858 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.879 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.879 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.986 [Pipeline] Start of Pipeline 00:00:06.000 [Pipeline] library 00:00:06.002 Loading library shm_lib@master 00:00:06.003 Library shm_lib@master is cached. Copying from home. 00:00:06.019 [Pipeline] node 00:00:06.028 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.030 [Pipeline] { 00:00:06.042 [Pipeline] catchError 00:00:06.044 [Pipeline] { 00:00:06.053 [Pipeline] wrap 00:00:06.060 [Pipeline] { 00:00:06.065 [Pipeline] stage 00:00:06.067 [Pipeline] { (Prologue) 00:00:06.234 [Pipeline] sh 00:00:06.512 + logger -p user.info -t JENKINS-CI 00:00:06.531 [Pipeline] echo 00:00:06.533 Node: GP11 00:00:06.541 [Pipeline] sh 00:00:06.836 [Pipeline] setCustomBuildProperty 00:00:06.846 [Pipeline] echo 00:00:06.847 Cleanup processes 00:00:06.853 [Pipeline] sh 00:00:07.131 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.131 3697228 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.146 [Pipeline] sh 00:00:07.431 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.431 ++ grep -v 'sudo pgrep' 00:00:07.431 ++ awk '{print $1}' 00:00:07.431 + sudo kill -9 00:00:07.431 + true 00:00:07.445 [Pipeline] cleanWs 00:00:07.454 [WS-CLEANUP] Deleting project workspace... 00:00:07.454 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.460 [WS-CLEANUP] done 00:00:07.465 [Pipeline] setCustomBuildProperty 00:00:07.481 [Pipeline] sh 00:00:07.762 + sudo git config --global --replace-all safe.directory '*' 00:00:07.852 [Pipeline] httpRequest 00:00:08.244 [Pipeline] echo 00:00:08.247 Sorcerer 10.211.164.20 is alive 00:00:08.256 [Pipeline] retry 00:00:08.258 [Pipeline] { 00:00:08.267 [Pipeline] httpRequest 00:00:08.271 HttpMethod: GET 00:00:08.272 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.272 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.297 Response Code: HTTP/1.1 200 OK 00:00:08.297 Success: Status code 200 is in the accepted range: 200,404 00:00:08.298 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:29.407 [Pipeline] } 00:00:29.424 [Pipeline] // retry 00:00:29.431 [Pipeline] sh 00:00:29.710 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:29.727 [Pipeline] httpRequest 00:00:30.211 [Pipeline] echo 00:00:30.213 Sorcerer 10.211.164.20 is alive 00:00:30.224 [Pipeline] retry 00:00:30.226 [Pipeline] { 00:00:30.241 [Pipeline] httpRequest 00:00:30.245 HttpMethod: GET 00:00:30.246 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:30.246 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:30.258 Response Code: HTTP/1.1 200 OK 00:00:30.258 Success: Status code 200 is in the accepted range: 200,404 00:00:30.258 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:11.949 [Pipeline] } 00:01:11.965 [Pipeline] // retry 00:01:11.972 [Pipeline] sh 00:01:12.253 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:14.797 [Pipeline] sh 00:01:15.079 + git -C spdk log --oneline -n5 00:01:15.079 c13c99a5e test: Various fixes for Fedora40 00:01:15.079 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:15.079 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:15.079 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:15.079 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:15.089 [Pipeline] } 00:01:15.103 [Pipeline] // stage 00:01:15.113 [Pipeline] stage 00:01:15.115 [Pipeline] { (Prepare) 00:01:15.132 [Pipeline] writeFile 00:01:15.147 [Pipeline] sh 00:01:15.429 + logger -p user.info -t JENKINS-CI 00:01:15.442 [Pipeline] sh 00:01:15.726 + logger -p user.info -t JENKINS-CI 00:01:15.739 [Pipeline] sh 00:01:16.022 + cat autorun-spdk.conf 00:01:16.022 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.022 SPDK_TEST_NVMF=1 00:01:16.022 SPDK_TEST_NVME_CLI=1 00:01:16.022 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.022 SPDK_TEST_NVMF_NICS=e810 00:01:16.022 SPDK_RUN_UBSAN=1 00:01:16.022 NET_TYPE=phy 00:01:16.030 RUN_NIGHTLY=1 00:01:16.035 [Pipeline] readFile 00:01:16.062 [Pipeline] withEnv 00:01:16.064 [Pipeline] { 00:01:16.079 [Pipeline] sh 00:01:16.368 + set -ex 00:01:16.368 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:16.368 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:16.368 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.368 ++ SPDK_TEST_NVMF=1 00:01:16.368 ++ SPDK_TEST_NVME_CLI=1 00:01:16.368 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.368 ++ SPDK_TEST_NVMF_NICS=e810 00:01:16.368 ++ SPDK_RUN_UBSAN=1 00:01:16.368 ++ NET_TYPE=phy 00:01:16.368 ++ RUN_NIGHTLY=1 00:01:16.368 + case $SPDK_TEST_NVMF_NICS in 00:01:16.368 + DRIVERS=ice 00:01:16.368 + [[ tcp == \r\d\m\a ]] 00:01:16.368 + [[ -n ice ]] 00:01:16.368 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:16.368 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:16.368 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:16.368 rmmod: ERROR: Module irdma is not currently loaded 00:01:16.368 rmmod: ERROR: Module i40iw is not currently loaded 00:01:16.368 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:16.368 + true 00:01:16.368 + for D in $DRIVERS 00:01:16.368 + sudo modprobe ice 00:01:16.368 + exit 0 00:01:16.377 [Pipeline] } 00:01:16.393 [Pipeline] // withEnv 00:01:16.398 [Pipeline] } 00:01:16.412 [Pipeline] // stage 00:01:16.423 [Pipeline] catchError 00:01:16.425 [Pipeline] { 00:01:16.439 [Pipeline] timeout 00:01:16.439 Timeout set to expire in 1 hr 0 min 00:01:16.441 [Pipeline] { 00:01:16.455 [Pipeline] stage 00:01:16.457 [Pipeline] { (Tests) 00:01:16.472 [Pipeline] sh 00:01:16.754 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.755 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.755 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.755 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:16.755 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:16.755 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:16.755 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:16.755 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:16.755 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:16.755 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:16.755 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:16.755 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.755 + source /etc/os-release 00:01:16.755 ++ NAME='Fedora Linux' 00:01:16.755 ++ VERSION='39 (Cloud Edition)' 00:01:16.755 ++ ID=fedora 00:01:16.755 ++ VERSION_ID=39 00:01:16.755 ++ VERSION_CODENAME= 00:01:16.755 ++ PLATFORM_ID=platform:f39 00:01:16.755 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:16.755 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:16.755 ++ LOGO=fedora-logo-icon 00:01:16.755 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:16.755 ++ HOME_URL=https://fedoraproject.org/ 00:01:16.755 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:16.755 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:16.755 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:16.755 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:16.755 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:16.755 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:16.755 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:16.755 ++ SUPPORT_END=2024-11-12 00:01:16.755 ++ VARIANT='Cloud Edition' 00:01:16.755 ++ VARIANT_ID=cloud 00:01:16.755 + uname -a 00:01:16.755 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:16.755 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:17.689 Hugepages 00:01:17.689 node hugesize free / total 00:01:17.689 node0 1048576kB 0 / 0 00:01:17.689 node0 2048kB 0 / 0 00:01:17.689 node1 1048576kB 0 / 0 00:01:17.689 node1 2048kB 0 / 0 00:01:17.689 00:01:17.689 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:17.689 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:17.689 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:17.689 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:17.689 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:17.689 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:17.689 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:17.690 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:17.690 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:17.690 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:17.690 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:17.690 + rm -f /tmp/spdk-ld-path 00:01:17.690 + source autorun-spdk.conf 00:01:17.690 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:17.690 ++ SPDK_TEST_NVMF=1 00:01:17.690 ++ SPDK_TEST_NVME_CLI=1 00:01:17.690 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:17.690 ++ SPDK_TEST_NVMF_NICS=e810 00:01:17.690 ++ SPDK_RUN_UBSAN=1 00:01:17.690 ++ NET_TYPE=phy 00:01:17.690 ++ RUN_NIGHTLY=1 00:01:17.690 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:17.690 + [[ -n '' ]] 00:01:17.690 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.690 + for M in /var/spdk/build-*-manifest.txt 00:01:17.690 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:17.690 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.690 + for M in /var/spdk/build-*-manifest.txt 00:01:17.690 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:17.690 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.690 + for M in /var/spdk/build-*-manifest.txt 00:01:17.690 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:17.690 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.690 ++ uname 00:01:17.690 + [[ Linux == \L\i\n\u\x ]] 00:01:17.690 + sudo dmesg -T 00:01:17.690 + sudo dmesg --clear 00:01:17.690 + dmesg_pid=3697892 00:01:17.690 + [[ Fedora Linux == FreeBSD ]] 00:01:17.690 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.690 + sudo dmesg -Tw 00:01:17.690 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.690 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:17.690 + [[ -x /usr/src/fio-static/fio ]] 00:01:17.690 + export FIO_BIN=/usr/src/fio-static/fio 00:01:17.690 + FIO_BIN=/usr/src/fio-static/fio 00:01:17.690 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:17.690 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:17.690 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:17.690 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.690 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.690 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:17.690 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.690 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.690 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:17.690 Test configuration: 00:01:17.690 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:17.690 SPDK_TEST_NVMF=1 00:01:17.690 SPDK_TEST_NVME_CLI=1 00:01:17.690 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:17.690 SPDK_TEST_NVMF_NICS=e810 00:01:17.690 SPDK_RUN_UBSAN=1 00:01:17.690 NET_TYPE=phy 00:01:17.690 RUN_NIGHTLY=1 04:07:54 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:17.690 04:07:54 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:17.690 04:07:54 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:17.690 04:07:54 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:17.690 04:07:54 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:17.690 04:07:54 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.690 04:07:54 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.690 04:07:54 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.690 04:07:54 -- paths/export.sh@5 -- $ export PATH 00:01:17.690 04:07:54 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.690 04:07:54 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:17.690 04:07:54 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:17.690 04:07:54 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732763274.XXXXXX 00:01:17.690 04:07:54 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732763274.yDyakj 00:01:17.690 04:07:54 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:17.690 04:07:54 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:17.690 04:07:54 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:17.690 04:07:54 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:17.690 04:07:54 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:17.949 04:07:54 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:17.949 04:07:55 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:17.949 04:07:55 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.949 04:07:55 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:17.949 04:07:55 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:17.949 04:07:55 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:17.949 04:07:55 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.949 04:07:55 -- spdk/autobuild.sh@16 -- $ date -u 00:01:17.949 Thu Nov 28 03:07:55 AM UTC 2024 00:01:17.949 04:07:55 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:17.949 LTS-67-gc13c99a5e 00:01:17.949 04:07:55 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:17.949 04:07:55 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:17.949 04:07:55 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:17.949 04:07:55 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:17.949 04:07:55 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:17.949 04:07:55 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.949 ************************************ 00:01:17.949 START TEST ubsan 00:01:17.949 ************************************ 00:01:17.949 04:07:55 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:17.949 using ubsan 00:01:17.949 00:01:17.949 real 0m0.000s 00:01:17.949 user 0m0.000s 00:01:17.949 sys 0m0.000s 00:01:17.949 04:07:55 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:17.949 04:07:55 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.949 ************************************ 00:01:17.949 END TEST ubsan 00:01:17.949 ************************************ 00:01:17.949 04:07:55 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:17.949 04:07:55 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:17.949 04:07:55 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:17.949 04:07:55 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:17.949 04:07:55 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:17.949 04:07:55 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:17.949 04:07:55 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:17.949 04:07:55 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:17.949 04:07:55 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:17.949 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:17.949 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:18.207 Using 'verbs' RDMA provider 00:01:28.746 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:38.786 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:38.786 Creating mk/config.mk...done. 00:01:38.786 Creating mk/cc.flags.mk...done. 00:01:38.786 Type 'make' to build. 00:01:38.786 04:08:15 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:38.786 04:08:15 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:38.786 04:08:15 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:38.786 04:08:15 -- common/autotest_common.sh@10 -- $ set +x 00:01:38.786 ************************************ 00:01:38.786 START TEST make 00:01:38.786 ************************************ 00:01:38.786 04:08:15 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:38.786 make[1]: Nothing to be done for 'all'. 00:01:46.918 The Meson build system 00:01:46.918 Version: 1.5.0 00:01:46.918 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:46.918 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:46.918 Build type: native build 00:01:46.918 Program cat found: YES (/usr/bin/cat) 00:01:46.918 Project name: DPDK 00:01:46.918 Project version: 23.11.0 00:01:46.918 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:46.918 C linker for the host machine: cc ld.bfd 2.40-14 00:01:46.918 Host machine cpu family: x86_64 00:01:46.918 Host machine cpu: x86_64 00:01:46.918 Message: ## Building in Developer Mode ## 00:01:46.918 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:46.918 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:46.918 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:46.918 Program python3 found: YES (/usr/bin/python3) 00:01:46.918 Program cat found: YES (/usr/bin/cat) 00:01:46.918 Compiler for C supports arguments -march=native: YES 00:01:46.918 Checking for size of "void *" : 8 00:01:46.918 Checking for size of "void *" : 8 (cached) 00:01:46.918 Library m found: YES 00:01:46.918 Library numa found: YES 00:01:46.918 Has header "numaif.h" : YES 00:01:46.918 Library fdt found: NO 00:01:46.918 Library execinfo found: NO 00:01:46.918 Has header "execinfo.h" : YES 00:01:46.919 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:46.919 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:46.919 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:46.919 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:46.919 Run-time dependency openssl found: YES 3.1.1 00:01:46.919 Run-time dependency libpcap found: YES 1.10.4 00:01:46.919 Has header "pcap.h" with dependency libpcap: YES 00:01:46.919 Compiler for C supports arguments -Wcast-qual: YES 00:01:46.919 Compiler for C supports arguments -Wdeprecated: YES 00:01:46.919 Compiler for C supports arguments -Wformat: YES 00:01:46.919 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:46.919 Compiler for C supports arguments -Wformat-security: NO 00:01:46.919 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:46.919 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:46.919 Compiler for C supports arguments -Wnested-externs: YES 00:01:46.919 Compiler for C supports arguments -Wold-style-definition: YES 00:01:46.919 Compiler for C supports arguments -Wpointer-arith: YES 00:01:46.919 Compiler for C supports arguments -Wsign-compare: YES 00:01:46.919 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:46.919 Compiler for C supports arguments -Wundef: YES 00:01:46.919 Compiler for C supports arguments -Wwrite-strings: YES 00:01:46.919 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:46.919 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:46.919 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:46.919 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:46.919 Program objdump found: YES (/usr/bin/objdump) 00:01:46.919 Compiler for C supports arguments -mavx512f: YES 00:01:46.919 Checking if "AVX512 checking" compiles: YES 00:01:46.919 Fetching value of define "__SSE4_2__" : 1 00:01:46.919 Fetching value of define "__AES__" : 1 00:01:46.919 Fetching value of define "__AVX__" : 1 00:01:46.919 Fetching value of define "__AVX2__" : (undefined) 00:01:46.919 Fetching value of define "__AVX512BW__" : (undefined) 00:01:46.919 Fetching value of define "__AVX512CD__" : (undefined) 00:01:46.919 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:46.919 Fetching value of define "__AVX512F__" : (undefined) 00:01:46.919 Fetching value of define "__AVX512VL__" : (undefined) 00:01:46.919 Fetching value of define "__PCLMUL__" : 1 00:01:46.919 Fetching value of define "__RDRND__" : 1 00:01:46.919 Fetching value of define "__RDSEED__" : (undefined) 00:01:46.919 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:46.919 Fetching value of define "__znver1__" : (undefined) 00:01:46.919 Fetching value of define "__znver2__" : (undefined) 00:01:46.919 Fetching value of define "__znver3__" : (undefined) 00:01:46.919 Fetching value of define "__znver4__" : (undefined) 00:01:46.919 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:46.919 Message: lib/log: Defining dependency "log" 00:01:46.919 Message: lib/kvargs: Defining dependency "kvargs" 00:01:46.919 Message: lib/telemetry: Defining dependency "telemetry" 00:01:46.919 Checking for function "getentropy" : NO 00:01:46.919 Message: lib/eal: Defining dependency "eal" 00:01:46.919 Message: lib/ring: Defining dependency "ring" 00:01:46.919 Message: lib/rcu: Defining dependency "rcu" 00:01:46.919 Message: lib/mempool: Defining dependency "mempool" 00:01:46.919 Message: lib/mbuf: Defining dependency "mbuf" 00:01:46.919 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:46.919 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:46.919 Compiler for C supports arguments -mpclmul: YES 00:01:46.919 Compiler for C supports arguments -maes: YES 00:01:46.919 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:46.919 Compiler for C supports arguments -mavx512bw: YES 00:01:46.919 Compiler for C supports arguments -mavx512dq: YES 00:01:46.919 Compiler for C supports arguments -mavx512vl: YES 00:01:46.919 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:46.919 Compiler for C supports arguments -mavx2: YES 00:01:46.919 Compiler for C supports arguments -mavx: YES 00:01:46.919 Message: lib/net: Defining dependency "net" 00:01:46.919 Message: lib/meter: Defining dependency "meter" 00:01:46.919 Message: lib/ethdev: Defining dependency "ethdev" 00:01:46.919 Message: lib/pci: Defining dependency "pci" 00:01:46.919 Message: lib/cmdline: Defining dependency "cmdline" 00:01:46.919 Message: lib/hash: Defining dependency "hash" 00:01:46.919 Message: lib/timer: Defining dependency "timer" 00:01:46.919 Message: lib/compressdev: Defining dependency "compressdev" 00:01:46.919 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:46.919 Message: lib/dmadev: Defining dependency "dmadev" 00:01:46.919 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:46.919 Message: lib/power: Defining dependency "power" 00:01:46.919 Message: lib/reorder: Defining dependency "reorder" 00:01:46.919 Message: lib/security: Defining dependency "security" 00:01:46.919 Has header "linux/userfaultfd.h" : YES 00:01:46.919 Has header "linux/vduse.h" : YES 00:01:46.919 Message: lib/vhost: Defining dependency "vhost" 00:01:46.919 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:46.919 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:46.919 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:46.919 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:46.919 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:46.919 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:46.919 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:46.919 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:46.919 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:46.919 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:46.919 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:46.919 Configuring doxy-api-html.conf using configuration 00:01:46.919 Configuring doxy-api-man.conf using configuration 00:01:46.919 Program mandb found: YES (/usr/bin/mandb) 00:01:46.919 Program sphinx-build found: NO 00:01:46.919 Configuring rte_build_config.h using configuration 00:01:46.919 Message: 00:01:46.919 ================= 00:01:46.919 Applications Enabled 00:01:46.919 ================= 00:01:46.919 00:01:46.919 apps: 00:01:46.919 00:01:46.919 00:01:46.919 Message: 00:01:46.919 ================= 00:01:46.919 Libraries Enabled 00:01:46.919 ================= 00:01:46.919 00:01:46.919 libs: 00:01:46.919 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:46.919 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:46.919 cryptodev, dmadev, power, reorder, security, vhost, 00:01:46.919 00:01:46.919 Message: 00:01:46.919 =============== 00:01:46.919 Drivers Enabled 00:01:46.919 =============== 00:01:46.919 00:01:46.919 common: 00:01:46.919 00:01:46.919 bus: 00:01:46.919 pci, vdev, 00:01:46.919 mempool: 00:01:46.919 ring, 00:01:46.919 dma: 00:01:46.919 00:01:46.919 net: 00:01:46.919 00:01:46.919 crypto: 00:01:46.919 00:01:46.919 compress: 00:01:46.919 00:01:46.919 vdpa: 00:01:46.919 00:01:46.919 00:01:46.919 Message: 00:01:46.919 ================= 00:01:46.919 Content Skipped 00:01:46.919 ================= 00:01:46.919 00:01:46.919 apps: 00:01:46.919 dumpcap: explicitly disabled via build config 00:01:46.919 graph: explicitly disabled via build config 00:01:46.919 pdump: explicitly disabled via build config 00:01:46.919 proc-info: explicitly disabled via build config 00:01:46.919 test-acl: explicitly disabled via build config 00:01:46.919 test-bbdev: explicitly disabled via build config 00:01:46.919 test-cmdline: explicitly disabled via build config 00:01:46.919 test-compress-perf: explicitly disabled via build config 00:01:46.919 test-crypto-perf: explicitly disabled via build config 00:01:46.919 test-dma-perf: explicitly disabled via build config 00:01:46.919 test-eventdev: explicitly disabled via build config 00:01:46.919 test-fib: explicitly disabled via build config 00:01:46.919 test-flow-perf: explicitly disabled via build config 00:01:46.919 test-gpudev: explicitly disabled via build config 00:01:46.919 test-mldev: explicitly disabled via build config 00:01:46.919 test-pipeline: explicitly disabled via build config 00:01:46.919 test-pmd: explicitly disabled via build config 00:01:46.919 test-regex: explicitly disabled via build config 00:01:46.919 test-sad: explicitly disabled via build config 00:01:46.919 test-security-perf: explicitly disabled via build config 00:01:46.919 00:01:46.919 libs: 00:01:46.919 metrics: explicitly disabled via build config 00:01:46.919 acl: explicitly disabled via build config 00:01:46.919 bbdev: explicitly disabled via build config 00:01:46.919 bitratestats: explicitly disabled via build config 00:01:46.919 bpf: explicitly disabled via build config 00:01:46.919 cfgfile: explicitly disabled via build config 00:01:46.919 distributor: explicitly disabled via build config 00:01:46.919 efd: explicitly disabled via build config 00:01:46.919 eventdev: explicitly disabled via build config 00:01:46.919 dispatcher: explicitly disabled via build config 00:01:46.919 gpudev: explicitly disabled via build config 00:01:46.919 gro: explicitly disabled via build config 00:01:46.919 gso: explicitly disabled via build config 00:01:46.919 ip_frag: explicitly disabled via build config 00:01:46.919 jobstats: explicitly disabled via build config 00:01:46.919 latencystats: explicitly disabled via build config 00:01:46.919 lpm: explicitly disabled via build config 00:01:46.919 member: explicitly disabled via build config 00:01:46.919 pcapng: explicitly disabled via build config 00:01:46.919 rawdev: explicitly disabled via build config 00:01:46.919 regexdev: explicitly disabled via build config 00:01:46.919 mldev: explicitly disabled via build config 00:01:46.919 rib: explicitly disabled via build config 00:01:46.919 sched: explicitly disabled via build config 00:01:46.919 stack: explicitly disabled via build config 00:01:46.919 ipsec: explicitly disabled via build config 00:01:46.919 pdcp: explicitly disabled via build config 00:01:46.919 fib: explicitly disabled via build config 00:01:46.919 port: explicitly disabled via build config 00:01:46.919 pdump: explicitly disabled via build config 00:01:46.920 table: explicitly disabled via build config 00:01:46.920 pipeline: explicitly disabled via build config 00:01:46.920 graph: explicitly disabled via build config 00:01:46.920 node: explicitly disabled via build config 00:01:46.920 00:01:46.920 drivers: 00:01:46.920 common/cpt: not in enabled drivers build config 00:01:46.920 common/dpaax: not in enabled drivers build config 00:01:46.920 common/iavf: not in enabled drivers build config 00:01:46.920 common/idpf: not in enabled drivers build config 00:01:46.920 common/mvep: not in enabled drivers build config 00:01:46.920 common/octeontx: not in enabled drivers build config 00:01:46.920 bus/auxiliary: not in enabled drivers build config 00:01:46.920 bus/cdx: not in enabled drivers build config 00:01:46.920 bus/dpaa: not in enabled drivers build config 00:01:46.920 bus/fslmc: not in enabled drivers build config 00:01:46.920 bus/ifpga: not in enabled drivers build config 00:01:46.920 bus/platform: not in enabled drivers build config 00:01:46.920 bus/vmbus: not in enabled drivers build config 00:01:46.920 common/cnxk: not in enabled drivers build config 00:01:46.920 common/mlx5: not in enabled drivers build config 00:01:46.920 common/nfp: not in enabled drivers build config 00:01:46.920 common/qat: not in enabled drivers build config 00:01:46.920 common/sfc_efx: not in enabled drivers build config 00:01:46.920 mempool/bucket: not in enabled drivers build config 00:01:46.920 mempool/cnxk: not in enabled drivers build config 00:01:46.920 mempool/dpaa: not in enabled drivers build config 00:01:46.920 mempool/dpaa2: not in enabled drivers build config 00:01:46.920 mempool/octeontx: not in enabled drivers build config 00:01:46.920 mempool/stack: not in enabled drivers build config 00:01:46.920 dma/cnxk: not in enabled drivers build config 00:01:46.920 dma/dpaa: not in enabled drivers build config 00:01:46.920 dma/dpaa2: not in enabled drivers build config 00:01:46.920 dma/hisilicon: not in enabled drivers build config 00:01:46.920 dma/idxd: not in enabled drivers build config 00:01:46.920 dma/ioat: not in enabled drivers build config 00:01:46.920 dma/skeleton: not in enabled drivers build config 00:01:46.920 net/af_packet: not in enabled drivers build config 00:01:46.920 net/af_xdp: not in enabled drivers build config 00:01:46.920 net/ark: not in enabled drivers build config 00:01:46.920 net/atlantic: not in enabled drivers build config 00:01:46.920 net/avp: not in enabled drivers build config 00:01:46.920 net/axgbe: not in enabled drivers build config 00:01:46.920 net/bnx2x: not in enabled drivers build config 00:01:46.920 net/bnxt: not in enabled drivers build config 00:01:46.920 net/bonding: not in enabled drivers build config 00:01:46.920 net/cnxk: not in enabled drivers build config 00:01:46.920 net/cpfl: not in enabled drivers build config 00:01:46.920 net/cxgbe: not in enabled drivers build config 00:01:46.920 net/dpaa: not in enabled drivers build config 00:01:46.920 net/dpaa2: not in enabled drivers build config 00:01:46.920 net/e1000: not in enabled drivers build config 00:01:46.920 net/ena: not in enabled drivers build config 00:01:46.920 net/enetc: not in enabled drivers build config 00:01:46.920 net/enetfec: not in enabled drivers build config 00:01:46.920 net/enic: not in enabled drivers build config 00:01:46.920 net/failsafe: not in enabled drivers build config 00:01:46.920 net/fm10k: not in enabled drivers build config 00:01:46.920 net/gve: not in enabled drivers build config 00:01:46.920 net/hinic: not in enabled drivers build config 00:01:46.920 net/hns3: not in enabled drivers build config 00:01:46.920 net/i40e: not in enabled drivers build config 00:01:46.920 net/iavf: not in enabled drivers build config 00:01:46.920 net/ice: not in enabled drivers build config 00:01:46.920 net/idpf: not in enabled drivers build config 00:01:46.920 net/igc: not in enabled drivers build config 00:01:46.920 net/ionic: not in enabled drivers build config 00:01:46.920 net/ipn3ke: not in enabled drivers build config 00:01:46.920 net/ixgbe: not in enabled drivers build config 00:01:46.920 net/mana: not in enabled drivers build config 00:01:46.920 net/memif: not in enabled drivers build config 00:01:46.920 net/mlx4: not in enabled drivers build config 00:01:46.920 net/mlx5: not in enabled drivers build config 00:01:46.920 net/mvneta: not in enabled drivers build config 00:01:46.920 net/mvpp2: not in enabled drivers build config 00:01:46.920 net/netvsc: not in enabled drivers build config 00:01:46.920 net/nfb: not in enabled drivers build config 00:01:46.920 net/nfp: not in enabled drivers build config 00:01:46.920 net/ngbe: not in enabled drivers build config 00:01:46.920 net/null: not in enabled drivers build config 00:01:46.920 net/octeontx: not in enabled drivers build config 00:01:46.920 net/octeon_ep: not in enabled drivers build config 00:01:46.920 net/pcap: not in enabled drivers build config 00:01:46.920 net/pfe: not in enabled drivers build config 00:01:46.920 net/qede: not in enabled drivers build config 00:01:46.920 net/ring: not in enabled drivers build config 00:01:46.920 net/sfc: not in enabled drivers build config 00:01:46.920 net/softnic: not in enabled drivers build config 00:01:46.920 net/tap: not in enabled drivers build config 00:01:46.920 net/thunderx: not in enabled drivers build config 00:01:46.920 net/txgbe: not in enabled drivers build config 00:01:46.920 net/vdev_netvsc: not in enabled drivers build config 00:01:46.920 net/vhost: not in enabled drivers build config 00:01:46.920 net/virtio: not in enabled drivers build config 00:01:46.920 net/vmxnet3: not in enabled drivers build config 00:01:46.920 raw/*: missing internal dependency, "rawdev" 00:01:46.920 crypto/armv8: not in enabled drivers build config 00:01:46.920 crypto/bcmfs: not in enabled drivers build config 00:01:46.920 crypto/caam_jr: not in enabled drivers build config 00:01:46.920 crypto/ccp: not in enabled drivers build config 00:01:46.920 crypto/cnxk: not in enabled drivers build config 00:01:46.920 crypto/dpaa_sec: not in enabled drivers build config 00:01:46.920 crypto/dpaa2_sec: not in enabled drivers build config 00:01:46.920 crypto/ipsec_mb: not in enabled drivers build config 00:01:46.920 crypto/mlx5: not in enabled drivers build config 00:01:46.920 crypto/mvsam: not in enabled drivers build config 00:01:46.920 crypto/nitrox: not in enabled drivers build config 00:01:46.920 crypto/null: not in enabled drivers build config 00:01:46.920 crypto/octeontx: not in enabled drivers build config 00:01:46.920 crypto/openssl: not in enabled drivers build config 00:01:46.920 crypto/scheduler: not in enabled drivers build config 00:01:46.920 crypto/uadk: not in enabled drivers build config 00:01:46.920 crypto/virtio: not in enabled drivers build config 00:01:46.920 compress/isal: not in enabled drivers build config 00:01:46.920 compress/mlx5: not in enabled drivers build config 00:01:46.920 compress/octeontx: not in enabled drivers build config 00:01:46.920 compress/zlib: not in enabled drivers build config 00:01:46.920 regex/*: missing internal dependency, "regexdev" 00:01:46.920 ml/*: missing internal dependency, "mldev" 00:01:46.920 vdpa/ifc: not in enabled drivers build config 00:01:46.920 vdpa/mlx5: not in enabled drivers build config 00:01:46.920 vdpa/nfp: not in enabled drivers build config 00:01:46.920 vdpa/sfc: not in enabled drivers build config 00:01:46.920 event/*: missing internal dependency, "eventdev" 00:01:46.920 baseband/*: missing internal dependency, "bbdev" 00:01:46.920 gpu/*: missing internal dependency, "gpudev" 00:01:46.920 00:01:46.920 00:01:46.920 Build targets in project: 85 00:01:46.920 00:01:46.920 DPDK 23.11.0 00:01:46.920 00:01:46.920 User defined options 00:01:46.920 buildtype : debug 00:01:46.920 default_library : shared 00:01:46.920 libdir : lib 00:01:46.920 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:46.920 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:46.920 c_link_args : 00:01:46.920 cpu_instruction_set: native 00:01:46.920 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:46.920 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:46.920 enable_docs : false 00:01:46.920 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:46.920 enable_kmods : false 00:01:46.920 tests : false 00:01:46.920 00:01:46.920 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:47.491 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:47.491 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:47.491 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:47.491 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:47.491 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:47.491 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:47.491 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:47.491 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:47.491 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:47.491 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:47.491 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:47.491 [11/265] Linking static target lib/librte_kvargs.a 00:01:47.492 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:47.492 [13/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:47.492 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:47.492 [15/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:47.752 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:47.752 [17/265] Linking static target lib/librte_log.a 00:01:47.752 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:47.752 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:47.752 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:48.020 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:48.288 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.288 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:48.288 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:48.560 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:48.560 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:48.560 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:48.560 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:48.560 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:48.560 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:48.560 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:48.560 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:48.560 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:48.560 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:48.560 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:48.560 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:48.560 [37/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:48.560 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:48.560 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:48.560 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:48.560 [41/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:48.560 [42/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:48.560 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:48.560 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:48.560 [45/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:48.560 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:48.560 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:48.560 [48/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:48.560 [49/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:48.560 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:48.560 [51/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:48.560 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:48.560 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:48.560 [54/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:48.560 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:48.560 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:48.560 [57/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:48.560 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:48.560 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:48.560 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:48.560 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:48.560 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:48.560 [63/265] Linking static target lib/librte_telemetry.a 00:01:48.560 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:48.560 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:48.560 [66/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.560 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:48.818 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:48.818 [69/265] Linking target lib/librte_log.so.24.0 00:01:48.818 [70/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:48.818 [71/265] Linking static target lib/librte_pci.a 00:01:48.818 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:48.818 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:48.818 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:48.818 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:48.818 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:49.078 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:49.078 [78/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:49.078 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:49.078 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:49.078 [81/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:49.078 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:49.078 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:49.078 [84/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:49.078 [85/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:49.078 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:49.337 [87/265] Linking target lib/librte_kvargs.so.24.0 00:01:49.337 [88/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:49.337 [89/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:49.337 [90/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:49.337 [91/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:49.337 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.337 [93/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:49.337 [94/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:49.337 [95/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:49.337 [96/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:49.337 [97/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:49.337 [98/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:49.337 [99/265] Linking static target lib/librte_ring.a 00:01:49.337 [100/265] Linking static target lib/librte_eal.a 00:01:49.337 [101/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:49.337 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:49.599 [103/265] Linking static target lib/librte_meter.a 00:01:49.599 [104/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:49.599 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:49.599 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:49.599 [107/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:49.599 [108/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:49.599 [109/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:49.599 [110/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:49.599 [111/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:49.599 [112/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:49.599 [113/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:49.599 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:49.599 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:49.599 [116/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.599 [117/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:49.599 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:49.599 [119/265] Linking static target lib/librte_rcu.a 00:01:49.599 [120/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:49.857 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:49.857 [122/265] Linking target lib/librte_telemetry.so.24.0 00:01:49.857 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:49.857 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:49.857 [125/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:49.857 [126/265] Linking static target lib/librte_mempool.a 00:01:49.857 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:49.857 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:49.857 [129/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:49.857 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:49.857 [131/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:49.857 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:49.857 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:49.857 [134/265] Linking static target lib/librte_cmdline.a 00:01:49.857 [135/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.857 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:50.116 [137/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:50.116 [138/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.116 [139/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:50.116 [140/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:50.116 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:50.116 [142/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:50.116 [143/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:50.116 [144/265] Linking static target lib/librte_net.a 00:01:50.116 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:50.376 [146/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:50.376 [147/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:50.376 [148/265] Linking static target lib/librte_timer.a 00:01:50.376 [149/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:50.376 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:50.376 [151/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.376 [152/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:50.376 [153/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:50.635 [154/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:50.635 [155/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.635 [156/265] Linking static target lib/librte_dmadev.a 00:01:50.635 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:50.635 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:50.635 [159/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:50.635 [160/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:50.635 [161/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:50.635 [162/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:50.635 [163/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:50.635 [164/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:50.635 [165/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.635 [166/265] Linking static target lib/librte_hash.a 00:01:50.635 [167/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.894 [168/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:50.895 [169/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:50.895 [170/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:50.895 [171/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:50.895 [172/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:50.895 [173/265] Linking static target lib/librte_power.a 00:01:50.895 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:50.895 [175/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:50.895 [176/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:50.895 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:50.895 [178/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:50.895 [179/265] Linking static target lib/librte_compressdev.a 00:01:50.895 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:50.895 [181/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:50.895 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:50.895 [183/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.895 [184/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.895 [185/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:50.895 [186/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:51.154 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:51.154 [188/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:51.154 [189/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:51.154 [190/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:51.154 [191/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:51.154 [192/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:51.154 [193/265] Linking static target lib/librte_reorder.a 00:01:51.154 [194/265] Linking static target drivers/librte_bus_vdev.a 00:01:51.154 [195/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:51.154 [196/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:51.154 [197/265] Linking static target lib/librte_mbuf.a 00:01:51.154 [198/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:51.154 [199/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:51.154 [200/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.413 [201/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.413 [202/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:51.413 [203/265] Linking static target lib/librte_security.a 00:01:51.413 [204/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:51.413 [205/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:51.413 [206/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.413 [207/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.413 [208/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.413 [209/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:51.413 [210/265] Linking static target drivers/librte_bus_pci.a 00:01:51.413 [211/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:51.413 [212/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:51.413 [213/265] Linking static target drivers/librte_mempool_ring.a 00:01:51.413 [214/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.413 [215/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:51.413 [216/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.672 [217/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.672 [218/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:51.672 [219/265] Linking static target lib/librte_cryptodev.a 00:01:51.672 [220/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.672 [221/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:51.672 [222/265] Linking static target lib/librte_ethdev.a 00:01:51.672 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.607 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.979 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:55.879 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.879 [227/265] Linking target lib/librte_eal.so.24.0 00:01:55.880 [228/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.880 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:55.880 [230/265] Linking target lib/librte_timer.so.24.0 00:01:55.880 [231/265] Linking target lib/librte_ring.so.24.0 00:01:55.880 [232/265] Linking target lib/librte_meter.so.24.0 00:01:55.880 [233/265] Linking target lib/librte_pci.so.24.0 00:01:55.880 [234/265] Linking target lib/librte_dmadev.so.24.0 00:01:55.880 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:56.138 [236/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:56.138 [237/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:56.138 [238/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:56.138 [239/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:56.138 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:56.138 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:56.138 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:56.138 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:56.138 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:56.138 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:56.396 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:56.396 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:56.396 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:56.396 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:56.396 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:56.396 [251/265] Linking target lib/librte_net.so.24.0 00:01:56.396 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:56.655 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:56.655 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:56.655 [255/265] Linking target lib/librte_cmdline.so.24.0 00:01:56.655 [256/265] Linking target lib/librte_hash.so.24.0 00:01:56.655 [257/265] Linking target lib/librte_security.so.24.0 00:01:56.655 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:56.655 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:56.655 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:56.913 [261/265] Linking target lib/librte_power.so.24.0 00:02:00.195 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:00.195 [263/265] Linking static target lib/librte_vhost.a 00:02:00.760 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.760 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:00.760 INFO: autodetecting backend as ninja 00:02:00.760 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:01.693 CC lib/ut_mock/mock.o 00:02:01.693 CC lib/log/log.o 00:02:01.693 CC lib/log/log_flags.o 00:02:01.693 CC lib/log/log_deprecated.o 00:02:01.693 CC lib/ut/ut.o 00:02:01.952 LIB libspdk_ut_mock.a 00:02:01.952 SO libspdk_ut_mock.so.5.0 00:02:01.952 LIB libspdk_log.a 00:02:01.952 LIB libspdk_ut.a 00:02:01.952 SO libspdk_log.so.6.1 00:02:01.952 SO libspdk_ut.so.1.0 00:02:01.952 SYMLINK libspdk_ut_mock.so 00:02:01.952 SYMLINK libspdk_ut.so 00:02:01.952 SYMLINK libspdk_log.so 00:02:02.211 CC lib/dma/dma.o 00:02:02.211 CC lib/ioat/ioat.o 00:02:02.211 CC lib/util/base64.o 00:02:02.211 CC lib/util/bit_array.o 00:02:02.211 CXX lib/trace_parser/trace.o 00:02:02.211 CC lib/util/cpuset.o 00:02:02.211 CC lib/util/crc16.o 00:02:02.211 CC lib/util/crc32.o 00:02:02.211 CC lib/util/crc32c.o 00:02:02.211 CC lib/util/crc32_ieee.o 00:02:02.211 CC lib/util/crc64.o 00:02:02.211 CC lib/util/dif.o 00:02:02.211 CC lib/util/fd.o 00:02:02.211 CC lib/util/file.o 00:02:02.211 CC lib/util/hexlify.o 00:02:02.211 CC lib/util/iov.o 00:02:02.211 CC lib/util/math.o 00:02:02.211 CC lib/util/pipe.o 00:02:02.211 CC lib/util/strerror_tls.o 00:02:02.211 CC lib/util/string.o 00:02:02.211 CC lib/util/uuid.o 00:02:02.211 CC lib/util/fd_group.o 00:02:02.211 CC lib/util/zipf.o 00:02:02.211 CC lib/util/xor.o 00:02:02.211 CC lib/vfio_user/host/vfio_user_pci.o 00:02:02.211 CC lib/vfio_user/host/vfio_user.o 00:02:02.211 LIB libspdk_dma.a 00:02:02.211 SO libspdk_dma.so.3.0 00:02:02.469 SYMLINK libspdk_dma.so 00:02:02.469 LIB libspdk_ioat.a 00:02:02.469 SO libspdk_ioat.so.6.0 00:02:02.469 LIB libspdk_vfio_user.a 00:02:02.469 SYMLINK libspdk_ioat.so 00:02:02.469 SO libspdk_vfio_user.so.4.0 00:02:02.469 SYMLINK libspdk_vfio_user.so 00:02:02.727 LIB libspdk_util.a 00:02:02.727 SO libspdk_util.so.8.0 00:02:02.727 SYMLINK libspdk_util.so 00:02:02.986 CC lib/rdma/common.o 00:02:02.986 CC lib/json/json_parse.o 00:02:02.986 CC lib/idxd/idxd.o 00:02:02.986 CC lib/rdma/rdma_verbs.o 00:02:02.986 CC lib/conf/conf.o 00:02:02.986 CC lib/json/json_util.o 00:02:02.986 CC lib/vmd/vmd.o 00:02:02.986 CC lib/idxd/idxd_user.o 00:02:02.986 CC lib/json/json_write.o 00:02:02.986 CC lib/idxd/idxd_kernel.o 00:02:02.986 CC lib/env_dpdk/env.o 00:02:02.986 CC lib/vmd/led.o 00:02:02.986 CC lib/env_dpdk/memory.o 00:02:02.986 CC lib/env_dpdk/pci.o 00:02:02.986 CC lib/env_dpdk/init.o 00:02:02.986 CC lib/env_dpdk/threads.o 00:02:02.986 CC lib/env_dpdk/pci_ioat.o 00:02:02.986 CC lib/env_dpdk/pci_virtio.o 00:02:02.986 CC lib/env_dpdk/pci_vmd.o 00:02:02.986 CC lib/env_dpdk/pci_idxd.o 00:02:02.986 CC lib/env_dpdk/pci_event.o 00:02:02.986 CC lib/env_dpdk/sigbus_handler.o 00:02:02.986 CC lib/env_dpdk/pci_dpdk.o 00:02:02.986 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:02.986 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:02.986 LIB libspdk_trace_parser.a 00:02:03.244 SO libspdk_trace_parser.so.4.0 00:02:03.244 LIB libspdk_conf.a 00:02:03.244 SO libspdk_conf.so.5.0 00:02:03.244 SYMLINK libspdk_trace_parser.so 00:02:03.244 LIB libspdk_json.a 00:02:03.244 SYMLINK libspdk_conf.so 00:02:03.244 SO libspdk_json.so.5.1 00:02:03.244 SYMLINK libspdk_json.so 00:02:03.244 LIB libspdk_rdma.a 00:02:03.244 SO libspdk_rdma.so.5.0 00:02:03.503 SYMLINK libspdk_rdma.so 00:02:03.503 CC lib/jsonrpc/jsonrpc_server.o 00:02:03.503 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:03.503 CC lib/jsonrpc/jsonrpc_client.o 00:02:03.503 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:03.503 LIB libspdk_idxd.a 00:02:03.503 SO libspdk_idxd.so.11.0 00:02:03.503 LIB libspdk_vmd.a 00:02:03.760 SO libspdk_vmd.so.5.0 00:02:03.760 SYMLINK libspdk_idxd.so 00:02:03.760 LIB libspdk_jsonrpc.a 00:02:03.760 SYMLINK libspdk_vmd.so 00:02:03.760 SO libspdk_jsonrpc.so.5.1 00:02:03.760 SYMLINK libspdk_jsonrpc.so 00:02:04.019 CC lib/rpc/rpc.o 00:02:04.019 LIB libspdk_rpc.a 00:02:04.019 SO libspdk_rpc.so.5.0 00:02:04.277 SYMLINK libspdk_rpc.so 00:02:04.277 CC lib/trace/trace.o 00:02:04.277 CC lib/sock/sock.o 00:02:04.277 CC lib/trace/trace_flags.o 00:02:04.277 CC lib/sock/sock_rpc.o 00:02:04.277 CC lib/trace/trace_rpc.o 00:02:04.278 CC lib/notify/notify.o 00:02:04.278 CC lib/notify/notify_rpc.o 00:02:04.536 LIB libspdk_notify.a 00:02:04.536 SO libspdk_notify.so.5.0 00:02:04.536 SYMLINK libspdk_notify.so 00:02:04.536 LIB libspdk_trace.a 00:02:04.536 SO libspdk_trace.so.9.0 00:02:04.536 SYMLINK libspdk_trace.so 00:02:04.536 LIB libspdk_sock.a 00:02:04.794 SO libspdk_sock.so.8.0 00:02:04.794 CC lib/thread/thread.o 00:02:04.794 CC lib/thread/iobuf.o 00:02:04.794 SYMLINK libspdk_sock.so 00:02:04.794 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:04.794 CC lib/nvme/nvme_ctrlr.o 00:02:04.794 CC lib/nvme/nvme_fabric.o 00:02:04.794 CC lib/nvme/nvme_ns_cmd.o 00:02:04.794 CC lib/nvme/nvme_ns.o 00:02:04.794 CC lib/nvme/nvme_pcie_common.o 00:02:04.794 CC lib/nvme/nvme_pcie.o 00:02:04.794 CC lib/nvme/nvme_qpair.o 00:02:04.794 CC lib/nvme/nvme.o 00:02:04.794 CC lib/nvme/nvme_quirks.o 00:02:04.794 CC lib/nvme/nvme_transport.o 00:02:04.794 CC lib/nvme/nvme_discovery.o 00:02:04.794 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:04.794 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:04.794 CC lib/nvme/nvme_tcp.o 00:02:04.795 CC lib/nvme/nvme_opal.o 00:02:04.795 CC lib/nvme/nvme_io_msg.o 00:02:04.795 CC lib/nvme/nvme_poll_group.o 00:02:04.795 CC lib/nvme/nvme_zns.o 00:02:04.795 CC lib/nvme/nvme_vfio_user.o 00:02:04.795 CC lib/nvme/nvme_cuse.o 00:02:04.795 CC lib/nvme/nvme_rdma.o 00:02:05.052 LIB libspdk_env_dpdk.a 00:02:05.052 SO libspdk_env_dpdk.so.13.0 00:02:05.310 SYMLINK libspdk_env_dpdk.so 00:02:06.243 LIB libspdk_thread.a 00:02:06.243 SO libspdk_thread.so.9.0 00:02:06.243 SYMLINK libspdk_thread.so 00:02:06.501 CC lib/init/json_config.o 00:02:06.501 CC lib/virtio/virtio.o 00:02:06.501 CC lib/blob/blobstore.o 00:02:06.501 CC lib/init/subsystem.o 00:02:06.501 CC lib/blob/request.o 00:02:06.501 CC lib/virtio/virtio_vhost_user.o 00:02:06.501 CC lib/init/subsystem_rpc.o 00:02:06.501 CC lib/blob/zeroes.o 00:02:06.501 CC lib/virtio/virtio_vfio_user.o 00:02:06.501 CC lib/blob/blob_bs_dev.o 00:02:06.501 CC lib/virtio/virtio_pci.o 00:02:06.501 CC lib/accel/accel.o 00:02:06.501 CC lib/init/rpc.o 00:02:06.501 CC lib/accel/accel_rpc.o 00:02:06.501 CC lib/accel/accel_sw.o 00:02:06.759 LIB libspdk_init.a 00:02:06.759 SO libspdk_init.so.4.0 00:02:06.759 SYMLINK libspdk_init.so 00:02:06.759 LIB libspdk_virtio.a 00:02:06.759 SO libspdk_virtio.so.6.0 00:02:07.017 SYMLINK libspdk_virtio.so 00:02:07.017 CC lib/event/app.o 00:02:07.017 CC lib/event/reactor.o 00:02:07.017 CC lib/event/log_rpc.o 00:02:07.017 CC lib/event/app_rpc.o 00:02:07.017 CC lib/event/scheduler_static.o 00:02:07.275 LIB libspdk_nvme.a 00:02:07.275 SO libspdk_nvme.so.12.0 00:02:07.275 LIB libspdk_event.a 00:02:07.275 SO libspdk_event.so.12.0 00:02:07.532 SYMLINK libspdk_event.so 00:02:07.532 SYMLINK libspdk_nvme.so 00:02:07.532 LIB libspdk_accel.a 00:02:07.532 SO libspdk_accel.so.14.0 00:02:07.532 SYMLINK libspdk_accel.so 00:02:07.791 CC lib/bdev/bdev.o 00:02:07.791 CC lib/bdev/bdev_rpc.o 00:02:07.791 CC lib/bdev/bdev_zone.o 00:02:07.791 CC lib/bdev/part.o 00:02:07.791 CC lib/bdev/scsi_nvme.o 00:02:09.165 LIB libspdk_blob.a 00:02:09.165 SO libspdk_blob.so.10.1 00:02:09.422 SYMLINK libspdk_blob.so 00:02:09.422 CC lib/blobfs/blobfs.o 00:02:09.422 CC lib/blobfs/tree.o 00:02:09.422 CC lib/lvol/lvol.o 00:02:10.365 LIB libspdk_bdev.a 00:02:10.365 SO libspdk_bdev.so.14.0 00:02:10.365 LIB libspdk_blobfs.a 00:02:10.365 SO libspdk_blobfs.so.9.0 00:02:10.365 SYMLINK libspdk_bdev.so 00:02:10.365 LIB libspdk_lvol.a 00:02:10.365 SYMLINK libspdk_blobfs.so 00:02:10.365 SO libspdk_lvol.so.9.1 00:02:10.365 SYMLINK libspdk_lvol.so 00:02:10.365 CC lib/scsi/dev.o 00:02:10.365 CC lib/nvmf/ctrlr.o 00:02:10.365 CC lib/scsi/lun.o 00:02:10.365 CC lib/nvmf/ctrlr_discovery.o 00:02:10.365 CC lib/scsi/port.o 00:02:10.365 CC lib/ublk/ublk.o 00:02:10.365 CC lib/nbd/nbd.o 00:02:10.365 CC lib/scsi/scsi.o 00:02:10.365 CC lib/nvmf/ctrlr_bdev.o 00:02:10.365 CC lib/ublk/ublk_rpc.o 00:02:10.365 CC lib/nvmf/subsystem.o 00:02:10.365 CC lib/nbd/nbd_rpc.o 00:02:10.365 CC lib/scsi/scsi_bdev.o 00:02:10.365 CC lib/ftl/ftl_core.o 00:02:10.365 CC lib/nvmf/nvmf.o 00:02:10.365 CC lib/scsi/scsi_pr.o 00:02:10.365 CC lib/ftl/ftl_init.o 00:02:10.365 CC lib/nvmf/nvmf_rpc.o 00:02:10.365 CC lib/scsi/scsi_rpc.o 00:02:10.365 CC lib/nvmf/transport.o 00:02:10.365 CC lib/ftl/ftl_layout.o 00:02:10.365 CC lib/nvmf/tcp.o 00:02:10.365 CC lib/scsi/task.o 00:02:10.365 CC lib/ftl/ftl_debug.o 00:02:10.365 CC lib/nvmf/rdma.o 00:02:10.365 CC lib/ftl/ftl_io.o 00:02:10.365 CC lib/ftl/ftl_sb.o 00:02:10.365 CC lib/ftl/ftl_l2p.o 00:02:10.365 CC lib/ftl/ftl_l2p_flat.o 00:02:10.365 CC lib/ftl/ftl_nv_cache.o 00:02:10.365 CC lib/ftl/ftl_band.o 00:02:10.365 CC lib/ftl/ftl_writer.o 00:02:10.365 CC lib/ftl/ftl_band_ops.o 00:02:10.365 CC lib/ftl/ftl_rq.o 00:02:10.365 CC lib/ftl/ftl_reloc.o 00:02:10.365 CC lib/ftl/ftl_p2l.o 00:02:10.365 CC lib/ftl/ftl_l2p_cache.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:10.365 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:10.623 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:10.623 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:10.882 CC lib/ftl/utils/ftl_conf.o 00:02:10.882 CC lib/ftl/utils/ftl_md.o 00:02:10.882 CC lib/ftl/utils/ftl_mempool.o 00:02:10.882 CC lib/ftl/utils/ftl_bitmap.o 00:02:10.882 CC lib/ftl/utils/ftl_property.o 00:02:10.882 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:10.882 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:10.882 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:10.882 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:10.882 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:10.882 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:10.882 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:10.882 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:10.882 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:10.882 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:10.882 CC lib/ftl/base/ftl_base_dev.o 00:02:10.882 CC lib/ftl/base/ftl_base_bdev.o 00:02:10.882 CC lib/ftl/ftl_trace.o 00:02:11.141 LIB libspdk_nbd.a 00:02:11.141 SO libspdk_nbd.so.6.0 00:02:11.141 SYMLINK libspdk_nbd.so 00:02:11.399 LIB libspdk_scsi.a 00:02:11.399 SO libspdk_scsi.so.8.0 00:02:11.399 SYMLINK libspdk_scsi.so 00:02:11.399 LIB libspdk_ublk.a 00:02:11.399 SO libspdk_ublk.so.2.0 00:02:11.399 SYMLINK libspdk_ublk.so 00:02:11.399 CC lib/iscsi/conn.o 00:02:11.399 CC lib/iscsi/init_grp.o 00:02:11.399 CC lib/iscsi/iscsi.o 00:02:11.399 CC lib/iscsi/md5.o 00:02:11.399 CC lib/iscsi/param.o 00:02:11.399 CC lib/iscsi/portal_grp.o 00:02:11.399 CC lib/vhost/vhost.o 00:02:11.399 CC lib/iscsi/tgt_node.o 00:02:11.399 CC lib/iscsi/iscsi_subsystem.o 00:02:11.399 CC lib/vhost/vhost_rpc.o 00:02:11.399 CC lib/iscsi/iscsi_rpc.o 00:02:11.399 CC lib/iscsi/task.o 00:02:11.399 CC lib/vhost/vhost_scsi.o 00:02:11.399 CC lib/vhost/vhost_blk.o 00:02:11.399 CC lib/vhost/rte_vhost_user.o 00:02:11.657 LIB libspdk_ftl.a 00:02:11.915 SO libspdk_ftl.so.8.0 00:02:12.173 SYMLINK libspdk_ftl.so 00:02:12.739 LIB libspdk_vhost.a 00:02:12.739 SO libspdk_vhost.so.7.1 00:02:12.739 SYMLINK libspdk_vhost.so 00:02:12.739 LIB libspdk_nvmf.a 00:02:12.998 SO libspdk_nvmf.so.17.0 00:02:12.998 LIB libspdk_iscsi.a 00:02:12.998 SO libspdk_iscsi.so.7.0 00:02:12.998 SYMLINK libspdk_nvmf.so 00:02:13.256 SYMLINK libspdk_iscsi.so 00:02:13.256 CC module/env_dpdk/env_dpdk_rpc.o 00:02:13.514 CC module/blob/bdev/blob_bdev.o 00:02:13.514 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:13.514 CC module/accel/error/accel_error.o 00:02:13.514 CC module/scheduler/gscheduler/gscheduler.o 00:02:13.514 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:13.514 CC module/accel/iaa/accel_iaa.o 00:02:13.514 CC module/sock/posix/posix.o 00:02:13.514 CC module/accel/error/accel_error_rpc.o 00:02:13.514 CC module/accel/ioat/accel_ioat.o 00:02:13.514 CC module/accel/iaa/accel_iaa_rpc.o 00:02:13.514 CC module/accel/ioat/accel_ioat_rpc.o 00:02:13.514 CC module/accel/dsa/accel_dsa.o 00:02:13.514 CC module/accel/dsa/accel_dsa_rpc.o 00:02:13.514 LIB libspdk_env_dpdk_rpc.a 00:02:13.514 SO libspdk_env_dpdk_rpc.so.5.0 00:02:13.514 SYMLINK libspdk_env_dpdk_rpc.so 00:02:13.514 LIB libspdk_scheduler_gscheduler.a 00:02:13.514 LIB libspdk_scheduler_dpdk_governor.a 00:02:13.514 SO libspdk_scheduler_gscheduler.so.3.0 00:02:13.514 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:13.514 LIB libspdk_accel_error.a 00:02:13.514 LIB libspdk_accel_ioat.a 00:02:13.514 LIB libspdk_scheduler_dynamic.a 00:02:13.514 SO libspdk_accel_error.so.1.0 00:02:13.514 LIB libspdk_accel_iaa.a 00:02:13.514 SO libspdk_accel_ioat.so.5.0 00:02:13.514 SYMLINK libspdk_scheduler_gscheduler.so 00:02:13.514 SO libspdk_scheduler_dynamic.so.3.0 00:02:13.772 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:13.772 SO libspdk_accel_iaa.so.2.0 00:02:13.772 LIB libspdk_accel_dsa.a 00:02:13.772 SYMLINK libspdk_accel_error.so 00:02:13.772 SYMLINK libspdk_accel_ioat.so 00:02:13.772 SYMLINK libspdk_scheduler_dynamic.so 00:02:13.772 SO libspdk_accel_dsa.so.4.0 00:02:13.772 LIB libspdk_blob_bdev.a 00:02:13.772 SYMLINK libspdk_accel_iaa.so 00:02:13.772 SO libspdk_blob_bdev.so.10.1 00:02:13.772 SYMLINK libspdk_accel_dsa.so 00:02:13.772 SYMLINK libspdk_blob_bdev.so 00:02:14.030 CC module/bdev/passthru/vbdev_passthru.o 00:02:14.030 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:14.030 CC module/bdev/malloc/bdev_malloc.o 00:02:14.030 CC module/bdev/split/vbdev_split.o 00:02:14.030 CC module/bdev/null/bdev_null.o 00:02:14.030 CC module/bdev/lvol/vbdev_lvol.o 00:02:14.030 CC module/bdev/nvme/bdev_nvme.o 00:02:14.030 CC module/bdev/gpt/gpt.o 00:02:14.030 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:14.030 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:14.030 CC module/bdev/aio/bdev_aio.o 00:02:14.030 CC module/blobfs/bdev/blobfs_bdev.o 00:02:14.030 CC module/bdev/gpt/vbdev_gpt.o 00:02:14.030 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:14.030 CC module/bdev/split/vbdev_split_rpc.o 00:02:14.030 CC module/bdev/null/bdev_null_rpc.o 00:02:14.030 CC module/bdev/delay/vbdev_delay.o 00:02:14.030 CC module/bdev/error/vbdev_error.o 00:02:14.030 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:14.030 CC module/bdev/nvme/nvme_rpc.o 00:02:14.030 CC module/bdev/raid/bdev_raid.o 00:02:14.030 CC module/bdev/raid/bdev_raid_rpc.o 00:02:14.030 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:14.030 CC module/bdev/error/vbdev_error_rpc.o 00:02:14.030 CC module/bdev/raid/bdev_raid_sb.o 00:02:14.030 CC module/bdev/aio/bdev_aio_rpc.o 00:02:14.030 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:14.030 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:14.030 CC module/bdev/nvme/bdev_mdns_client.o 00:02:14.030 CC module/bdev/ftl/bdev_ftl.o 00:02:14.030 CC module/bdev/nvme/vbdev_opal.o 00:02:14.030 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:14.030 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:14.030 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:14.030 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:14.030 CC module/bdev/raid/raid0.o 00:02:14.030 CC module/bdev/raid/raid1.o 00:02:14.030 CC module/bdev/raid/concat.o 00:02:14.030 CC module/bdev/iscsi/bdev_iscsi.o 00:02:14.030 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:14.030 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:14.030 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:14.289 LIB libspdk_bdev_error.a 00:02:14.289 LIB libspdk_bdev_passthru.a 00:02:14.289 LIB libspdk_blobfs_bdev.a 00:02:14.289 SO libspdk_bdev_error.so.5.0 00:02:14.289 LIB libspdk_sock_posix.a 00:02:14.289 SO libspdk_bdev_passthru.so.5.0 00:02:14.289 SO libspdk_blobfs_bdev.so.5.0 00:02:14.289 LIB libspdk_bdev_split.a 00:02:14.289 SO libspdk_sock_posix.so.5.0 00:02:14.289 LIB libspdk_bdev_gpt.a 00:02:14.289 SO libspdk_bdev_split.so.5.0 00:02:14.289 SYMLINK libspdk_bdev_error.so 00:02:14.289 LIB libspdk_bdev_null.a 00:02:14.289 SO libspdk_bdev_gpt.so.5.0 00:02:14.289 SYMLINK libspdk_bdev_passthru.so 00:02:14.289 SYMLINK libspdk_blobfs_bdev.so 00:02:14.289 SO libspdk_bdev_null.so.5.0 00:02:14.289 SYMLINK libspdk_bdev_split.so 00:02:14.289 LIB libspdk_bdev_zone_block.a 00:02:14.289 SYMLINK libspdk_sock_posix.so 00:02:14.548 SYMLINK libspdk_bdev_gpt.so 00:02:14.548 SO libspdk_bdev_zone_block.so.5.0 00:02:14.548 SYMLINK libspdk_bdev_null.so 00:02:14.548 LIB libspdk_bdev_ftl.a 00:02:14.548 LIB libspdk_bdev_malloc.a 00:02:14.548 SO libspdk_bdev_ftl.so.5.0 00:02:14.548 SO libspdk_bdev_malloc.so.5.0 00:02:14.548 SYMLINK libspdk_bdev_zone_block.so 00:02:14.548 LIB libspdk_bdev_aio.a 00:02:14.548 SYMLINK libspdk_bdev_ftl.so 00:02:14.548 SO libspdk_bdev_aio.so.5.0 00:02:14.548 SYMLINK libspdk_bdev_malloc.so 00:02:14.548 LIB libspdk_bdev_delay.a 00:02:14.548 LIB libspdk_bdev_iscsi.a 00:02:14.548 SO libspdk_bdev_delay.so.5.0 00:02:14.548 SYMLINK libspdk_bdev_aio.so 00:02:14.548 SO libspdk_bdev_iscsi.so.5.0 00:02:14.548 SYMLINK libspdk_bdev_delay.so 00:02:14.548 SYMLINK libspdk_bdev_iscsi.so 00:02:14.548 LIB libspdk_bdev_virtio.a 00:02:14.548 LIB libspdk_bdev_lvol.a 00:02:14.548 SO libspdk_bdev_virtio.so.5.0 00:02:14.807 SO libspdk_bdev_lvol.so.5.0 00:02:14.807 SYMLINK libspdk_bdev_virtio.so 00:02:14.807 SYMLINK libspdk_bdev_lvol.so 00:02:15.066 LIB libspdk_bdev_raid.a 00:02:15.066 SO libspdk_bdev_raid.so.5.0 00:02:15.066 SYMLINK libspdk_bdev_raid.so 00:02:16.546 LIB libspdk_bdev_nvme.a 00:02:16.546 SO libspdk_bdev_nvme.so.6.0 00:02:16.546 SYMLINK libspdk_bdev_nvme.so 00:02:16.546 CC module/event/subsystems/vmd/vmd.o 00:02:16.546 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:16.546 CC module/event/subsystems/iobuf/iobuf.o 00:02:16.546 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:16.546 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:16.546 CC module/event/subsystems/scheduler/scheduler.o 00:02:16.546 CC module/event/subsystems/sock/sock.o 00:02:16.805 LIB libspdk_event_sock.a 00:02:16.805 LIB libspdk_event_scheduler.a 00:02:16.805 LIB libspdk_event_vhost_blk.a 00:02:16.805 LIB libspdk_event_vmd.a 00:02:16.805 LIB libspdk_event_iobuf.a 00:02:16.805 SO libspdk_event_sock.so.4.0 00:02:16.805 SO libspdk_event_scheduler.so.3.0 00:02:16.805 SO libspdk_event_vhost_blk.so.2.0 00:02:16.805 SO libspdk_event_vmd.so.5.0 00:02:16.805 SO libspdk_event_iobuf.so.2.0 00:02:16.805 SYMLINK libspdk_event_sock.so 00:02:16.805 SYMLINK libspdk_event_scheduler.so 00:02:16.805 SYMLINK libspdk_event_vhost_blk.so 00:02:16.805 SYMLINK libspdk_event_vmd.so 00:02:16.805 SYMLINK libspdk_event_iobuf.so 00:02:17.064 CC module/event/subsystems/accel/accel.o 00:02:17.064 LIB libspdk_event_accel.a 00:02:17.064 SO libspdk_event_accel.so.5.0 00:02:17.064 SYMLINK libspdk_event_accel.so 00:02:17.323 CC module/event/subsystems/bdev/bdev.o 00:02:17.323 LIB libspdk_event_bdev.a 00:02:17.581 SO libspdk_event_bdev.so.5.0 00:02:17.581 SYMLINK libspdk_event_bdev.so 00:02:17.581 CC module/event/subsystems/nbd/nbd.o 00:02:17.581 CC module/event/subsystems/ublk/ublk.o 00:02:17.581 CC module/event/subsystems/scsi/scsi.o 00:02:17.581 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:17.581 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:17.840 LIB libspdk_event_nbd.a 00:02:17.840 LIB libspdk_event_ublk.a 00:02:17.840 SO libspdk_event_nbd.so.5.0 00:02:17.840 SO libspdk_event_ublk.so.2.0 00:02:17.840 LIB libspdk_event_scsi.a 00:02:17.840 SO libspdk_event_scsi.so.5.0 00:02:17.840 SYMLINK libspdk_event_ublk.so 00:02:17.840 SYMLINK libspdk_event_nbd.so 00:02:17.840 SYMLINK libspdk_event_scsi.so 00:02:17.840 LIB libspdk_event_nvmf.a 00:02:17.840 SO libspdk_event_nvmf.so.5.0 00:02:17.840 SYMLINK libspdk_event_nvmf.so 00:02:17.840 CC module/event/subsystems/iscsi/iscsi.o 00:02:17.840 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:18.098 LIB libspdk_event_vhost_scsi.a 00:02:18.098 LIB libspdk_event_iscsi.a 00:02:18.098 SO libspdk_event_vhost_scsi.so.2.0 00:02:18.098 SO libspdk_event_iscsi.so.5.0 00:02:18.098 SYMLINK libspdk_event_vhost_scsi.so 00:02:18.098 SYMLINK libspdk_event_iscsi.so 00:02:18.358 SO libspdk.so.5.0 00:02:18.358 SYMLINK libspdk.so 00:02:18.358 CC app/trace_record/trace_record.o 00:02:18.358 CC app/spdk_top/spdk_top.o 00:02:18.358 CC app/spdk_nvme_discover/discovery_aer.o 00:02:18.358 CC app/spdk_nvme_perf/perf.o 00:02:18.358 CXX app/trace/trace.o 00:02:18.358 CC app/spdk_nvme_identify/identify.o 00:02:18.358 CC test/rpc_client/rpc_client_test.o 00:02:18.358 CC app/spdk_lspci/spdk_lspci.o 00:02:18.358 TEST_HEADER include/spdk/accel.h 00:02:18.358 TEST_HEADER include/spdk/accel_module.h 00:02:18.358 TEST_HEADER include/spdk/assert.h 00:02:18.358 TEST_HEADER include/spdk/barrier.h 00:02:18.358 TEST_HEADER include/spdk/base64.h 00:02:18.358 TEST_HEADER include/spdk/bdev.h 00:02:18.358 TEST_HEADER include/spdk/bdev_module.h 00:02:18.358 TEST_HEADER include/spdk/bdev_zone.h 00:02:18.358 TEST_HEADER include/spdk/bit_array.h 00:02:18.358 TEST_HEADER include/spdk/bit_pool.h 00:02:18.358 TEST_HEADER include/spdk/blob_bdev.h 00:02:18.358 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:18.358 TEST_HEADER include/spdk/blobfs.h 00:02:18.358 TEST_HEADER include/spdk/blob.h 00:02:18.358 TEST_HEADER include/spdk/conf.h 00:02:18.358 TEST_HEADER include/spdk/config.h 00:02:18.358 CC app/spdk_dd/spdk_dd.o 00:02:18.358 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:18.358 TEST_HEADER include/spdk/cpuset.h 00:02:18.358 TEST_HEADER include/spdk/crc16.h 00:02:18.358 CC app/iscsi_tgt/iscsi_tgt.o 00:02:18.358 TEST_HEADER include/spdk/crc32.h 00:02:18.358 TEST_HEADER include/spdk/crc64.h 00:02:18.624 TEST_HEADER include/spdk/dif.h 00:02:18.624 CC app/nvmf_tgt/nvmf_main.o 00:02:18.624 TEST_HEADER include/spdk/dma.h 00:02:18.624 CC app/vhost/vhost.o 00:02:18.624 TEST_HEADER include/spdk/endian.h 00:02:18.624 CC examples/ioat/perf/perf.o 00:02:18.624 CC examples/vmd/lsvmd/lsvmd.o 00:02:18.624 CC examples/vmd/led/led.o 00:02:18.624 TEST_HEADER include/spdk/env_dpdk.h 00:02:18.624 CC examples/nvme/hello_world/hello_world.o 00:02:18.624 CC examples/sock/hello_world/hello_sock.o 00:02:18.624 TEST_HEADER include/spdk/env.h 00:02:18.624 CC examples/util/zipf/zipf.o 00:02:18.624 CC examples/nvme/arbitration/arbitration.o 00:02:18.624 CC examples/nvme/abort/abort.o 00:02:18.624 TEST_HEADER include/spdk/event.h 00:02:18.624 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:18.624 CC examples/nvme/hotplug/hotplug.o 00:02:18.624 CC examples/ioat/verify/verify.o 00:02:18.624 CC examples/nvme/reconnect/reconnect.o 00:02:18.624 CC app/fio/nvme/fio_plugin.o 00:02:18.624 TEST_HEADER include/spdk/fd_group.h 00:02:18.624 TEST_HEADER include/spdk/fd.h 00:02:18.624 CC test/event/event_perf/event_perf.o 00:02:18.624 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:18.624 TEST_HEADER include/spdk/file.h 00:02:18.624 CC test/thread/poller_perf/poller_perf.o 00:02:18.624 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:18.624 CC test/nvme/aer/aer.o 00:02:18.624 TEST_HEADER include/spdk/ftl.h 00:02:18.624 CC examples/accel/perf/accel_perf.o 00:02:18.624 TEST_HEADER include/spdk/gpt_spec.h 00:02:18.624 TEST_HEADER include/spdk/hexlify.h 00:02:18.624 CC examples/idxd/perf/perf.o 00:02:18.624 TEST_HEADER include/spdk/histogram_data.h 00:02:18.624 TEST_HEADER include/spdk/idxd.h 00:02:18.624 CC app/spdk_tgt/spdk_tgt.o 00:02:18.624 TEST_HEADER include/spdk/idxd_spec.h 00:02:18.624 TEST_HEADER include/spdk/init.h 00:02:18.624 TEST_HEADER include/spdk/ioat.h 00:02:18.624 TEST_HEADER include/spdk/ioat_spec.h 00:02:18.624 TEST_HEADER include/spdk/iscsi_spec.h 00:02:18.624 TEST_HEADER include/spdk/json.h 00:02:18.625 TEST_HEADER include/spdk/jsonrpc.h 00:02:18.625 CC examples/bdev/hello_world/hello_bdev.o 00:02:18.625 TEST_HEADER include/spdk/likely.h 00:02:18.625 CC test/bdev/bdevio/bdevio.o 00:02:18.625 TEST_HEADER include/spdk/log.h 00:02:18.625 TEST_HEADER include/spdk/lvol.h 00:02:18.625 CC test/accel/dif/dif.o 00:02:18.625 TEST_HEADER include/spdk/memory.h 00:02:18.625 CC test/blobfs/mkfs/mkfs.o 00:02:18.625 TEST_HEADER include/spdk/mmio.h 00:02:18.625 CC examples/nvmf/nvmf/nvmf.o 00:02:18.625 TEST_HEADER include/spdk/nbd.h 00:02:18.625 CC test/app/bdev_svc/bdev_svc.o 00:02:18.625 TEST_HEADER include/spdk/notify.h 00:02:18.625 CC examples/blob/hello_world/hello_blob.o 00:02:18.625 CC examples/thread/thread/thread_ex.o 00:02:18.625 CC examples/bdev/bdevperf/bdevperf.o 00:02:18.625 TEST_HEADER include/spdk/nvme.h 00:02:18.625 TEST_HEADER include/spdk/nvme_intel.h 00:02:18.625 CC test/dma/test_dma/test_dma.o 00:02:18.625 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:18.625 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:18.625 TEST_HEADER include/spdk/nvme_spec.h 00:02:18.625 TEST_HEADER include/spdk/nvme_zns.h 00:02:18.625 CC test/lvol/esnap/esnap.o 00:02:18.625 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:18.625 CC test/env/mem_callbacks/mem_callbacks.o 00:02:18.625 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:18.625 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:18.625 TEST_HEADER include/spdk/nvmf.h 00:02:18.625 TEST_HEADER include/spdk/nvmf_spec.h 00:02:18.625 TEST_HEADER include/spdk/nvmf_transport.h 00:02:18.625 TEST_HEADER include/spdk/opal.h 00:02:18.625 TEST_HEADER include/spdk/opal_spec.h 00:02:18.625 TEST_HEADER include/spdk/pci_ids.h 00:02:18.625 TEST_HEADER include/spdk/pipe.h 00:02:18.625 TEST_HEADER include/spdk/queue.h 00:02:18.625 TEST_HEADER include/spdk/reduce.h 00:02:18.625 TEST_HEADER include/spdk/rpc.h 00:02:18.625 TEST_HEADER include/spdk/scheduler.h 00:02:18.625 TEST_HEADER include/spdk/scsi.h 00:02:18.625 TEST_HEADER include/spdk/scsi_spec.h 00:02:18.625 TEST_HEADER include/spdk/sock.h 00:02:18.625 TEST_HEADER include/spdk/stdinc.h 00:02:18.625 TEST_HEADER include/spdk/string.h 00:02:18.625 TEST_HEADER include/spdk/thread.h 00:02:18.625 LINK spdk_lspci 00:02:18.625 TEST_HEADER include/spdk/trace.h 00:02:18.625 TEST_HEADER include/spdk/trace_parser.h 00:02:18.625 TEST_HEADER include/spdk/tree.h 00:02:18.625 TEST_HEADER include/spdk/ublk.h 00:02:18.625 TEST_HEADER include/spdk/util.h 00:02:18.625 TEST_HEADER include/spdk/uuid.h 00:02:18.625 TEST_HEADER include/spdk/version.h 00:02:18.625 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:18.625 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:18.625 TEST_HEADER include/spdk/vhost.h 00:02:18.625 TEST_HEADER include/spdk/vmd.h 00:02:18.625 TEST_HEADER include/spdk/xor.h 00:02:18.625 TEST_HEADER include/spdk/zipf.h 00:02:18.625 CXX test/cpp_headers/accel.o 00:02:18.883 LINK lsvmd 00:02:18.883 LINK rpc_client_test 00:02:18.883 LINK spdk_nvme_discover 00:02:18.883 LINK led 00:02:18.883 LINK event_perf 00:02:18.883 LINK poller_perf 00:02:18.883 LINK zipf 00:02:18.883 LINK interrupt_tgt 00:02:18.883 LINK nvmf_tgt 00:02:18.883 LINK vhost 00:02:18.883 LINK cmb_copy 00:02:18.883 LINK pmr_persistence 00:02:18.883 LINK spdk_trace_record 00:02:18.883 LINK iscsi_tgt 00:02:18.883 LINK ioat_perf 00:02:18.883 LINK bdev_svc 00:02:18.883 LINK hello_world 00:02:18.883 LINK spdk_tgt 00:02:18.883 LINK hello_sock 00:02:18.883 LINK mkfs 00:02:18.883 LINK verify 00:02:18.883 LINK hotplug 00:02:19.145 LINK hello_bdev 00:02:19.145 LINK hello_blob 00:02:19.145 LINK aer 00:02:19.145 LINK thread 00:02:19.145 CXX test/cpp_headers/accel_module.o 00:02:19.145 LINK arbitration 00:02:19.145 CC examples/blob/cli/blobcli.o 00:02:19.145 LINK idxd_perf 00:02:19.145 LINK nvmf 00:02:19.145 LINK spdk_dd 00:02:19.145 LINK reconnect 00:02:19.145 CC test/event/reactor/reactor.o 00:02:19.145 CC test/nvme/reset/reset.o 00:02:19.145 LINK abort 00:02:19.145 CC test/event/reactor_perf/reactor_perf.o 00:02:19.145 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:19.145 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:19.145 CC test/app/histogram_perf/histogram_perf.o 00:02:19.145 CC app/fio/bdev/fio_plugin.o 00:02:19.145 LINK spdk_trace 00:02:19.145 CXX test/cpp_headers/assert.o 00:02:19.145 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:19.145 CXX test/cpp_headers/barrier.o 00:02:19.145 CC test/env/vtophys/vtophys.o 00:02:19.145 CXX test/cpp_headers/base64.o 00:02:19.409 LINK dif 00:02:19.409 CC test/app/jsoncat/jsoncat.o 00:02:19.409 LINK bdevio 00:02:19.409 CC test/event/app_repeat/app_repeat.o 00:02:19.409 CC test/app/stub/stub.o 00:02:19.409 LINK test_dma 00:02:19.409 CXX test/cpp_headers/bdev.o 00:02:19.409 CC test/nvme/sgl/sgl.o 00:02:19.409 CC test/event/scheduler/scheduler.o 00:02:19.409 LINK nvme_fuzz 00:02:19.409 CC test/nvme/e2edp/nvme_dp.o 00:02:19.409 LINK accel_perf 00:02:19.409 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:19.409 CXX test/cpp_headers/bdev_module.o 00:02:19.409 CC test/env/memory/memory_ut.o 00:02:19.409 CXX test/cpp_headers/bdev_zone.o 00:02:19.409 CC test/nvme/overhead/overhead.o 00:02:19.409 LINK nvme_manage 00:02:19.409 LINK reactor 00:02:19.409 LINK reactor_perf 00:02:19.409 CC test/env/pci/pci_ut.o 00:02:19.671 LINK spdk_nvme 00:02:19.671 CXX test/cpp_headers/bit_array.o 00:02:19.671 LINK histogram_perf 00:02:19.671 CC test/nvme/err_injection/err_injection.o 00:02:19.671 CC test/nvme/startup/startup.o 00:02:19.671 CXX test/cpp_headers/bit_pool.o 00:02:19.671 LINK vtophys 00:02:19.671 LINK jsoncat 00:02:19.671 CC test/nvme/reserve/reserve.o 00:02:19.671 CC test/nvme/simple_copy/simple_copy.o 00:02:19.671 CXX test/cpp_headers/blob_bdev.o 00:02:19.671 CXX test/cpp_headers/blobfs_bdev.o 00:02:19.671 CC test/nvme/compliance/nvme_compliance.o 00:02:19.671 CC test/nvme/connect_stress/connect_stress.o 00:02:19.671 CXX test/cpp_headers/blobfs.o 00:02:19.671 CC test/nvme/boot_partition/boot_partition.o 00:02:19.671 LINK app_repeat 00:02:19.671 CXX test/cpp_headers/blob.o 00:02:19.671 LINK stub 00:02:19.671 CC test/nvme/fused_ordering/fused_ordering.o 00:02:19.671 CXX test/cpp_headers/conf.o 00:02:19.671 CXX test/cpp_headers/config.o 00:02:19.671 LINK reset 00:02:19.671 LINK env_dpdk_post_init 00:02:19.671 CXX test/cpp_headers/crc16.o 00:02:19.671 CXX test/cpp_headers/cpuset.o 00:02:19.671 CXX test/cpp_headers/crc32.o 00:02:19.671 CXX test/cpp_headers/crc64.o 00:02:19.671 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:19.935 CXX test/cpp_headers/dif.o 00:02:19.935 LINK mem_callbacks 00:02:19.935 CC test/nvme/fdp/fdp.o 00:02:19.935 CC test/nvme/cuse/cuse.o 00:02:19.935 LINK scheduler 00:02:19.935 CXX test/cpp_headers/dma.o 00:02:19.935 CXX test/cpp_headers/endian.o 00:02:19.935 CXX test/cpp_headers/env_dpdk.o 00:02:19.935 CXX test/cpp_headers/env.o 00:02:19.935 CXX test/cpp_headers/event.o 00:02:19.935 CXX test/cpp_headers/fd_group.o 00:02:19.935 LINK sgl 00:02:19.935 LINK startup 00:02:19.935 CXX test/cpp_headers/fd.o 00:02:19.935 LINK nvme_dp 00:02:19.935 LINK spdk_nvme_perf 00:02:19.935 LINK err_injection 00:02:19.935 LINK boot_partition 00:02:19.935 CXX test/cpp_headers/file.o 00:02:19.935 LINK reserve 00:02:19.935 LINK connect_stress 00:02:19.935 CXX test/cpp_headers/gpt_spec.o 00:02:19.935 CXX test/cpp_headers/ftl.o 00:02:19.935 LINK bdevperf 00:02:19.935 CXX test/cpp_headers/hexlify.o 00:02:19.935 LINK overhead 00:02:19.935 LINK vhost_fuzz 00:02:19.935 CXX test/cpp_headers/histogram_data.o 00:02:19.935 CXX test/cpp_headers/idxd.o 00:02:19.935 LINK spdk_nvme_identify 00:02:19.935 CXX test/cpp_headers/idxd_spec.o 00:02:19.935 CXX test/cpp_headers/init.o 00:02:20.196 LINK simple_copy 00:02:20.196 CXX test/cpp_headers/ioat.o 00:02:20.196 LINK spdk_top 00:02:20.196 CXX test/cpp_headers/ioat_spec.o 00:02:20.196 LINK fused_ordering 00:02:20.196 LINK blobcli 00:02:20.196 CXX test/cpp_headers/iscsi_spec.o 00:02:20.196 CXX test/cpp_headers/json.o 00:02:20.196 CXX test/cpp_headers/jsonrpc.o 00:02:20.196 CXX test/cpp_headers/likely.o 00:02:20.196 LINK doorbell_aers 00:02:20.196 LINK spdk_bdev 00:02:20.196 CXX test/cpp_headers/log.o 00:02:20.196 CXX test/cpp_headers/lvol.o 00:02:20.196 CXX test/cpp_headers/memory.o 00:02:20.196 CXX test/cpp_headers/mmio.o 00:02:20.196 CXX test/cpp_headers/nbd.o 00:02:20.196 CXX test/cpp_headers/notify.o 00:02:20.196 LINK nvme_compliance 00:02:20.196 CXX test/cpp_headers/nvme.o 00:02:20.196 CXX test/cpp_headers/nvme_intel.o 00:02:20.196 CXX test/cpp_headers/nvme_ocssd.o 00:02:20.196 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:20.196 CXX test/cpp_headers/nvme_spec.o 00:02:20.196 LINK pci_ut 00:02:20.196 CXX test/cpp_headers/nvme_zns.o 00:02:20.196 CXX test/cpp_headers/nvmf_cmd.o 00:02:20.196 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:20.196 CXX test/cpp_headers/nvmf.o 00:02:20.196 CXX test/cpp_headers/nvmf_spec.o 00:02:20.196 CXX test/cpp_headers/nvmf_transport.o 00:02:20.196 CXX test/cpp_headers/opal.o 00:02:20.196 CXX test/cpp_headers/opal_spec.o 00:02:20.196 CXX test/cpp_headers/pci_ids.o 00:02:20.461 CXX test/cpp_headers/pipe.o 00:02:20.461 CXX test/cpp_headers/queue.o 00:02:20.461 CXX test/cpp_headers/reduce.o 00:02:20.461 CXX test/cpp_headers/rpc.o 00:02:20.461 CXX test/cpp_headers/scheduler.o 00:02:20.461 CXX test/cpp_headers/scsi.o 00:02:20.461 CXX test/cpp_headers/scsi_spec.o 00:02:20.461 CXX test/cpp_headers/sock.o 00:02:20.461 CXX test/cpp_headers/stdinc.o 00:02:20.461 CXX test/cpp_headers/string.o 00:02:20.461 CXX test/cpp_headers/thread.o 00:02:20.461 CXX test/cpp_headers/trace.o 00:02:20.461 CXX test/cpp_headers/trace_parser.o 00:02:20.461 CXX test/cpp_headers/tree.o 00:02:20.461 CXX test/cpp_headers/ublk.o 00:02:20.461 CXX test/cpp_headers/util.o 00:02:20.461 LINK fdp 00:02:20.461 CXX test/cpp_headers/uuid.o 00:02:20.461 CXX test/cpp_headers/version.o 00:02:20.461 CXX test/cpp_headers/vfio_user_pci.o 00:02:20.461 CXX test/cpp_headers/vfio_user_spec.o 00:02:20.461 CXX test/cpp_headers/vhost.o 00:02:20.461 CXX test/cpp_headers/vmd.o 00:02:20.461 CXX test/cpp_headers/xor.o 00:02:20.461 CXX test/cpp_headers/zipf.o 00:02:21.027 LINK memory_ut 00:02:21.284 LINK cuse 00:02:21.542 LINK iscsi_fuzz 00:02:24.072 LINK esnap 00:02:24.330 00:02:24.330 real 0m46.583s 00:02:24.330 user 9m40.225s 00:02:24.330 sys 2m10.497s 00:02:24.330 04:09:01 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:24.330 04:09:01 -- common/autotest_common.sh@10 -- $ set +x 00:02:24.330 ************************************ 00:02:24.330 END TEST make 00:02:24.330 ************************************ 00:02:24.588 04:09:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:24.589 04:09:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:24.589 04:09:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:24.589 04:09:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:24.589 04:09:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:24.589 04:09:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:24.589 04:09:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:24.589 04:09:01 -- scripts/common.sh@335 -- # IFS=.-: 00:02:24.589 04:09:01 -- scripts/common.sh@335 -- # read -ra ver1 00:02:24.589 04:09:01 -- scripts/common.sh@336 -- # IFS=.-: 00:02:24.589 04:09:01 -- scripts/common.sh@336 -- # read -ra ver2 00:02:24.589 04:09:01 -- scripts/common.sh@337 -- # local 'op=<' 00:02:24.589 04:09:01 -- scripts/common.sh@339 -- # ver1_l=2 00:02:24.589 04:09:01 -- scripts/common.sh@340 -- # ver2_l=1 00:02:24.589 04:09:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:24.589 04:09:01 -- scripts/common.sh@343 -- # case "$op" in 00:02:24.589 04:09:01 -- scripts/common.sh@344 -- # : 1 00:02:24.589 04:09:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:24.589 04:09:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:24.589 04:09:01 -- scripts/common.sh@364 -- # decimal 1 00:02:24.589 04:09:01 -- scripts/common.sh@352 -- # local d=1 00:02:24.589 04:09:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:24.589 04:09:01 -- scripts/common.sh@354 -- # echo 1 00:02:24.589 04:09:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:24.589 04:09:01 -- scripts/common.sh@365 -- # decimal 2 00:02:24.589 04:09:01 -- scripts/common.sh@352 -- # local d=2 00:02:24.589 04:09:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:24.589 04:09:01 -- scripts/common.sh@354 -- # echo 2 00:02:24.589 04:09:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:24.589 04:09:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:24.589 04:09:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:24.589 04:09:01 -- scripts/common.sh@367 -- # return 0 00:02:24.589 04:09:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:24.589 04:09:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:24.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:24.589 --rc genhtml_branch_coverage=1 00:02:24.589 --rc genhtml_function_coverage=1 00:02:24.589 --rc genhtml_legend=1 00:02:24.589 --rc geninfo_all_blocks=1 00:02:24.589 --rc geninfo_unexecuted_blocks=1 00:02:24.589 00:02:24.589 ' 00:02:24.589 04:09:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:24.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:24.589 --rc genhtml_branch_coverage=1 00:02:24.589 --rc genhtml_function_coverage=1 00:02:24.589 --rc genhtml_legend=1 00:02:24.589 --rc geninfo_all_blocks=1 00:02:24.589 --rc geninfo_unexecuted_blocks=1 00:02:24.589 00:02:24.589 ' 00:02:24.589 04:09:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:24.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:24.589 --rc genhtml_branch_coverage=1 00:02:24.589 --rc genhtml_function_coverage=1 00:02:24.589 --rc genhtml_legend=1 00:02:24.589 --rc geninfo_all_blocks=1 00:02:24.589 --rc geninfo_unexecuted_blocks=1 00:02:24.589 00:02:24.589 ' 00:02:24.589 04:09:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:24.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:24.589 --rc genhtml_branch_coverage=1 00:02:24.589 --rc genhtml_function_coverage=1 00:02:24.589 --rc genhtml_legend=1 00:02:24.589 --rc geninfo_all_blocks=1 00:02:24.589 --rc geninfo_unexecuted_blocks=1 00:02:24.589 00:02:24.589 ' 00:02:24.589 04:09:01 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:24.589 04:09:01 -- nvmf/common.sh@7 -- # uname -s 00:02:24.589 04:09:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:24.589 04:09:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:24.589 04:09:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:24.589 04:09:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:24.589 04:09:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:24.589 04:09:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:24.589 04:09:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:24.589 04:09:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:24.589 04:09:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:24.589 04:09:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:24.589 04:09:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:24.589 04:09:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:24.589 04:09:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:24.589 04:09:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:24.589 04:09:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:24.589 04:09:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:24.589 04:09:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:24.589 04:09:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:24.589 04:09:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:24.589 04:09:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:24.589 04:09:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:24.589 04:09:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:24.589 04:09:01 -- paths/export.sh@5 -- # export PATH 00:02:24.589 04:09:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:24.589 04:09:01 -- nvmf/common.sh@46 -- # : 0 00:02:24.589 04:09:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:24.589 04:09:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:24.589 04:09:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:24.589 04:09:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:24.589 04:09:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:24.589 04:09:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:24.589 04:09:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:24.589 04:09:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:24.589 04:09:01 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:24.589 04:09:01 -- spdk/autotest.sh@32 -- # uname -s 00:02:24.589 04:09:01 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:24.589 04:09:01 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:24.589 04:09:01 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:24.589 04:09:01 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:24.589 04:09:01 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:24.589 04:09:01 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:24.589 04:09:01 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:24.589 04:09:01 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:24.589 04:09:01 -- spdk/autotest.sh@48 -- # udevadm_pid=3740316 00:02:24.589 04:09:01 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:24.589 04:09:01 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:24.589 04:09:01 -- spdk/autotest.sh@54 -- # echo 3740318 00:02:24.589 04:09:01 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:24.589 04:09:01 -- spdk/autotest.sh@56 -- # echo 3740319 00:02:24.589 04:09:01 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:24.589 04:09:01 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:24.589 04:09:01 -- spdk/autotest.sh@60 -- # echo 3740320 00:02:24.589 04:09:01 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:24.589 04:09:01 -- spdk/autotest.sh@62 -- # echo 3740321 00:02:24.589 04:09:01 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:24.589 04:09:01 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:24.589 04:09:01 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:24.589 04:09:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:24.589 04:09:01 -- common/autotest_common.sh@10 -- # set +x 00:02:24.589 04:09:01 -- spdk/autotest.sh@70 -- # create_test_list 00:02:24.589 04:09:01 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:24.589 04:09:01 -- common/autotest_common.sh@10 -- # set +x 00:02:24.589 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:24.589 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:24.589 04:09:01 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:24.589 04:09:01 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:24.589 04:09:01 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:24.589 04:09:01 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:24.589 04:09:01 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:24.589 04:09:01 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:24.589 04:09:01 -- common/autotest_common.sh@1450 -- # uname 00:02:24.589 04:09:01 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:24.589 04:09:01 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:24.589 04:09:01 -- common/autotest_common.sh@1470 -- # uname 00:02:24.590 04:09:01 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:24.590 04:09:01 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:24.590 04:09:01 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:24.848 lcov: LCOV version 1.15 00:02:24.848 04:09:01 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:28.132 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:28.132 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:28.132 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:28.132 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:28.132 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:28.132 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:00.202 04:09:34 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:00.202 04:09:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:00.202 04:09:34 -- common/autotest_common.sh@10 -- # set +x 00:03:00.202 04:09:34 -- spdk/autotest.sh@89 -- # rm -f 00:03:00.202 04:09:34 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:00.202 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:00.202 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:00.202 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:00.202 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:00.202 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:00.202 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:00.202 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:00.202 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:00.202 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:00.202 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:00.202 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:00.202 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:00.202 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:00.202 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:00.202 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:00.202 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:00.202 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:00.202 04:09:35 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:00.202 04:09:35 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:00.202 04:09:35 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:00.202 04:09:35 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:00.202 04:09:35 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:00.202 04:09:35 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:00.202 04:09:35 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:00.202 04:09:35 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:00.202 04:09:35 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:00.202 04:09:35 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:00.202 04:09:35 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:00.202 04:09:35 -- spdk/autotest.sh@108 -- # grep -v p 00:03:00.202 04:09:35 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:00.202 04:09:35 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:00.202 04:09:35 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:00.202 04:09:35 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:00.202 04:09:35 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:00.202 No valid GPT data, bailing 00:03:00.202 04:09:35 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:00.202 04:09:35 -- scripts/common.sh@393 -- # pt= 00:03:00.202 04:09:35 -- scripts/common.sh@394 -- # return 1 00:03:00.202 04:09:35 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:00.202 1+0 records in 00:03:00.202 1+0 records out 00:03:00.202 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00226736 s, 462 MB/s 00:03:00.202 04:09:35 -- spdk/autotest.sh@116 -- # sync 00:03:00.202 04:09:35 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:00.202 04:09:35 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:00.202 04:09:35 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:00.460 04:09:37 -- spdk/autotest.sh@122 -- # uname -s 00:03:00.460 04:09:37 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:00.460 04:09:37 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:00.460 04:09:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:00.460 04:09:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:00.460 04:09:37 -- common/autotest_common.sh@10 -- # set +x 00:03:00.460 ************************************ 00:03:00.460 START TEST setup.sh 00:03:00.460 ************************************ 00:03:00.460 04:09:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:00.460 * Looking for test storage... 00:03:00.460 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:00.460 04:09:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:00.460 04:09:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:00.460 04:09:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:00.719 04:09:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:00.719 04:09:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:00.719 04:09:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:00.719 04:09:37 -- scripts/common.sh@335 -- # IFS=.-: 00:03:00.719 04:09:37 -- scripts/common.sh@335 -- # read -ra ver1 00:03:00.719 04:09:37 -- scripts/common.sh@336 -- # IFS=.-: 00:03:00.719 04:09:37 -- scripts/common.sh@336 -- # read -ra ver2 00:03:00.719 04:09:37 -- scripts/common.sh@337 -- # local 'op=<' 00:03:00.719 04:09:37 -- scripts/common.sh@339 -- # ver1_l=2 00:03:00.719 04:09:37 -- scripts/common.sh@340 -- # ver2_l=1 00:03:00.719 04:09:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:00.719 04:09:37 -- scripts/common.sh@343 -- # case "$op" in 00:03:00.719 04:09:37 -- scripts/common.sh@344 -- # : 1 00:03:00.719 04:09:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:00.719 04:09:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:00.719 04:09:37 -- scripts/common.sh@364 -- # decimal 1 00:03:00.719 04:09:37 -- scripts/common.sh@352 -- # local d=1 00:03:00.719 04:09:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:00.719 04:09:37 -- scripts/common.sh@354 -- # echo 1 00:03:00.719 04:09:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:00.719 04:09:37 -- scripts/common.sh@365 -- # decimal 2 00:03:00.719 04:09:37 -- scripts/common.sh@352 -- # local d=2 00:03:00.719 04:09:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:00.719 04:09:37 -- scripts/common.sh@354 -- # echo 2 00:03:00.719 04:09:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:00.719 04:09:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:00.719 04:09:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:00.719 04:09:37 -- scripts/common.sh@367 -- # return 0 00:03:00.719 04:09:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:00.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.719 --rc genhtml_branch_coverage=1 00:03:00.719 --rc genhtml_function_coverage=1 00:03:00.719 --rc genhtml_legend=1 00:03:00.719 --rc geninfo_all_blocks=1 00:03:00.719 --rc geninfo_unexecuted_blocks=1 00:03:00.719 00:03:00.719 ' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:00.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.719 --rc genhtml_branch_coverage=1 00:03:00.719 --rc genhtml_function_coverage=1 00:03:00.719 --rc genhtml_legend=1 00:03:00.719 --rc geninfo_all_blocks=1 00:03:00.719 --rc geninfo_unexecuted_blocks=1 00:03:00.719 00:03:00.719 ' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:00.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.719 --rc genhtml_branch_coverage=1 00:03:00.719 --rc genhtml_function_coverage=1 00:03:00.719 --rc genhtml_legend=1 00:03:00.719 --rc geninfo_all_blocks=1 00:03:00.719 --rc geninfo_unexecuted_blocks=1 00:03:00.719 00:03:00.719 ' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:00.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.719 --rc genhtml_branch_coverage=1 00:03:00.719 --rc genhtml_function_coverage=1 00:03:00.719 --rc genhtml_legend=1 00:03:00.719 --rc geninfo_all_blocks=1 00:03:00.719 --rc geninfo_unexecuted_blocks=1 00:03:00.719 00:03:00.719 ' 00:03:00.719 04:09:37 -- setup/test-setup.sh@10 -- # uname -s 00:03:00.719 04:09:37 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:00.719 04:09:37 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:00.719 04:09:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:00.719 04:09:37 -- common/autotest_common.sh@10 -- # set +x 00:03:00.719 ************************************ 00:03:00.719 START TEST acl 00:03:00.719 ************************************ 00:03:00.719 04:09:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:00.719 * Looking for test storage... 00:03:00.719 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:00.719 04:09:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:00.719 04:09:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:00.719 04:09:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:00.719 04:09:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:00.719 04:09:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:00.719 04:09:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:00.719 04:09:37 -- scripts/common.sh@335 -- # IFS=.-: 00:03:00.719 04:09:37 -- scripts/common.sh@335 -- # read -ra ver1 00:03:00.719 04:09:37 -- scripts/common.sh@336 -- # IFS=.-: 00:03:00.719 04:09:37 -- scripts/common.sh@336 -- # read -ra ver2 00:03:00.719 04:09:37 -- scripts/common.sh@337 -- # local 'op=<' 00:03:00.719 04:09:37 -- scripts/common.sh@339 -- # ver1_l=2 00:03:00.719 04:09:37 -- scripts/common.sh@340 -- # ver2_l=1 00:03:00.719 04:09:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:00.719 04:09:37 -- scripts/common.sh@343 -- # case "$op" in 00:03:00.719 04:09:37 -- scripts/common.sh@344 -- # : 1 00:03:00.719 04:09:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:00.719 04:09:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:00.719 04:09:37 -- scripts/common.sh@364 -- # decimal 1 00:03:00.719 04:09:37 -- scripts/common.sh@352 -- # local d=1 00:03:00.719 04:09:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:00.719 04:09:37 -- scripts/common.sh@354 -- # echo 1 00:03:00.719 04:09:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:00.719 04:09:37 -- scripts/common.sh@365 -- # decimal 2 00:03:00.719 04:09:37 -- scripts/common.sh@352 -- # local d=2 00:03:00.719 04:09:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:00.719 04:09:37 -- scripts/common.sh@354 -- # echo 2 00:03:00.719 04:09:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:00.719 04:09:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:00.719 04:09:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:00.719 04:09:37 -- scripts/common.sh@367 -- # return 0 00:03:00.719 04:09:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:00.719 04:09:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:00.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.719 --rc genhtml_branch_coverage=1 00:03:00.719 --rc genhtml_function_coverage=1 00:03:00.719 --rc genhtml_legend=1 00:03:00.719 --rc geninfo_all_blocks=1 00:03:00.719 --rc geninfo_unexecuted_blocks=1 00:03:00.719 00:03:00.719 ' 00:03:00.720 04:09:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:00.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.720 --rc genhtml_branch_coverage=1 00:03:00.720 --rc genhtml_function_coverage=1 00:03:00.720 --rc genhtml_legend=1 00:03:00.720 --rc geninfo_all_blocks=1 00:03:00.720 --rc geninfo_unexecuted_blocks=1 00:03:00.720 00:03:00.720 ' 00:03:00.720 04:09:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:00.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.720 --rc genhtml_branch_coverage=1 00:03:00.720 --rc genhtml_function_coverage=1 00:03:00.720 --rc genhtml_legend=1 00:03:00.720 --rc geninfo_all_blocks=1 00:03:00.720 --rc geninfo_unexecuted_blocks=1 00:03:00.720 00:03:00.720 ' 00:03:00.720 04:09:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:00.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:00.720 --rc genhtml_branch_coverage=1 00:03:00.720 --rc genhtml_function_coverage=1 00:03:00.720 --rc genhtml_legend=1 00:03:00.720 --rc geninfo_all_blocks=1 00:03:00.720 --rc geninfo_unexecuted_blocks=1 00:03:00.720 00:03:00.720 ' 00:03:00.720 04:09:37 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:00.720 04:09:37 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:00.720 04:09:37 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:00.720 04:09:37 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:00.720 04:09:37 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:00.720 04:09:37 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:00.720 04:09:37 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:00.720 04:09:37 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:00.720 04:09:37 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:00.720 04:09:37 -- setup/acl.sh@12 -- # devs=() 00:03:00.720 04:09:37 -- setup/acl.sh@12 -- # declare -a devs 00:03:00.720 04:09:37 -- setup/acl.sh@13 -- # drivers=() 00:03:00.720 04:09:37 -- setup/acl.sh@13 -- # declare -A drivers 00:03:00.720 04:09:37 -- setup/acl.sh@51 -- # setup reset 00:03:00.720 04:09:37 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:00.720 04:09:37 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:02.620 04:09:39 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:02.620 04:09:39 -- setup/acl.sh@16 -- # local dev driver 00:03:02.620 04:09:39 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:02.620 04:09:39 -- setup/acl.sh@15 -- # setup output status 00:03:02.620 04:09:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:02.620 04:09:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:03.554 Hugepages 00:03:03.554 node hugesize free / total 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 00:03:03.554 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.554 04:09:40 -- setup/acl.sh@20 -- # continue 00:03:03.554 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.554 04:09:40 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:03.555 04:09:40 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:03.555 04:09:40 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:03.555 04:09:40 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:03.555 04:09:40 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:03.555 04:09:40 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.555 04:09:40 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:03.555 04:09:40 -- setup/acl.sh@54 -- # run_test denied denied 00:03:03.555 04:09:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.555 04:09:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.555 04:09:40 -- common/autotest_common.sh@10 -- # set +x 00:03:03.555 ************************************ 00:03:03.555 START TEST denied 00:03:03.555 ************************************ 00:03:03.555 04:09:40 -- common/autotest_common.sh@1114 -- # denied 00:03:03.555 04:09:40 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:03.555 04:09:40 -- setup/acl.sh@38 -- # setup output config 00:03:03.555 04:09:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.555 04:09:40 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:03.555 04:09:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:04.929 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:04.929 04:09:42 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:04.929 04:09:42 -- setup/acl.sh@28 -- # local dev driver 00:03:04.929 04:09:42 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:04.929 04:09:42 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:04.929 04:09:42 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:04.929 04:09:42 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:04.929 04:09:42 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:04.929 04:09:42 -- setup/acl.sh@41 -- # setup reset 00:03:04.929 04:09:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:04.929 04:09:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:07.462 00:03:07.462 real 0m3.757s 00:03:07.462 user 0m1.072s 00:03:07.462 sys 0m1.842s 00:03:07.462 04:09:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:07.462 04:09:44 -- common/autotest_common.sh@10 -- # set +x 00:03:07.462 ************************************ 00:03:07.462 END TEST denied 00:03:07.462 ************************************ 00:03:07.462 04:09:44 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:07.462 04:09:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:07.462 04:09:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:07.462 04:09:44 -- common/autotest_common.sh@10 -- # set +x 00:03:07.462 ************************************ 00:03:07.462 START TEST allowed 00:03:07.462 ************************************ 00:03:07.462 04:09:44 -- common/autotest_common.sh@1114 -- # allowed 00:03:07.462 04:09:44 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:07.462 04:09:44 -- setup/acl.sh@45 -- # setup output config 00:03:07.462 04:09:44 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:07.462 04:09:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.462 04:09:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:09.994 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:09.994 04:09:46 -- setup/acl.sh@47 -- # verify 00:03:09.994 04:09:46 -- setup/acl.sh@28 -- # local dev driver 00:03:09.994 04:09:46 -- setup/acl.sh@48 -- # setup reset 00:03:09.994 04:09:46 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:09.994 04:09:46 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:11.372 00:03:11.372 real 0m3.820s 00:03:11.372 user 0m1.004s 00:03:11.372 sys 0m1.712s 00:03:11.372 04:09:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:11.372 04:09:48 -- common/autotest_common.sh@10 -- # set +x 00:03:11.372 ************************************ 00:03:11.372 END TEST allowed 00:03:11.372 ************************************ 00:03:11.372 00:03:11.372 real 0m10.446s 00:03:11.372 user 0m3.205s 00:03:11.372 sys 0m5.380s 00:03:11.372 04:09:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:11.372 04:09:48 -- common/autotest_common.sh@10 -- # set +x 00:03:11.372 ************************************ 00:03:11.372 END TEST acl 00:03:11.372 ************************************ 00:03:11.372 04:09:48 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:11.372 04:09:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.372 04:09:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.372 04:09:48 -- common/autotest_common.sh@10 -- # set +x 00:03:11.372 ************************************ 00:03:11.372 START TEST hugepages 00:03:11.372 ************************************ 00:03:11.372 04:09:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:11.372 * Looking for test storage... 00:03:11.372 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:11.372 04:09:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:11.372 04:09:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:11.372 04:09:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:11.372 04:09:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:11.372 04:09:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:11.372 04:09:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:11.372 04:09:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:11.372 04:09:48 -- scripts/common.sh@335 -- # IFS=.-: 00:03:11.372 04:09:48 -- scripts/common.sh@335 -- # read -ra ver1 00:03:11.372 04:09:48 -- scripts/common.sh@336 -- # IFS=.-: 00:03:11.372 04:09:48 -- scripts/common.sh@336 -- # read -ra ver2 00:03:11.372 04:09:48 -- scripts/common.sh@337 -- # local 'op=<' 00:03:11.372 04:09:48 -- scripts/common.sh@339 -- # ver1_l=2 00:03:11.372 04:09:48 -- scripts/common.sh@340 -- # ver2_l=1 00:03:11.372 04:09:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:11.372 04:09:48 -- scripts/common.sh@343 -- # case "$op" in 00:03:11.372 04:09:48 -- scripts/common.sh@344 -- # : 1 00:03:11.372 04:09:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:11.372 04:09:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:11.372 04:09:48 -- scripts/common.sh@364 -- # decimal 1 00:03:11.372 04:09:48 -- scripts/common.sh@352 -- # local d=1 00:03:11.372 04:09:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:11.372 04:09:48 -- scripts/common.sh@354 -- # echo 1 00:03:11.372 04:09:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:11.372 04:09:48 -- scripts/common.sh@365 -- # decimal 2 00:03:11.373 04:09:48 -- scripts/common.sh@352 -- # local d=2 00:03:11.373 04:09:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:11.373 04:09:48 -- scripts/common.sh@354 -- # echo 2 00:03:11.373 04:09:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:11.373 04:09:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:11.373 04:09:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:11.373 04:09:48 -- scripts/common.sh@367 -- # return 0 00:03:11.373 04:09:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:11.373 04:09:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:11.373 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:11.373 --rc genhtml_branch_coverage=1 00:03:11.373 --rc genhtml_function_coverage=1 00:03:11.373 --rc genhtml_legend=1 00:03:11.373 --rc geninfo_all_blocks=1 00:03:11.373 --rc geninfo_unexecuted_blocks=1 00:03:11.373 00:03:11.373 ' 00:03:11.373 04:09:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:11.373 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:11.373 --rc genhtml_branch_coverage=1 00:03:11.373 --rc genhtml_function_coverage=1 00:03:11.373 --rc genhtml_legend=1 00:03:11.373 --rc geninfo_all_blocks=1 00:03:11.373 --rc geninfo_unexecuted_blocks=1 00:03:11.373 00:03:11.373 ' 00:03:11.373 04:09:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:11.373 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:11.373 --rc genhtml_branch_coverage=1 00:03:11.373 --rc genhtml_function_coverage=1 00:03:11.373 --rc genhtml_legend=1 00:03:11.373 --rc geninfo_all_blocks=1 00:03:11.373 --rc geninfo_unexecuted_blocks=1 00:03:11.373 00:03:11.373 ' 00:03:11.373 04:09:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:11.373 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:11.373 --rc genhtml_branch_coverage=1 00:03:11.373 --rc genhtml_function_coverage=1 00:03:11.373 --rc genhtml_legend=1 00:03:11.373 --rc geninfo_all_blocks=1 00:03:11.373 --rc geninfo_unexecuted_blocks=1 00:03:11.373 00:03:11.373 ' 00:03:11.373 04:09:48 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:11.373 04:09:48 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:11.373 04:09:48 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:11.373 04:09:48 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:11.373 04:09:48 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:11.373 04:09:48 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:11.373 04:09:48 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:11.373 04:09:48 -- setup/common.sh@18 -- # local node= 00:03:11.373 04:09:48 -- setup/common.sh@19 -- # local var val 00:03:11.373 04:09:48 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.373 04:09:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.373 04:09:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.373 04:09:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.373 04:09:48 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.373 04:09:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43040832 kB' 'MemAvailable: 46811332 kB' 'Buffers: 2708 kB' 'Cached: 10753500 kB' 'SwapCached: 0 kB' 'Active: 7469432 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068952 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480616 kB' 'Mapped: 217380 kB' 'Shmem: 6591616 kB' 'KReclaimable: 198976 kB' 'Slab: 737120 kB' 'SReclaimable: 198976 kB' 'SUnreclaim: 538144 kB' 'KernelStack: 12800 kB' 'PageTables: 8408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 8140072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.373 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.373 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.374 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.374 04:09:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # continue 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.375 04:09:48 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.375 04:09:48 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:11.375 04:09:48 -- setup/common.sh@33 -- # echo 2048 00:03:11.375 04:09:48 -- setup/common.sh@33 -- # return 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:11.375 04:09:48 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:11.375 04:09:48 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:11.375 04:09:48 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:11.375 04:09:48 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:11.375 04:09:48 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:11.375 04:09:48 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:11.375 04:09:48 -- setup/hugepages.sh@207 -- # get_nodes 00:03:11.375 04:09:48 -- setup/hugepages.sh@27 -- # local node 00:03:11.375 04:09:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:11.375 04:09:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:11.375 04:09:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:11.375 04:09:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:11.375 04:09:48 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:11.375 04:09:48 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:11.375 04:09:48 -- setup/hugepages.sh@208 -- # clear_hp 00:03:11.375 04:09:48 -- setup/hugepages.sh@37 -- # local node hp 00:03:11.375 04:09:48 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:11.375 04:09:48 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.375 04:09:48 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.375 04:09:48 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:11.375 04:09:48 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.375 04:09:48 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:11.375 04:09:48 -- setup/hugepages.sh@41 -- # echo 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:11.375 04:09:48 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:11.375 04:09:48 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:11.375 04:09:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.375 04:09:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.375 04:09:48 -- common/autotest_common.sh@10 -- # set +x 00:03:11.375 ************************************ 00:03:11.375 START TEST default_setup 00:03:11.375 ************************************ 00:03:11.375 04:09:48 -- common/autotest_common.sh@1114 -- # default_setup 00:03:11.375 04:09:48 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:11.375 04:09:48 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:11.375 04:09:48 -- setup/hugepages.sh@51 -- # shift 00:03:11.375 04:09:48 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:11.375 04:09:48 -- setup/hugepages.sh@52 -- # local node_ids 00:03:11.375 04:09:48 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:11.375 04:09:48 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:11.375 04:09:48 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:11.375 04:09:48 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:11.375 04:09:48 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:11.375 04:09:48 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:11.375 04:09:48 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:11.375 04:09:48 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:11.375 04:09:48 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:11.375 04:09:48 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:11.375 04:09:48 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:11.375 04:09:48 -- setup/hugepages.sh@73 -- # return 0 00:03:11.375 04:09:48 -- setup/hugepages.sh@137 -- # setup output 00:03:11.375 04:09:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:11.375 04:09:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:12.751 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:12.751 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:12.751 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:12.751 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:12.751 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:12.751 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:12.751 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:12.751 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:12.751 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:13.693 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:13.693 04:09:50 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:13.693 04:09:50 -- setup/hugepages.sh@89 -- # local node 00:03:13.693 04:09:50 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:13.693 04:09:50 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:13.693 04:09:50 -- setup/hugepages.sh@92 -- # local surp 00:03:13.693 04:09:50 -- setup/hugepages.sh@93 -- # local resv 00:03:13.693 04:09:50 -- setup/hugepages.sh@94 -- # local anon 00:03:13.693 04:09:50 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:13.693 04:09:50 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:13.693 04:09:50 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:13.693 04:09:50 -- setup/common.sh@18 -- # local node= 00:03:13.693 04:09:50 -- setup/common.sh@19 -- # local var val 00:03:13.693 04:09:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.693 04:09:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.693 04:09:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.693 04:09:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.693 04:09:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.693 04:09:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45109952 kB' 'MemAvailable: 48880436 kB' 'Buffers: 2708 kB' 'Cached: 10753596 kB' 'SwapCached: 0 kB' 'Active: 7470288 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069808 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481288 kB' 'Mapped: 216164 kB' 'Shmem: 6591712 kB' 'KReclaimable: 198944 kB' 'Slab: 737068 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538124 kB' 'KernelStack: 12864 kB' 'PageTables: 7700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.693 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.693 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.694 04:09:50 -- setup/common.sh@33 -- # echo 0 00:03:13.694 04:09:50 -- setup/common.sh@33 -- # return 0 00:03:13.694 04:09:50 -- setup/hugepages.sh@97 -- # anon=0 00:03:13.694 04:09:50 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:13.694 04:09:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.694 04:09:50 -- setup/common.sh@18 -- # local node= 00:03:13.694 04:09:50 -- setup/common.sh@19 -- # local var val 00:03:13.694 04:09:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.694 04:09:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.694 04:09:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.694 04:09:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.694 04:09:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.694 04:09:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45109952 kB' 'MemAvailable: 48880436 kB' 'Buffers: 2708 kB' 'Cached: 10753600 kB' 'SwapCached: 0 kB' 'Active: 7470288 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069808 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481424 kB' 'Mapped: 216164 kB' 'Shmem: 6591716 kB' 'KReclaimable: 198944 kB' 'Slab: 737076 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538132 kB' 'KernelStack: 12800 kB' 'PageTables: 7812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.694 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.694 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.695 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.695 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.696 04:09:50 -- setup/common.sh@33 -- # echo 0 00:03:13.696 04:09:50 -- setup/common.sh@33 -- # return 0 00:03:13.696 04:09:50 -- setup/hugepages.sh@99 -- # surp=0 00:03:13.696 04:09:50 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:13.696 04:09:50 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:13.696 04:09:50 -- setup/common.sh@18 -- # local node= 00:03:13.696 04:09:50 -- setup/common.sh@19 -- # local var val 00:03:13.696 04:09:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.696 04:09:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.696 04:09:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.696 04:09:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.696 04:09:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.696 04:09:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45109700 kB' 'MemAvailable: 48880184 kB' 'Buffers: 2708 kB' 'Cached: 10753604 kB' 'SwapCached: 0 kB' 'Active: 7470176 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069696 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481320 kB' 'Mapped: 216100 kB' 'Shmem: 6591720 kB' 'KReclaimable: 198944 kB' 'Slab: 737080 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538136 kB' 'KernelStack: 12848 kB' 'PageTables: 8340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143400 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.696 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.696 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.697 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.697 04:09:50 -- setup/common.sh@33 -- # echo 0 00:03:13.697 04:09:50 -- setup/common.sh@33 -- # return 0 00:03:13.697 04:09:50 -- setup/hugepages.sh@100 -- # resv=0 00:03:13.697 04:09:50 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:13.697 nr_hugepages=1024 00:03:13.697 04:09:50 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:13.697 resv_hugepages=0 00:03:13.697 04:09:50 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:13.697 surplus_hugepages=0 00:03:13.697 04:09:50 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:13.697 anon_hugepages=0 00:03:13.697 04:09:50 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.697 04:09:50 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:13.697 04:09:50 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:13.697 04:09:50 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:13.697 04:09:50 -- setup/common.sh@18 -- # local node= 00:03:13.697 04:09:50 -- setup/common.sh@19 -- # local var val 00:03:13.697 04:09:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.697 04:09:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.697 04:09:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.697 04:09:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.697 04:09:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.697 04:09:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.697 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45110124 kB' 'MemAvailable: 48880608 kB' 'Buffers: 2708 kB' 'Cached: 10753624 kB' 'SwapCached: 0 kB' 'Active: 7469512 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069032 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480612 kB' 'Mapped: 216048 kB' 'Shmem: 6591740 kB' 'KReclaimable: 198944 kB' 'Slab: 737140 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538196 kB' 'KernelStack: 12816 kB' 'PageTables: 8328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.698 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.698 04:09:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.699 04:09:50 -- setup/common.sh@33 -- # echo 1024 00:03:13.699 04:09:50 -- setup/common.sh@33 -- # return 0 00:03:13.699 04:09:50 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.699 04:09:50 -- setup/hugepages.sh@112 -- # get_nodes 00:03:13.699 04:09:50 -- setup/hugepages.sh@27 -- # local node 00:03:13.699 04:09:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.699 04:09:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:13.699 04:09:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.699 04:09:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:13.699 04:09:50 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:13.699 04:09:50 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:13.699 04:09:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.699 04:09:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.699 04:09:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:13.699 04:09:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.699 04:09:50 -- setup/common.sh@18 -- # local node=0 00:03:13.699 04:09:50 -- setup/common.sh@19 -- # local var val 00:03:13.699 04:09:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.699 04:09:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.699 04:09:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:13.699 04:09:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:13.699 04:09:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.699 04:09:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26676000 kB' 'MemUsed: 6149856 kB' 'SwapCached: 0 kB' 'Active: 2545136 kB' 'Inactive: 176952 kB' 'Active(anon): 2388412 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2403332 kB' 'Mapped: 111792 kB' 'AnonPages: 322000 kB' 'Shmem: 2069656 kB' 'KernelStack: 7336 kB' 'PageTables: 5252 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115860 kB' 'Slab: 438268 kB' 'SReclaimable: 115860 kB' 'SUnreclaim: 322408 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.699 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.699 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # continue 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.700 04:09:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.700 04:09:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.700 04:09:50 -- setup/common.sh@33 -- # echo 0 00:03:13.700 04:09:50 -- setup/common.sh@33 -- # return 0 00:03:13.700 04:09:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.700 04:09:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.700 04:09:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.700 04:09:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.700 04:09:50 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:13.700 node0=1024 expecting 1024 00:03:13.700 04:09:50 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:13.700 00:03:13.700 real 0m2.468s 00:03:13.700 user 0m0.668s 00:03:13.700 sys 0m0.913s 00:03:13.700 04:09:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.700 04:09:50 -- common/autotest_common.sh@10 -- # set +x 00:03:13.700 ************************************ 00:03:13.700 END TEST default_setup 00:03:13.700 ************************************ 00:03:13.700 04:09:50 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:13.700 04:09:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:13.700 04:09:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:13.700 04:09:50 -- common/autotest_common.sh@10 -- # set +x 00:03:13.700 ************************************ 00:03:13.700 START TEST per_node_1G_alloc 00:03:13.700 ************************************ 00:03:13.700 04:09:50 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:13.700 04:09:50 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:13.700 04:09:50 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:13.700 04:09:50 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:13.700 04:09:50 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:13.700 04:09:50 -- setup/hugepages.sh@51 -- # shift 00:03:13.700 04:09:50 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:13.700 04:09:50 -- setup/hugepages.sh@52 -- # local node_ids 00:03:13.700 04:09:50 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:13.700 04:09:50 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:13.700 04:09:50 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:13.700 04:09:50 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:13.700 04:09:50 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:13.700 04:09:50 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:13.700 04:09:50 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:13.700 04:09:50 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:13.700 04:09:50 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:13.700 04:09:50 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:13.700 04:09:50 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:13.700 04:09:50 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:13.700 04:09:50 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:13.700 04:09:50 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:13.700 04:09:50 -- setup/hugepages.sh@73 -- # return 0 00:03:13.700 04:09:50 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:13.700 04:09:50 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:13.700 04:09:50 -- setup/hugepages.sh@146 -- # setup output 00:03:13.700 04:09:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.700 04:09:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:15.079 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:15.079 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:15.079 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:15.079 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:15.079 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:15.079 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:15.079 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:15.079 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:15.079 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:15.079 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:15.079 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:15.079 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:15.079 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:15.079 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:15.079 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:15.079 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:15.079 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:15.079 04:09:52 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:15.079 04:09:52 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:15.079 04:09:52 -- setup/hugepages.sh@89 -- # local node 00:03:15.079 04:09:52 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:15.079 04:09:52 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:15.079 04:09:52 -- setup/hugepages.sh@92 -- # local surp 00:03:15.079 04:09:52 -- setup/hugepages.sh@93 -- # local resv 00:03:15.079 04:09:52 -- setup/hugepages.sh@94 -- # local anon 00:03:15.079 04:09:52 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:15.079 04:09:52 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:15.079 04:09:52 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:15.079 04:09:52 -- setup/common.sh@18 -- # local node= 00:03:15.079 04:09:52 -- setup/common.sh@19 -- # local var val 00:03:15.079 04:09:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.079 04:09:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.079 04:09:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.079 04:09:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.079 04:09:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.079 04:09:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45133348 kB' 'MemAvailable: 48903832 kB' 'Buffers: 2708 kB' 'Cached: 10753684 kB' 'SwapCached: 0 kB' 'Active: 7469728 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069248 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480680 kB' 'Mapped: 216128 kB' 'Shmem: 6591800 kB' 'KReclaimable: 198944 kB' 'Slab: 737360 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538416 kB' 'KernelStack: 12848 kB' 'PageTables: 8368 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.079 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.079 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.080 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.080 04:09:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.080 04:09:52 -- setup/common.sh@33 -- # echo 0 00:03:15.080 04:09:52 -- setup/common.sh@33 -- # return 0 00:03:15.080 04:09:52 -- setup/hugepages.sh@97 -- # anon=0 00:03:15.080 04:09:52 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:15.080 04:09:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.342 04:09:52 -- setup/common.sh@18 -- # local node= 00:03:15.342 04:09:52 -- setup/common.sh@19 -- # local var val 00:03:15.342 04:09:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.342 04:09:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.342 04:09:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.342 04:09:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.342 04:09:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.342 04:09:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.342 04:09:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45139664 kB' 'MemAvailable: 48910148 kB' 'Buffers: 2708 kB' 'Cached: 10753684 kB' 'SwapCached: 0 kB' 'Active: 7470252 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069772 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481224 kB' 'Mapped: 216128 kB' 'Shmem: 6591800 kB' 'KReclaimable: 198944 kB' 'Slab: 737344 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538400 kB' 'KernelStack: 12832 kB' 'PageTables: 8304 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143604 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.342 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.342 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.343 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.343 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.344 04:09:52 -- setup/common.sh@33 -- # echo 0 00:03:15.344 04:09:52 -- setup/common.sh@33 -- # return 0 00:03:15.344 04:09:52 -- setup/hugepages.sh@99 -- # surp=0 00:03:15.344 04:09:52 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:15.344 04:09:52 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:15.344 04:09:52 -- setup/common.sh@18 -- # local node= 00:03:15.344 04:09:52 -- setup/common.sh@19 -- # local var val 00:03:15.344 04:09:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.344 04:09:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.344 04:09:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.344 04:09:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.344 04:09:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.344 04:09:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45138968 kB' 'MemAvailable: 48909452 kB' 'Buffers: 2708 kB' 'Cached: 10753696 kB' 'SwapCached: 0 kB' 'Active: 7469860 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069380 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480812 kB' 'Mapped: 216072 kB' 'Shmem: 6591812 kB' 'KReclaimable: 198944 kB' 'Slab: 737440 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538496 kB' 'KernelStack: 12832 kB' 'PageTables: 8324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.344 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.344 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.345 04:09:52 -- setup/common.sh@33 -- # echo 0 00:03:15.345 04:09:52 -- setup/common.sh@33 -- # return 0 00:03:15.345 04:09:52 -- setup/hugepages.sh@100 -- # resv=0 00:03:15.345 04:09:52 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:15.345 nr_hugepages=1024 00:03:15.345 04:09:52 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:15.345 resv_hugepages=0 00:03:15.345 04:09:52 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:15.345 surplus_hugepages=0 00:03:15.345 04:09:52 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:15.345 anon_hugepages=0 00:03:15.345 04:09:52 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.345 04:09:52 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:15.345 04:09:52 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:15.345 04:09:52 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:15.345 04:09:52 -- setup/common.sh@18 -- # local node= 00:03:15.345 04:09:52 -- setup/common.sh@19 -- # local var val 00:03:15.345 04:09:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.345 04:09:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.345 04:09:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.345 04:09:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.345 04:09:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.345 04:09:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45139260 kB' 'MemAvailable: 48909744 kB' 'Buffers: 2708 kB' 'Cached: 10753712 kB' 'SwapCached: 0 kB' 'Active: 7469876 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069396 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480816 kB' 'Mapped: 216072 kB' 'Shmem: 6591828 kB' 'KReclaimable: 198944 kB' 'Slab: 737440 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538496 kB' 'KernelStack: 12832 kB' 'PageTables: 8324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.345 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.345 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.346 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.346 04:09:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.347 04:09:52 -- setup/common.sh@33 -- # echo 1024 00:03:15.347 04:09:52 -- setup/common.sh@33 -- # return 0 00:03:15.347 04:09:52 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.347 04:09:52 -- setup/hugepages.sh@112 -- # get_nodes 00:03:15.347 04:09:52 -- setup/hugepages.sh@27 -- # local node 00:03:15.347 04:09:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.347 04:09:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:15.347 04:09:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.347 04:09:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:15.347 04:09:52 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:15.347 04:09:52 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:15.347 04:09:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:15.347 04:09:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:15.347 04:09:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:15.347 04:09:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.347 04:09:52 -- setup/common.sh@18 -- # local node=0 00:03:15.347 04:09:52 -- setup/common.sh@19 -- # local var val 00:03:15.347 04:09:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.347 04:09:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.347 04:09:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:15.347 04:09:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:15.347 04:09:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.347 04:09:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27747536 kB' 'MemUsed: 5078320 kB' 'SwapCached: 0 kB' 'Active: 2544912 kB' 'Inactive: 176952 kB' 'Active(anon): 2388188 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2403368 kB' 'Mapped: 111800 kB' 'AnonPages: 321684 kB' 'Shmem: 2069692 kB' 'KernelStack: 7320 kB' 'PageTables: 5148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115860 kB' 'Slab: 438440 kB' 'SReclaimable: 115860 kB' 'SUnreclaim: 322580 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.347 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.347 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@33 -- # echo 0 00:03:15.348 04:09:52 -- setup/common.sh@33 -- # return 0 00:03:15.348 04:09:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:15.348 04:09:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:15.348 04:09:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:15.348 04:09:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:15.348 04:09:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.348 04:09:52 -- setup/common.sh@18 -- # local node=1 00:03:15.348 04:09:52 -- setup/common.sh@19 -- # local var val 00:03:15.348 04:09:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.348 04:09:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.348 04:09:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:15.348 04:09:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:15.348 04:09:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.348 04:09:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17392524 kB' 'MemUsed: 10317268 kB' 'SwapCached: 0 kB' 'Active: 4925180 kB' 'Inactive: 3587160 kB' 'Active(anon): 4681424 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8353080 kB' 'Mapped: 104256 kB' 'AnonPages: 159368 kB' 'Shmem: 4522164 kB' 'KernelStack: 5528 kB' 'PageTables: 3228 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83084 kB' 'Slab: 299000 kB' 'SReclaimable: 83084 kB' 'SUnreclaim: 215916 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.348 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.348 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # continue 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.349 04:09:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.349 04:09:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.349 04:09:52 -- setup/common.sh@33 -- # echo 0 00:03:15.349 04:09:52 -- setup/common.sh@33 -- # return 0 00:03:15.349 04:09:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:15.349 04:09:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.349 04:09:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.349 04:09:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.349 04:09:52 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:15.349 node0=512 expecting 512 00:03:15.349 04:09:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.349 04:09:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.349 04:09:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.349 04:09:52 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:15.349 node1=512 expecting 512 00:03:15.349 04:09:52 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:15.349 00:03:15.349 real 0m1.532s 00:03:15.349 user 0m0.621s 00:03:15.349 sys 0m0.867s 00:03:15.349 04:09:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:15.349 04:09:52 -- common/autotest_common.sh@10 -- # set +x 00:03:15.349 ************************************ 00:03:15.349 END TEST per_node_1G_alloc 00:03:15.349 ************************************ 00:03:15.349 04:09:52 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:15.349 04:09:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.349 04:09:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.349 04:09:52 -- common/autotest_common.sh@10 -- # set +x 00:03:15.349 ************************************ 00:03:15.349 START TEST even_2G_alloc 00:03:15.349 ************************************ 00:03:15.349 04:09:52 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:15.349 04:09:52 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:15.349 04:09:52 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:15.349 04:09:52 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:15.350 04:09:52 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:15.350 04:09:52 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:15.350 04:09:52 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:15.350 04:09:52 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:15.350 04:09:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.350 04:09:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:15.350 04:09:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.350 04:09:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.350 04:09:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.350 04:09:52 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:15.350 04:09:52 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:15.350 04:09:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.350 04:09:52 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:15.350 04:09:52 -- setup/hugepages.sh@83 -- # : 512 00:03:15.350 04:09:52 -- setup/hugepages.sh@84 -- # : 1 00:03:15.350 04:09:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.350 04:09:52 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:15.350 04:09:52 -- setup/hugepages.sh@83 -- # : 0 00:03:15.350 04:09:52 -- setup/hugepages.sh@84 -- # : 0 00:03:15.350 04:09:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.350 04:09:52 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:15.350 04:09:52 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:15.350 04:09:52 -- setup/hugepages.sh@153 -- # setup output 00:03:15.350 04:09:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.350 04:09:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:16.780 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.780 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:16.780 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.780 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.780 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.780 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.780 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.780 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.780 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.780 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.780 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.780 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.780 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.780 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.780 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.780 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.780 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.780 04:09:53 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:16.780 04:09:53 -- setup/hugepages.sh@89 -- # local node 00:03:16.780 04:09:53 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.780 04:09:53 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.780 04:09:53 -- setup/hugepages.sh@92 -- # local surp 00:03:16.780 04:09:53 -- setup/hugepages.sh@93 -- # local resv 00:03:16.780 04:09:53 -- setup/hugepages.sh@94 -- # local anon 00:03:16.780 04:09:53 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.780 04:09:53 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.780 04:09:53 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.780 04:09:53 -- setup/common.sh@18 -- # local node= 00:03:16.780 04:09:53 -- setup/common.sh@19 -- # local var val 00:03:16.780 04:09:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.780 04:09:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.780 04:09:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.780 04:09:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.780 04:09:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.780 04:09:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45184504 kB' 'MemAvailable: 48954988 kB' 'Buffers: 2708 kB' 'Cached: 10753776 kB' 'SwapCached: 0 kB' 'Active: 7470340 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069860 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481104 kB' 'Mapped: 216212 kB' 'Shmem: 6591892 kB' 'KReclaimable: 198944 kB' 'Slab: 737612 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538668 kB' 'KernelStack: 12784 kB' 'PageTables: 8260 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143684 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.780 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.780 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.781 04:09:53 -- setup/common.sh@33 -- # echo 0 00:03:16.781 04:09:53 -- setup/common.sh@33 -- # return 0 00:03:16.781 04:09:53 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.781 04:09:53 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.781 04:09:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.781 04:09:53 -- setup/common.sh@18 -- # local node= 00:03:16.781 04:09:53 -- setup/common.sh@19 -- # local var val 00:03:16.781 04:09:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.781 04:09:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.781 04:09:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.781 04:09:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.781 04:09:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.781 04:09:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45184884 kB' 'MemAvailable: 48955368 kB' 'Buffers: 2708 kB' 'Cached: 10753780 kB' 'SwapCached: 0 kB' 'Active: 7470244 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069764 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481028 kB' 'Mapped: 216148 kB' 'Shmem: 6591896 kB' 'KReclaimable: 198944 kB' 'Slab: 737604 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538660 kB' 'KernelStack: 12800 kB' 'PageTables: 8276 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143696 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.781 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.781 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.782 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.782 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.782 04:09:53 -- setup/common.sh@33 -- # echo 0 00:03:16.782 04:09:53 -- setup/common.sh@33 -- # return 0 00:03:16.782 04:09:53 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.782 04:09:53 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.782 04:09:53 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.782 04:09:53 -- setup/common.sh@18 -- # local node= 00:03:16.782 04:09:53 -- setup/common.sh@19 -- # local var val 00:03:16.782 04:09:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.782 04:09:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.782 04:09:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.783 04:09:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.783 04:09:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.783 04:09:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45185576 kB' 'MemAvailable: 48956060 kB' 'Buffers: 2708 kB' 'Cached: 10753788 kB' 'SwapCached: 0 kB' 'Active: 7469864 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069384 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480608 kB' 'Mapped: 216072 kB' 'Shmem: 6591904 kB' 'KReclaimable: 198944 kB' 'Slab: 737492 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538548 kB' 'KernelStack: 12816 kB' 'PageTables: 8272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143712 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.783 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.783 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.784 04:09:53 -- setup/common.sh@33 -- # echo 0 00:03:16.784 04:09:53 -- setup/common.sh@33 -- # return 0 00:03:16.784 04:09:53 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.784 04:09:53 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:16.784 nr_hugepages=1024 00:03:16.784 04:09:53 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.784 resv_hugepages=0 00:03:16.784 04:09:53 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.784 surplus_hugepages=0 00:03:16.784 04:09:53 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.784 anon_hugepages=0 00:03:16.784 04:09:53 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.784 04:09:53 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:16.784 04:09:53 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.784 04:09:53 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.784 04:09:53 -- setup/common.sh@18 -- # local node= 00:03:16.784 04:09:53 -- setup/common.sh@19 -- # local var val 00:03:16.784 04:09:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.784 04:09:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.784 04:09:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.784 04:09:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.784 04:09:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.784 04:09:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45187624 kB' 'MemAvailable: 48958108 kB' 'Buffers: 2708 kB' 'Cached: 10753804 kB' 'SwapCached: 0 kB' 'Active: 7470140 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069660 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480908 kB' 'Mapped: 216072 kB' 'Shmem: 6591920 kB' 'KReclaimable: 198944 kB' 'Slab: 737484 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538540 kB' 'KernelStack: 12832 kB' 'PageTables: 8324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8143724 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.784 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.784 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.785 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.785 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.785 04:09:53 -- setup/common.sh@33 -- # echo 1024 00:03:16.785 04:09:53 -- setup/common.sh@33 -- # return 0 00:03:16.785 04:09:53 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.785 04:09:53 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.785 04:09:53 -- setup/hugepages.sh@27 -- # local node 00:03:16.785 04:09:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.785 04:09:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.785 04:09:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.786 04:09:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.786 04:09:53 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.786 04:09:53 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.786 04:09:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.786 04:09:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.786 04:09:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.786 04:09:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.786 04:09:53 -- setup/common.sh@18 -- # local node=0 00:03:16.786 04:09:53 -- setup/common.sh@19 -- # local var val 00:03:16.786 04:09:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.786 04:09:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.786 04:09:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.786 04:09:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.786 04:09:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.786 04:09:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27792108 kB' 'MemUsed: 5033748 kB' 'SwapCached: 0 kB' 'Active: 2544468 kB' 'Inactive: 176952 kB' 'Active(anon): 2387744 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2403372 kB' 'Mapped: 111808 kB' 'AnonPages: 321132 kB' 'Shmem: 2069696 kB' 'KernelStack: 7272 kB' 'PageTables: 5048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115860 kB' 'Slab: 438516 kB' 'SReclaimable: 115860 kB' 'SUnreclaim: 322656 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.786 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.786 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@33 -- # echo 0 00:03:16.787 04:09:53 -- setup/common.sh@33 -- # return 0 00:03:16.787 04:09:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.787 04:09:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.787 04:09:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.787 04:09:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:16.787 04:09:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.787 04:09:53 -- setup/common.sh@18 -- # local node=1 00:03:16.787 04:09:53 -- setup/common.sh@19 -- # local var val 00:03:16.787 04:09:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.787 04:09:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.787 04:09:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:16.787 04:09:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:16.787 04:09:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.787 04:09:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17393848 kB' 'MemUsed: 10315944 kB' 'SwapCached: 0 kB' 'Active: 4925728 kB' 'Inactive: 3587160 kB' 'Active(anon): 4681972 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8353168 kB' 'Mapped: 104264 kB' 'AnonPages: 159772 kB' 'Shmem: 4522252 kB' 'KernelStack: 5560 kB' 'PageTables: 3276 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83084 kB' 'Slab: 298968 kB' 'SReclaimable: 83084 kB' 'SUnreclaim: 215884 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.787 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.787 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # continue 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.788 04:09:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.788 04:09:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.788 04:09:53 -- setup/common.sh@33 -- # echo 0 00:03:16.788 04:09:53 -- setup/common.sh@33 -- # return 0 00:03:16.788 04:09:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.788 04:09:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.788 04:09:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.788 04:09:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.788 04:09:53 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:16.788 node0=512 expecting 512 00:03:16.788 04:09:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.788 04:09:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.788 04:09:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.788 04:09:53 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:16.788 node1=512 expecting 512 00:03:16.788 04:09:53 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:16.788 00:03:16.788 real 0m1.437s 00:03:16.788 user 0m0.600s 00:03:16.788 sys 0m0.798s 00:03:16.788 04:09:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:16.788 04:09:53 -- common/autotest_common.sh@10 -- # set +x 00:03:16.788 ************************************ 00:03:16.788 END TEST even_2G_alloc 00:03:16.788 ************************************ 00:03:16.788 04:09:53 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:16.788 04:09:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.788 04:09:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.788 04:09:53 -- common/autotest_common.sh@10 -- # set +x 00:03:16.788 ************************************ 00:03:16.788 START TEST odd_alloc 00:03:16.788 ************************************ 00:03:16.788 04:09:53 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:16.788 04:09:53 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:16.788 04:09:54 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:16.788 04:09:54 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:16.788 04:09:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.788 04:09:54 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:16.788 04:09:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:16.788 04:09:54 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:16.788 04:09:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.788 04:09:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:16.788 04:09:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.788 04:09:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.788 04:09:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.788 04:09:54 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:16.788 04:09:54 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:16.788 04:09:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.788 04:09:54 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:16.788 04:09:54 -- setup/hugepages.sh@83 -- # : 513 00:03:16.788 04:09:54 -- setup/hugepages.sh@84 -- # : 1 00:03:16.788 04:09:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.788 04:09:54 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:16.788 04:09:54 -- setup/hugepages.sh@83 -- # : 0 00:03:16.788 04:09:54 -- setup/hugepages.sh@84 -- # : 0 00:03:16.788 04:09:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.788 04:09:54 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:16.788 04:09:54 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:16.788 04:09:54 -- setup/hugepages.sh@160 -- # setup output 00:03:16.788 04:09:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.788 04:09:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:18.182 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.183 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.183 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.183 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.183 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.183 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.183 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.183 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.183 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.183 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.183 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.183 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.183 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.183 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.183 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.183 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.183 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.183 04:09:55 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:18.183 04:09:55 -- setup/hugepages.sh@89 -- # local node 00:03:18.183 04:09:55 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.183 04:09:55 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.183 04:09:55 -- setup/hugepages.sh@92 -- # local surp 00:03:18.183 04:09:55 -- setup/hugepages.sh@93 -- # local resv 00:03:18.183 04:09:55 -- setup/hugepages.sh@94 -- # local anon 00:03:18.183 04:09:55 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.183 04:09:55 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.183 04:09:55 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.183 04:09:55 -- setup/common.sh@18 -- # local node= 00:03:18.183 04:09:55 -- setup/common.sh@19 -- # local var val 00:03:18.183 04:09:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.183 04:09:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.183 04:09:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.183 04:09:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.183 04:09:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.183 04:09:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45171868 kB' 'MemAvailable: 48942352 kB' 'Buffers: 2708 kB' 'Cached: 10753868 kB' 'SwapCached: 0 kB' 'Active: 7474116 kB' 'Inactive: 3764112 kB' 'Active(anon): 7073636 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484848 kB' 'Mapped: 215852 kB' 'Shmem: 6591984 kB' 'KReclaimable: 198944 kB' 'Slab: 737728 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538784 kB' 'KernelStack: 12768 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8136460 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.183 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.183 04:09:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.183 04:09:55 -- setup/common.sh@33 -- # echo 0 00:03:18.183 04:09:55 -- setup/common.sh@33 -- # return 0 00:03:18.183 04:09:55 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.183 04:09:55 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.183 04:09:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.183 04:09:55 -- setup/common.sh@18 -- # local node= 00:03:18.184 04:09:55 -- setup/common.sh@19 -- # local var val 00:03:18.184 04:09:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.184 04:09:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.184 04:09:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.184 04:09:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.184 04:09:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.184 04:09:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45172304 kB' 'MemAvailable: 48942788 kB' 'Buffers: 2708 kB' 'Cached: 10753868 kB' 'SwapCached: 0 kB' 'Active: 7469116 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068636 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479892 kB' 'Mapped: 215500 kB' 'Shmem: 6591984 kB' 'KReclaimable: 198944 kB' 'Slab: 737752 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538808 kB' 'KernelStack: 12768 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8130352 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.184 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.184 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.185 04:09:55 -- setup/common.sh@33 -- # echo 0 00:03:18.185 04:09:55 -- setup/common.sh@33 -- # return 0 00:03:18.185 04:09:55 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.185 04:09:55 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.185 04:09:55 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.185 04:09:55 -- setup/common.sh@18 -- # local node= 00:03:18.185 04:09:55 -- setup/common.sh@19 -- # local var val 00:03:18.185 04:09:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.185 04:09:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.185 04:09:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.185 04:09:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.185 04:09:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.185 04:09:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45173024 kB' 'MemAvailable: 48943508 kB' 'Buffers: 2708 kB' 'Cached: 10753884 kB' 'SwapCached: 0 kB' 'Active: 7468424 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067944 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479248 kB' 'Mapped: 215020 kB' 'Shmem: 6592000 kB' 'KReclaimable: 198944 kB' 'Slab: 737712 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538768 kB' 'KernelStack: 12800 kB' 'PageTables: 8056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8130000 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.185 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.185 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.186 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.186 04:09:55 -- setup/common.sh@33 -- # echo 0 00:03:18.186 04:09:55 -- setup/common.sh@33 -- # return 0 00:03:18.186 04:09:55 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.186 04:09:55 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:18.186 nr_hugepages=1025 00:03:18.186 04:09:55 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.186 resv_hugepages=0 00:03:18.186 04:09:55 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.186 surplus_hugepages=0 00:03:18.186 04:09:55 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.186 anon_hugepages=0 00:03:18.186 04:09:55 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.186 04:09:55 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:18.186 04:09:55 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.186 04:09:55 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.186 04:09:55 -- setup/common.sh@18 -- # local node= 00:03:18.186 04:09:55 -- setup/common.sh@19 -- # local var val 00:03:18.186 04:09:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.186 04:09:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.186 04:09:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.186 04:09:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.186 04:09:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.186 04:09:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.186 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45172964 kB' 'MemAvailable: 48943448 kB' 'Buffers: 2708 kB' 'Cached: 10753896 kB' 'SwapCached: 0 kB' 'Active: 7467888 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067408 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478620 kB' 'Mapped: 214992 kB' 'Shmem: 6592012 kB' 'KReclaimable: 198944 kB' 'Slab: 737712 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538768 kB' 'KernelStack: 12704 kB' 'PageTables: 7744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 8130012 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.187 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.187 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.188 04:09:55 -- setup/common.sh@33 -- # echo 1025 00:03:18.188 04:09:55 -- setup/common.sh@33 -- # return 0 00:03:18.188 04:09:55 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.188 04:09:55 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.188 04:09:55 -- setup/hugepages.sh@27 -- # local node 00:03:18.188 04:09:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.188 04:09:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.188 04:09:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.188 04:09:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:18.188 04:09:55 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.188 04:09:55 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.188 04:09:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.188 04:09:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.188 04:09:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.188 04:09:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.188 04:09:55 -- setup/common.sh@18 -- # local node=0 00:03:18.188 04:09:55 -- setup/common.sh@19 -- # local var val 00:03:18.188 04:09:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.188 04:09:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.188 04:09:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.188 04:09:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.188 04:09:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.188 04:09:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27793188 kB' 'MemUsed: 5032668 kB' 'SwapCached: 0 kB' 'Active: 2542568 kB' 'Inactive: 176952 kB' 'Active(anon): 2385844 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2403388 kB' 'Mapped: 110804 kB' 'AnonPages: 319292 kB' 'Shmem: 2069712 kB' 'KernelStack: 7176 kB' 'PageTables: 4588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115860 kB' 'Slab: 438720 kB' 'SReclaimable: 115860 kB' 'SUnreclaim: 322860 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.188 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.188 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.448 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.448 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.448 04:09:55 -- setup/common.sh@33 -- # echo 0 00:03:18.449 04:09:55 -- setup/common.sh@33 -- # return 0 00:03:18.449 04:09:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.449 04:09:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.449 04:09:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.449 04:09:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:18.449 04:09:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.449 04:09:55 -- setup/common.sh@18 -- # local node=1 00:03:18.449 04:09:55 -- setup/common.sh@19 -- # local var val 00:03:18.449 04:09:55 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.449 04:09:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.449 04:09:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:18.449 04:09:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:18.449 04:09:55 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.449 04:09:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 17380444 kB' 'MemUsed: 10329348 kB' 'SwapCached: 0 kB' 'Active: 4925888 kB' 'Inactive: 3587160 kB' 'Active(anon): 4682132 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8353248 kB' 'Mapped: 104188 kB' 'AnonPages: 159872 kB' 'Shmem: 4522332 kB' 'KernelStack: 5544 kB' 'PageTables: 3212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83084 kB' 'Slab: 298968 kB' 'SReclaimable: 83084 kB' 'SUnreclaim: 215884 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.449 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.449 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.450 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.450 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.450 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.450 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.450 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.450 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.450 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.450 04:09:55 -- setup/common.sh@32 -- # continue 00:03:18.450 04:09:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.450 04:09:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.450 04:09:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.450 04:09:55 -- setup/common.sh@33 -- # echo 0 00:03:18.450 04:09:55 -- setup/common.sh@33 -- # return 0 00:03:18.450 04:09:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.450 04:09:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.450 04:09:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.450 04:09:55 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:18.450 node0=512 expecting 513 00:03:18.450 04:09:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.450 04:09:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.450 04:09:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.450 04:09:55 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:18.450 node1=513 expecting 512 00:03:18.450 04:09:55 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:18.450 00:03:18.450 real 0m1.523s 00:03:18.450 user 0m0.629s 00:03:18.450 sys 0m0.861s 00:03:18.450 04:09:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:18.450 04:09:55 -- common/autotest_common.sh@10 -- # set +x 00:03:18.450 ************************************ 00:03:18.450 END TEST odd_alloc 00:03:18.450 ************************************ 00:03:18.450 04:09:55 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:18.450 04:09:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:18.450 04:09:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:18.450 04:09:55 -- common/autotest_common.sh@10 -- # set +x 00:03:18.450 ************************************ 00:03:18.450 START TEST custom_alloc 00:03:18.450 ************************************ 00:03:18.450 04:09:55 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:18.450 04:09:55 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:18.450 04:09:55 -- setup/hugepages.sh@169 -- # local node 00:03:18.450 04:09:55 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:18.450 04:09:55 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:18.450 04:09:55 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:18.450 04:09:55 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:18.450 04:09:55 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:18.450 04:09:55 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:18.450 04:09:55 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:18.450 04:09:55 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.450 04:09:55 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.450 04:09:55 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:18.450 04:09:55 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.450 04:09:55 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.450 04:09:55 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.450 04:09:55 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:18.450 04:09:55 -- setup/hugepages.sh@83 -- # : 256 00:03:18.450 04:09:55 -- setup/hugepages.sh@84 -- # : 1 00:03:18.450 04:09:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:18.450 04:09:55 -- setup/hugepages.sh@83 -- # : 0 00:03:18.450 04:09:55 -- setup/hugepages.sh@84 -- # : 0 00:03:18.450 04:09:55 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:18.450 04:09:55 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:18.450 04:09:55 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:18.450 04:09:55 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:18.450 04:09:55 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:18.450 04:09:55 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.450 04:09:55 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.450 04:09:55 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:18.450 04:09:55 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.450 04:09:55 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.450 04:09:55 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.450 04:09:55 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:18.450 04:09:55 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:18.450 04:09:55 -- setup/hugepages.sh@78 -- # return 0 00:03:18.450 04:09:55 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:18.450 04:09:55 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:18.450 04:09:55 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:18.450 04:09:55 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:18.450 04:09:55 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:18.450 04:09:55 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:18.450 04:09:55 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:18.450 04:09:55 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:18.450 04:09:55 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:18.450 04:09:55 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:18.450 04:09:55 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:18.450 04:09:55 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:18.450 04:09:55 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:18.450 04:09:55 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:18.450 04:09:55 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:18.450 04:09:55 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:18.450 04:09:55 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:18.450 04:09:55 -- setup/hugepages.sh@78 -- # return 0 00:03:18.450 04:09:55 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:18.450 04:09:55 -- setup/hugepages.sh@187 -- # setup output 00:03:18.450 04:09:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.450 04:09:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:19.385 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.385 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:19.385 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.385 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.385 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.385 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.385 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.385 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.385 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.385 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.385 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.385 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.385 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.385 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.385 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.385 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.385 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.648 04:09:56 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:19.648 04:09:56 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:19.648 04:09:56 -- setup/hugepages.sh@89 -- # local node 00:03:19.648 04:09:56 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:19.648 04:09:56 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:19.648 04:09:56 -- setup/hugepages.sh@92 -- # local surp 00:03:19.648 04:09:56 -- setup/hugepages.sh@93 -- # local resv 00:03:19.648 04:09:56 -- setup/hugepages.sh@94 -- # local anon 00:03:19.648 04:09:56 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:19.648 04:09:56 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:19.648 04:09:56 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:19.648 04:09:56 -- setup/common.sh@18 -- # local node= 00:03:19.648 04:09:56 -- setup/common.sh@19 -- # local var val 00:03:19.648 04:09:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.648 04:09:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.648 04:09:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.648 04:09:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.648 04:09:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.648 04:09:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.648 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 04:09:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44119716 kB' 'MemAvailable: 47890200 kB' 'Buffers: 2708 kB' 'Cached: 10753960 kB' 'SwapCached: 0 kB' 'Active: 7468696 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068216 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479376 kB' 'Mapped: 215128 kB' 'Shmem: 6592076 kB' 'KReclaimable: 198944 kB' 'Slab: 737068 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538124 kB' 'KernelStack: 12768 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8130560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:19.648 04:09:56 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.648 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.648 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.648 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.648 04:09:56 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.648 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.648 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.649 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.649 04:09:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.649 04:09:56 -- setup/common.sh@33 -- # echo 0 00:03:19.649 04:09:56 -- setup/common.sh@33 -- # return 0 00:03:19.649 04:09:56 -- setup/hugepages.sh@97 -- # anon=0 00:03:19.649 04:09:56 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:19.649 04:09:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.649 04:09:56 -- setup/common.sh@18 -- # local node= 00:03:19.649 04:09:56 -- setup/common.sh@19 -- # local var val 00:03:19.649 04:09:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.649 04:09:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.649 04:09:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.650 04:09:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.650 04:09:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.650 04:09:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44121888 kB' 'MemAvailable: 47892372 kB' 'Buffers: 2708 kB' 'Cached: 10753964 kB' 'SwapCached: 0 kB' 'Active: 7468420 kB' 'Inactive: 3764112 kB' 'Active(anon): 7067940 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479124 kB' 'Mapped: 215072 kB' 'Shmem: 6592080 kB' 'KReclaimable: 198944 kB' 'Slab: 737060 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538116 kB' 'KernelStack: 12800 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8130572 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.650 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.650 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.651 04:09:56 -- setup/common.sh@33 -- # echo 0 00:03:19.651 04:09:56 -- setup/common.sh@33 -- # return 0 00:03:19.651 04:09:56 -- setup/hugepages.sh@99 -- # surp=0 00:03:19.651 04:09:56 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:19.651 04:09:56 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:19.651 04:09:56 -- setup/common.sh@18 -- # local node= 00:03:19.651 04:09:56 -- setup/common.sh@19 -- # local var val 00:03:19.651 04:09:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.651 04:09:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.651 04:09:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.651 04:09:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.651 04:09:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.651 04:09:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44122796 kB' 'MemAvailable: 47893280 kB' 'Buffers: 2708 kB' 'Cached: 10753976 kB' 'SwapCached: 0 kB' 'Active: 7468528 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068048 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479200 kB' 'Mapped: 214996 kB' 'Shmem: 6592092 kB' 'KReclaimable: 198944 kB' 'Slab: 737072 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538128 kB' 'KernelStack: 12816 kB' 'PageTables: 8012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8130588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.651 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.651 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.652 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.652 04:09:56 -- setup/common.sh@33 -- # echo 0 00:03:19.652 04:09:56 -- setup/common.sh@33 -- # return 0 00:03:19.652 04:09:56 -- setup/hugepages.sh@100 -- # resv=0 00:03:19.652 04:09:56 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:19.652 nr_hugepages=1536 00:03:19.652 04:09:56 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:19.652 resv_hugepages=0 00:03:19.652 04:09:56 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:19.652 surplus_hugepages=0 00:03:19.652 04:09:56 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:19.652 anon_hugepages=0 00:03:19.652 04:09:56 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:19.652 04:09:56 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:19.652 04:09:56 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:19.652 04:09:56 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:19.652 04:09:56 -- setup/common.sh@18 -- # local node= 00:03:19.652 04:09:56 -- setup/common.sh@19 -- # local var val 00:03:19.652 04:09:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.652 04:09:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.652 04:09:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.652 04:09:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.652 04:09:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.652 04:09:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.652 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 44123228 kB' 'MemAvailable: 47893712 kB' 'Buffers: 2708 kB' 'Cached: 10753988 kB' 'SwapCached: 0 kB' 'Active: 7468536 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068056 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479196 kB' 'Mapped: 214996 kB' 'Shmem: 6592104 kB' 'KReclaimable: 198944 kB' 'Slab: 737072 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538128 kB' 'KernelStack: 12816 kB' 'PageTables: 8012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 8130600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.653 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.653 04:09:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.654 04:09:56 -- setup/common.sh@33 -- # echo 1536 00:03:19.654 04:09:56 -- setup/common.sh@33 -- # return 0 00:03:19.654 04:09:56 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:19.654 04:09:56 -- setup/hugepages.sh@112 -- # get_nodes 00:03:19.654 04:09:56 -- setup/hugepages.sh@27 -- # local node 00:03:19.654 04:09:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.654 04:09:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:19.654 04:09:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.654 04:09:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:19.654 04:09:56 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.654 04:09:56 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.654 04:09:56 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.654 04:09:56 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.654 04:09:56 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:19.654 04:09:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.654 04:09:56 -- setup/common.sh@18 -- # local node=0 00:03:19.654 04:09:56 -- setup/common.sh@19 -- # local var val 00:03:19.654 04:09:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.654 04:09:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.654 04:09:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:19.654 04:09:56 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:19.654 04:09:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.654 04:09:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27793460 kB' 'MemUsed: 5032396 kB' 'SwapCached: 0 kB' 'Active: 2542832 kB' 'Inactive: 176952 kB' 'Active(anon): 2386108 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2403388 kB' 'Mapped: 110808 kB' 'AnonPages: 319512 kB' 'Shmem: 2069712 kB' 'KernelStack: 7240 kB' 'PageTables: 4692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115860 kB' 'Slab: 438308 kB' 'SReclaimable: 115860 kB' 'SUnreclaim: 322448 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.654 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.654 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@33 -- # echo 0 00:03:19.655 04:09:56 -- setup/common.sh@33 -- # return 0 00:03:19.655 04:09:56 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.655 04:09:56 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.655 04:09:56 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.655 04:09:56 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:19.655 04:09:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.655 04:09:56 -- setup/common.sh@18 -- # local node=1 00:03:19.655 04:09:56 -- setup/common.sh@19 -- # local var val 00:03:19.655 04:09:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.655 04:09:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.655 04:09:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:19.655 04:09:56 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:19.655 04:09:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.655 04:09:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16329516 kB' 'MemUsed: 11380276 kB' 'SwapCached: 0 kB' 'Active: 4925700 kB' 'Inactive: 3587160 kB' 'Active(anon): 4681944 kB' 'Inactive(anon): 0 kB' 'Active(file): 243756 kB' 'Inactive(file): 3587160 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8353336 kB' 'Mapped: 104188 kB' 'AnonPages: 159684 kB' 'Shmem: 4522420 kB' 'KernelStack: 5576 kB' 'PageTables: 3320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 83084 kB' 'Slab: 298764 kB' 'SReclaimable: 83084 kB' 'SUnreclaim: 215680 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.655 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.655 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.914 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.914 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # continue 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.915 04:09:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.915 04:09:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.915 04:09:56 -- setup/common.sh@33 -- # echo 0 00:03:19.915 04:09:56 -- setup/common.sh@33 -- # return 0 00:03:19.915 04:09:56 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.915 04:09:56 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.915 04:09:56 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.915 04:09:56 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.915 04:09:56 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:19.915 node0=512 expecting 512 00:03:19.915 04:09:56 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.915 04:09:56 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.915 04:09:56 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.915 04:09:56 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:19.915 node1=1024 expecting 1024 00:03:19.915 04:09:56 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:19.915 00:03:19.915 real 0m1.422s 00:03:19.915 user 0m0.558s 00:03:19.915 sys 0m0.826s 00:03:19.915 04:09:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.915 04:09:56 -- common/autotest_common.sh@10 -- # set +x 00:03:19.915 ************************************ 00:03:19.915 END TEST custom_alloc 00:03:19.915 ************************************ 00:03:19.915 04:09:56 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:19.915 04:09:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.915 04:09:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.915 04:09:56 -- common/autotest_common.sh@10 -- # set +x 00:03:19.915 ************************************ 00:03:19.915 START TEST no_shrink_alloc 00:03:19.915 ************************************ 00:03:19.915 04:09:56 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:19.915 04:09:56 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:19.915 04:09:56 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:19.915 04:09:56 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:19.915 04:09:56 -- setup/hugepages.sh@51 -- # shift 00:03:19.915 04:09:56 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:19.915 04:09:56 -- setup/hugepages.sh@52 -- # local node_ids 00:03:19.915 04:09:56 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.915 04:09:56 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:19.915 04:09:56 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:19.915 04:09:56 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:19.915 04:09:56 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.915 04:09:56 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.915 04:09:56 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.915 04:09:56 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.915 04:09:56 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.915 04:09:56 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:19.915 04:09:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:19.915 04:09:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:19.915 04:09:56 -- setup/hugepages.sh@73 -- # return 0 00:03:19.915 04:09:56 -- setup/hugepages.sh@198 -- # setup output 00:03:19.915 04:09:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.915 04:09:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.850 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.850 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:20.850 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.850 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.850 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.850 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.850 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.850 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.850 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.850 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.850 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.850 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.850 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.850 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.850 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.850 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.850 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.113 04:09:58 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:21.113 04:09:58 -- setup/hugepages.sh@89 -- # local node 00:03:21.113 04:09:58 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.113 04:09:58 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.113 04:09:58 -- setup/hugepages.sh@92 -- # local surp 00:03:21.113 04:09:58 -- setup/hugepages.sh@93 -- # local resv 00:03:21.113 04:09:58 -- setup/hugepages.sh@94 -- # local anon 00:03:21.113 04:09:58 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.113 04:09:58 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.113 04:09:58 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.113 04:09:58 -- setup/common.sh@18 -- # local node= 00:03:21.113 04:09:58 -- setup/common.sh@19 -- # local var val 00:03:21.113 04:09:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.113 04:09:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.113 04:09:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.113 04:09:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.113 04:09:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.113 04:09:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45047860 kB' 'MemAvailable: 48818344 kB' 'Buffers: 2708 kB' 'Cached: 10754056 kB' 'SwapCached: 0 kB' 'Active: 7468904 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068424 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479392 kB' 'Mapped: 215060 kB' 'Shmem: 6592172 kB' 'KReclaimable: 198944 kB' 'Slab: 736984 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538040 kB' 'KernelStack: 12816 kB' 'PageTables: 7976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8130788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.113 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.113 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.114 04:09:58 -- setup/common.sh@33 -- # echo 0 00:03:21.114 04:09:58 -- setup/common.sh@33 -- # return 0 00:03:21.114 04:09:58 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.114 04:09:58 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.114 04:09:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.114 04:09:58 -- setup/common.sh@18 -- # local node= 00:03:21.114 04:09:58 -- setup/common.sh@19 -- # local var val 00:03:21.114 04:09:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.114 04:09:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.114 04:09:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.114 04:09:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.114 04:09:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.114 04:09:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45049408 kB' 'MemAvailable: 48819892 kB' 'Buffers: 2708 kB' 'Cached: 10754060 kB' 'SwapCached: 0 kB' 'Active: 7468928 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068448 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479400 kB' 'Mapped: 215072 kB' 'Shmem: 6592176 kB' 'KReclaimable: 198944 kB' 'Slab: 737040 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538096 kB' 'KernelStack: 12816 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8130800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.114 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.114 04:09:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.115 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.115 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.116 04:09:58 -- setup/common.sh@33 -- # echo 0 00:03:21.116 04:09:58 -- setup/common.sh@33 -- # return 0 00:03:21.116 04:09:58 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.116 04:09:58 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.116 04:09:58 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.116 04:09:58 -- setup/common.sh@18 -- # local node= 00:03:21.116 04:09:58 -- setup/common.sh@19 -- # local var val 00:03:21.116 04:09:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.116 04:09:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.116 04:09:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.116 04:09:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.116 04:09:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.116 04:09:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45049376 kB' 'MemAvailable: 48819860 kB' 'Buffers: 2708 kB' 'Cached: 10754072 kB' 'SwapCached: 0 kB' 'Active: 7468776 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068296 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479204 kB' 'Mapped: 214996 kB' 'Shmem: 6592188 kB' 'KReclaimable: 198944 kB' 'Slab: 737032 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538088 kB' 'KernelStack: 12800 kB' 'PageTables: 7892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8130816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.116 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.116 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.117 04:09:58 -- setup/common.sh@33 -- # echo 0 00:03:21.117 04:09:58 -- setup/common.sh@33 -- # return 0 00:03:21.117 04:09:58 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.117 04:09:58 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:21.117 nr_hugepages=1024 00:03:21.117 04:09:58 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.117 resv_hugepages=0 00:03:21.117 04:09:58 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.117 surplus_hugepages=0 00:03:21.117 04:09:58 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.117 anon_hugepages=0 00:03:21.117 04:09:58 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.117 04:09:58 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:21.117 04:09:58 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.117 04:09:58 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.117 04:09:58 -- setup/common.sh@18 -- # local node= 00:03:21.117 04:09:58 -- setup/common.sh@19 -- # local var val 00:03:21.117 04:09:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.117 04:09:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.117 04:09:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.117 04:09:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.117 04:09:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.117 04:09:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45049376 kB' 'MemAvailable: 48819860 kB' 'Buffers: 2708 kB' 'Cached: 10754084 kB' 'SwapCached: 0 kB' 'Active: 7468768 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068288 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479168 kB' 'Mapped: 214996 kB' 'Shmem: 6592200 kB' 'KReclaimable: 198944 kB' 'Slab: 737032 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538088 kB' 'KernelStack: 12784 kB' 'PageTables: 7840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8130832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.117 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.117 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.118 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.118 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.119 04:09:58 -- setup/common.sh@33 -- # echo 1024 00:03:21.119 04:09:58 -- setup/common.sh@33 -- # return 0 00:03:21.119 04:09:58 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.119 04:09:58 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.119 04:09:58 -- setup/hugepages.sh@27 -- # local node 00:03:21.119 04:09:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.119 04:09:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:21.119 04:09:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.119 04:09:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:21.119 04:09:58 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.119 04:09:58 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.119 04:09:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.119 04:09:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.119 04:09:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.119 04:09:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.119 04:09:58 -- setup/common.sh@18 -- # local node=0 00:03:21.119 04:09:58 -- setup/common.sh@19 -- # local var val 00:03:21.119 04:09:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.119 04:09:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.119 04:09:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.119 04:09:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.119 04:09:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.119 04:09:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26729484 kB' 'MemUsed: 6096372 kB' 'SwapCached: 0 kB' 'Active: 2542968 kB' 'Inactive: 176952 kB' 'Active(anon): 2386244 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2403392 kB' 'Mapped: 110816 kB' 'AnonPages: 319600 kB' 'Shmem: 2069716 kB' 'KernelStack: 7256 kB' 'PageTables: 4732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115860 kB' 'Slab: 438268 kB' 'SReclaimable: 115860 kB' 'SUnreclaim: 322408 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.119 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.119 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # continue 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.120 04:09:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.120 04:09:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.120 04:09:58 -- setup/common.sh@33 -- # echo 0 00:03:21.120 04:09:58 -- setup/common.sh@33 -- # return 0 00:03:21.120 04:09:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.120 04:09:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.120 04:09:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.120 04:09:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.120 04:09:58 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:21.120 node0=1024 expecting 1024 00:03:21.120 04:09:58 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:21.120 04:09:58 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:21.120 04:09:58 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:21.120 04:09:58 -- setup/hugepages.sh@202 -- # setup output 00:03:21.120 04:09:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.120 04:09:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:22.496 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.496 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:22.496 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.496 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.496 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.496 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.496 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.496 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.496 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.496 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:22.496 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:22.496 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:22.496 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:22.496 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:22.496 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:22.496 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:22.496 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:22.496 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:22.496 04:09:59 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:22.496 04:09:59 -- setup/hugepages.sh@89 -- # local node 00:03:22.496 04:09:59 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:22.496 04:09:59 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:22.496 04:09:59 -- setup/hugepages.sh@92 -- # local surp 00:03:22.496 04:09:59 -- setup/hugepages.sh@93 -- # local resv 00:03:22.496 04:09:59 -- setup/hugepages.sh@94 -- # local anon 00:03:22.496 04:09:59 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:22.496 04:09:59 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:22.496 04:09:59 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:22.496 04:09:59 -- setup/common.sh@18 -- # local node= 00:03:22.496 04:09:59 -- setup/common.sh@19 -- # local var val 00:03:22.496 04:09:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.496 04:09:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.496 04:09:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.496 04:09:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.496 04:09:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.496 04:09:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.496 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.496 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.496 04:09:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45025812 kB' 'MemAvailable: 48796296 kB' 'Buffers: 2708 kB' 'Cached: 10754128 kB' 'SwapCached: 0 kB' 'Active: 7469292 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068812 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479720 kB' 'Mapped: 215060 kB' 'Shmem: 6592244 kB' 'KReclaimable: 198944 kB' 'Slab: 736960 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538016 kB' 'KernelStack: 12832 kB' 'PageTables: 7972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8130860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:22.496 04:09:59 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.496 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.496 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.496 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.496 04:09:59 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.496 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.497 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.497 04:09:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:22.497 04:09:59 -- setup/common.sh@33 -- # echo 0 00:03:22.497 04:09:59 -- setup/common.sh@33 -- # return 0 00:03:22.497 04:09:59 -- setup/hugepages.sh@97 -- # anon=0 00:03:22.497 04:09:59 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:22.497 04:09:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.497 04:09:59 -- setup/common.sh@18 -- # local node= 00:03:22.497 04:09:59 -- setup/common.sh@19 -- # local var val 00:03:22.497 04:09:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.497 04:09:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.498 04:09:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.498 04:09:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.498 04:09:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.498 04:09:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45035256 kB' 'MemAvailable: 48805740 kB' 'Buffers: 2708 kB' 'Cached: 10754132 kB' 'SwapCached: 0 kB' 'Active: 7469872 kB' 'Inactive: 3764112 kB' 'Active(anon): 7069392 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480312 kB' 'Mapped: 215060 kB' 'Shmem: 6592248 kB' 'KReclaimable: 198944 kB' 'Slab: 736948 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 538004 kB' 'KernelStack: 12880 kB' 'PageTables: 8116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8130872 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.498 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.498 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.499 04:09:59 -- setup/common.sh@33 -- # echo 0 00:03:22.499 04:09:59 -- setup/common.sh@33 -- # return 0 00:03:22.499 04:09:59 -- setup/hugepages.sh@99 -- # surp=0 00:03:22.499 04:09:59 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:22.499 04:09:59 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:22.499 04:09:59 -- setup/common.sh@18 -- # local node= 00:03:22.499 04:09:59 -- setup/common.sh@19 -- # local var val 00:03:22.499 04:09:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.499 04:09:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.499 04:09:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.499 04:09:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.499 04:09:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.499 04:09:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45035848 kB' 'MemAvailable: 48806332 kB' 'Buffers: 2708 kB' 'Cached: 10754144 kB' 'SwapCached: 0 kB' 'Active: 7468924 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068444 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479356 kB' 'Mapped: 215000 kB' 'Shmem: 6592260 kB' 'KReclaimable: 198944 kB' 'Slab: 736932 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 537988 kB' 'KernelStack: 12848 kB' 'PageTables: 8008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8130888 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.499 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.499 04:09:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.500 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:22.500 04:09:59 -- setup/common.sh@33 -- # echo 0 00:03:22.500 04:09:59 -- setup/common.sh@33 -- # return 0 00:03:22.500 04:09:59 -- setup/hugepages.sh@100 -- # resv=0 00:03:22.500 04:09:59 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:22.500 nr_hugepages=1024 00:03:22.500 04:09:59 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:22.500 resv_hugepages=0 00:03:22.500 04:09:59 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:22.500 surplus_hugepages=0 00:03:22.500 04:09:59 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:22.500 anon_hugepages=0 00:03:22.500 04:09:59 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.500 04:09:59 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:22.500 04:09:59 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:22.500 04:09:59 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:22.500 04:09:59 -- setup/common.sh@18 -- # local node= 00:03:22.500 04:09:59 -- setup/common.sh@19 -- # local var val 00:03:22.500 04:09:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.500 04:09:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.500 04:09:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:22.500 04:09:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:22.500 04:09:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.500 04:09:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.500 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 45036316 kB' 'MemAvailable: 48806800 kB' 'Buffers: 2708 kB' 'Cached: 10754156 kB' 'SwapCached: 0 kB' 'Active: 7469184 kB' 'Inactive: 3764112 kB' 'Active(anon): 7068704 kB' 'Inactive(anon): 0 kB' 'Active(file): 400480 kB' 'Inactive(file): 3764112 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479660 kB' 'Mapped: 215000 kB' 'Shmem: 6592272 kB' 'KReclaimable: 198944 kB' 'Slab: 736932 kB' 'SReclaimable: 198944 kB' 'SUnreclaim: 537988 kB' 'KernelStack: 12864 kB' 'PageTables: 8052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 8133440 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 36288 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2111068 kB' 'DirectMap2M: 15634432 kB' 'DirectMap1G: 52428800 kB' 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.501 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.501 04:09:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:22.502 04:09:59 -- setup/common.sh@33 -- # echo 1024 00:03:22.502 04:09:59 -- setup/common.sh@33 -- # return 0 00:03:22.502 04:09:59 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:22.502 04:09:59 -- setup/hugepages.sh@112 -- # get_nodes 00:03:22.502 04:09:59 -- setup/hugepages.sh@27 -- # local node 00:03:22.502 04:09:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.502 04:09:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:22.502 04:09:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:22.502 04:09:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:22.502 04:09:59 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:22.502 04:09:59 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:22.502 04:09:59 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.502 04:09:59 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.502 04:09:59 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:22.502 04:09:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.502 04:09:59 -- setup/common.sh@18 -- # local node=0 00:03:22.502 04:09:59 -- setup/common.sh@19 -- # local var val 00:03:22.502 04:09:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.502 04:09:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.502 04:09:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:22.502 04:09:59 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:22.502 04:09:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.502 04:09:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26714180 kB' 'MemUsed: 6111676 kB' 'SwapCached: 0 kB' 'Active: 2544160 kB' 'Inactive: 176952 kB' 'Active(anon): 2387436 kB' 'Inactive(anon): 0 kB' 'Active(file): 156724 kB' 'Inactive(file): 176952 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2403396 kB' 'Mapped: 110820 kB' 'AnonPages: 320984 kB' 'Shmem: 2069720 kB' 'KernelStack: 7448 kB' 'PageTables: 5376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115860 kB' 'Slab: 438180 kB' 'SReclaimable: 115860 kB' 'SUnreclaim: 322320 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.502 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.502 04:09:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # continue 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.503 04:09:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.503 04:09:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.503 04:09:59 -- setup/common.sh@33 -- # echo 0 00:03:22.503 04:09:59 -- setup/common.sh@33 -- # return 0 00:03:22.503 04:09:59 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.503 04:09:59 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.503 04:09:59 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.503 04:09:59 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.503 04:09:59 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:22.503 node0=1024 expecting 1024 00:03:22.503 04:09:59 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:22.503 00:03:22.503 real 0m2.741s 00:03:22.503 user 0m1.088s 00:03:22.503 sys 0m1.565s 00:03:22.503 04:09:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.503 04:09:59 -- common/autotest_common.sh@10 -- # set +x 00:03:22.503 ************************************ 00:03:22.503 END TEST no_shrink_alloc 00:03:22.503 ************************************ 00:03:22.503 04:09:59 -- setup/hugepages.sh@217 -- # clear_hp 00:03:22.503 04:09:59 -- setup/hugepages.sh@37 -- # local node hp 00:03:22.503 04:09:59 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:22.503 04:09:59 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.503 04:09:59 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.503 04:09:59 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.503 04:09:59 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.503 04:09:59 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:22.503 04:09:59 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.503 04:09:59 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.503 04:09:59 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:22.503 04:09:59 -- setup/hugepages.sh@41 -- # echo 0 00:03:22.503 04:09:59 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:22.503 04:09:59 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:22.503 00:03:22.503 real 0m11.467s 00:03:22.503 user 0m4.347s 00:03:22.503 sys 0m6.025s 00:03:22.503 04:09:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.503 04:09:59 -- common/autotest_common.sh@10 -- # set +x 00:03:22.503 ************************************ 00:03:22.503 END TEST hugepages 00:03:22.503 ************************************ 00:03:22.503 04:09:59 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:22.503 04:09:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.503 04:09:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.503 04:09:59 -- common/autotest_common.sh@10 -- # set +x 00:03:22.503 ************************************ 00:03:22.503 START TEST driver 00:03:22.503 ************************************ 00:03:22.503 04:09:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:22.761 * Looking for test storage... 00:03:22.761 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:22.761 04:09:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:22.761 04:09:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:22.761 04:09:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:22.761 04:09:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:22.761 04:09:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:22.761 04:09:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:22.761 04:09:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:22.761 04:09:59 -- scripts/common.sh@335 -- # IFS=.-: 00:03:22.761 04:09:59 -- scripts/common.sh@335 -- # read -ra ver1 00:03:22.761 04:09:59 -- scripts/common.sh@336 -- # IFS=.-: 00:03:22.761 04:09:59 -- scripts/common.sh@336 -- # read -ra ver2 00:03:22.761 04:09:59 -- scripts/common.sh@337 -- # local 'op=<' 00:03:22.761 04:09:59 -- scripts/common.sh@339 -- # ver1_l=2 00:03:22.761 04:09:59 -- scripts/common.sh@340 -- # ver2_l=1 00:03:22.761 04:09:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:22.761 04:09:59 -- scripts/common.sh@343 -- # case "$op" in 00:03:22.761 04:09:59 -- scripts/common.sh@344 -- # : 1 00:03:22.761 04:09:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:22.761 04:09:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:22.761 04:09:59 -- scripts/common.sh@364 -- # decimal 1 00:03:22.761 04:09:59 -- scripts/common.sh@352 -- # local d=1 00:03:22.761 04:09:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:22.761 04:09:59 -- scripts/common.sh@354 -- # echo 1 00:03:22.762 04:09:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:22.762 04:09:59 -- scripts/common.sh@365 -- # decimal 2 00:03:22.762 04:09:59 -- scripts/common.sh@352 -- # local d=2 00:03:22.762 04:09:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:22.762 04:09:59 -- scripts/common.sh@354 -- # echo 2 00:03:22.762 04:09:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:22.762 04:09:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:22.762 04:09:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:22.762 04:09:59 -- scripts/common.sh@367 -- # return 0 00:03:22.762 04:09:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:22.762 04:09:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:22.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:22.762 --rc genhtml_branch_coverage=1 00:03:22.762 --rc genhtml_function_coverage=1 00:03:22.762 --rc genhtml_legend=1 00:03:22.762 --rc geninfo_all_blocks=1 00:03:22.762 --rc geninfo_unexecuted_blocks=1 00:03:22.762 00:03:22.762 ' 00:03:22.762 04:09:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:22.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:22.762 --rc genhtml_branch_coverage=1 00:03:22.762 --rc genhtml_function_coverage=1 00:03:22.762 --rc genhtml_legend=1 00:03:22.762 --rc geninfo_all_blocks=1 00:03:22.762 --rc geninfo_unexecuted_blocks=1 00:03:22.762 00:03:22.762 ' 00:03:22.762 04:09:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:22.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:22.762 --rc genhtml_branch_coverage=1 00:03:22.762 --rc genhtml_function_coverage=1 00:03:22.762 --rc genhtml_legend=1 00:03:22.762 --rc geninfo_all_blocks=1 00:03:22.762 --rc geninfo_unexecuted_blocks=1 00:03:22.762 00:03:22.762 ' 00:03:22.762 04:09:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:22.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:22.762 --rc genhtml_branch_coverage=1 00:03:22.762 --rc genhtml_function_coverage=1 00:03:22.762 --rc genhtml_legend=1 00:03:22.762 --rc geninfo_all_blocks=1 00:03:22.762 --rc geninfo_unexecuted_blocks=1 00:03:22.762 00:03:22.762 ' 00:03:22.762 04:09:59 -- setup/driver.sh@68 -- # setup reset 00:03:22.762 04:09:59 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:22.762 04:09:59 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:25.287 04:10:02 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:25.287 04:10:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.287 04:10:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.287 04:10:02 -- common/autotest_common.sh@10 -- # set +x 00:03:25.287 ************************************ 00:03:25.287 START TEST guess_driver 00:03:25.287 ************************************ 00:03:25.287 04:10:02 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:25.287 04:10:02 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:25.287 04:10:02 -- setup/driver.sh@47 -- # local fail=0 00:03:25.288 04:10:02 -- setup/driver.sh@49 -- # pick_driver 00:03:25.288 04:10:02 -- setup/driver.sh@36 -- # vfio 00:03:25.288 04:10:02 -- setup/driver.sh@21 -- # local iommu_grups 00:03:25.288 04:10:02 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:25.288 04:10:02 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:25.288 04:10:02 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:25.288 04:10:02 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:25.288 04:10:02 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:25.288 04:10:02 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:25.288 04:10:02 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:25.288 04:10:02 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:25.288 04:10:02 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:25.288 04:10:02 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:25.288 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:25.288 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:25.288 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:25.288 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:25.288 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:25.288 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:25.288 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:25.288 04:10:02 -- setup/driver.sh@30 -- # return 0 00:03:25.288 04:10:02 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:25.288 04:10:02 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:25.288 04:10:02 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:25.288 04:10:02 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:25.288 Looking for driver=vfio-pci 00:03:25.288 04:10:02 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:25.288 04:10:02 -- setup/driver.sh@45 -- # setup output config 00:03:25.288 04:10:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.288 04:10:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.664 04:10:03 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:26.664 04:10:03 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:26.664 04:10:03 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.599 04:10:04 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.599 04:10:04 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.599 04:10:04 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.857 04:10:04 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:27.857 04:10:04 -- setup/driver.sh@65 -- # setup reset 00:03:27.857 04:10:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:27.857 04:10:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:30.391 00:03:30.391 real 0m4.924s 00:03:30.391 user 0m1.135s 00:03:30.391 sys 0m1.932s 00:03:30.391 04:10:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:30.391 04:10:07 -- common/autotest_common.sh@10 -- # set +x 00:03:30.391 ************************************ 00:03:30.391 END TEST guess_driver 00:03:30.391 ************************************ 00:03:30.391 00:03:30.391 real 0m7.660s 00:03:30.391 user 0m1.835s 00:03:30.391 sys 0m3.035s 00:03:30.391 04:10:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:30.391 04:10:07 -- common/autotest_common.sh@10 -- # set +x 00:03:30.391 ************************************ 00:03:30.391 END TEST driver 00:03:30.391 ************************************ 00:03:30.391 04:10:07 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.391 04:10:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.391 04:10:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.391 04:10:07 -- common/autotest_common.sh@10 -- # set +x 00:03:30.391 ************************************ 00:03:30.391 START TEST devices 00:03:30.391 ************************************ 00:03:30.391 04:10:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.391 * Looking for test storage... 00:03:30.391 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:30.391 04:10:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:30.391 04:10:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:30.391 04:10:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:30.391 04:10:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:30.391 04:10:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:30.391 04:10:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:30.391 04:10:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:30.391 04:10:07 -- scripts/common.sh@335 -- # IFS=.-: 00:03:30.391 04:10:07 -- scripts/common.sh@335 -- # read -ra ver1 00:03:30.391 04:10:07 -- scripts/common.sh@336 -- # IFS=.-: 00:03:30.391 04:10:07 -- scripts/common.sh@336 -- # read -ra ver2 00:03:30.391 04:10:07 -- scripts/common.sh@337 -- # local 'op=<' 00:03:30.391 04:10:07 -- scripts/common.sh@339 -- # ver1_l=2 00:03:30.391 04:10:07 -- scripts/common.sh@340 -- # ver2_l=1 00:03:30.391 04:10:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:30.391 04:10:07 -- scripts/common.sh@343 -- # case "$op" in 00:03:30.391 04:10:07 -- scripts/common.sh@344 -- # : 1 00:03:30.391 04:10:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:30.391 04:10:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:30.391 04:10:07 -- scripts/common.sh@364 -- # decimal 1 00:03:30.391 04:10:07 -- scripts/common.sh@352 -- # local d=1 00:03:30.391 04:10:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:30.391 04:10:07 -- scripts/common.sh@354 -- # echo 1 00:03:30.391 04:10:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:30.391 04:10:07 -- scripts/common.sh@365 -- # decimal 2 00:03:30.391 04:10:07 -- scripts/common.sh@352 -- # local d=2 00:03:30.391 04:10:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:30.391 04:10:07 -- scripts/common.sh@354 -- # echo 2 00:03:30.391 04:10:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:30.391 04:10:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:30.391 04:10:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:30.391 04:10:07 -- scripts/common.sh@367 -- # return 0 00:03:30.391 04:10:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:30.391 04:10:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:30.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.391 --rc genhtml_branch_coverage=1 00:03:30.391 --rc genhtml_function_coverage=1 00:03:30.391 --rc genhtml_legend=1 00:03:30.391 --rc geninfo_all_blocks=1 00:03:30.391 --rc geninfo_unexecuted_blocks=1 00:03:30.391 00:03:30.391 ' 00:03:30.391 04:10:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:30.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.391 --rc genhtml_branch_coverage=1 00:03:30.391 --rc genhtml_function_coverage=1 00:03:30.391 --rc genhtml_legend=1 00:03:30.391 --rc geninfo_all_blocks=1 00:03:30.391 --rc geninfo_unexecuted_blocks=1 00:03:30.391 00:03:30.391 ' 00:03:30.391 04:10:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:30.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.391 --rc genhtml_branch_coverage=1 00:03:30.391 --rc genhtml_function_coverage=1 00:03:30.391 --rc genhtml_legend=1 00:03:30.391 --rc geninfo_all_blocks=1 00:03:30.391 --rc geninfo_unexecuted_blocks=1 00:03:30.391 00:03:30.391 ' 00:03:30.391 04:10:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:30.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.391 --rc genhtml_branch_coverage=1 00:03:30.391 --rc genhtml_function_coverage=1 00:03:30.391 --rc genhtml_legend=1 00:03:30.391 --rc geninfo_all_blocks=1 00:03:30.391 --rc geninfo_unexecuted_blocks=1 00:03:30.391 00:03:30.391 ' 00:03:30.391 04:10:07 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:30.391 04:10:07 -- setup/devices.sh@192 -- # setup reset 00:03:30.391 04:10:07 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:30.391 04:10:07 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:32.293 04:10:09 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:32.293 04:10:09 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:32.293 04:10:09 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:32.293 04:10:09 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:32.293 04:10:09 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:32.293 04:10:09 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:32.293 04:10:09 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:32.293 04:10:09 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:32.293 04:10:09 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:32.293 04:10:09 -- setup/devices.sh@196 -- # blocks=() 00:03:32.293 04:10:09 -- setup/devices.sh@196 -- # declare -a blocks 00:03:32.293 04:10:09 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:32.293 04:10:09 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:32.293 04:10:09 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:32.293 04:10:09 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:32.293 04:10:09 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:32.293 04:10:09 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:32.293 04:10:09 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:32.293 04:10:09 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:32.293 04:10:09 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:32.293 04:10:09 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:32.293 04:10:09 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:32.293 No valid GPT data, bailing 00:03:32.293 04:10:09 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:32.293 04:10:09 -- scripts/common.sh@393 -- # pt= 00:03:32.293 04:10:09 -- scripts/common.sh@394 -- # return 1 00:03:32.293 04:10:09 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:32.293 04:10:09 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:32.293 04:10:09 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:32.293 04:10:09 -- setup/common.sh@80 -- # echo 1000204886016 00:03:32.293 04:10:09 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:32.293 04:10:09 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:32.293 04:10:09 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:32.293 04:10:09 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:32.293 04:10:09 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:32.293 04:10:09 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:32.293 04:10:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.293 04:10:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.293 04:10:09 -- common/autotest_common.sh@10 -- # set +x 00:03:32.293 ************************************ 00:03:32.293 START TEST nvme_mount 00:03:32.293 ************************************ 00:03:32.293 04:10:09 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:32.293 04:10:09 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:32.293 04:10:09 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:32.293 04:10:09 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.293 04:10:09 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.293 04:10:09 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:32.293 04:10:09 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:32.293 04:10:09 -- setup/common.sh@40 -- # local part_no=1 00:03:32.293 04:10:09 -- setup/common.sh@41 -- # local size=1073741824 00:03:32.293 04:10:09 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:32.293 04:10:09 -- setup/common.sh@44 -- # parts=() 00:03:32.293 04:10:09 -- setup/common.sh@44 -- # local parts 00:03:32.293 04:10:09 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:32.293 04:10:09 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.293 04:10:09 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:32.293 04:10:09 -- setup/common.sh@46 -- # (( part++ )) 00:03:32.293 04:10:09 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.293 04:10:09 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:32.293 04:10:09 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:32.293 04:10:09 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:33.228 Creating new GPT entries in memory. 00:03:33.228 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:33.228 other utilities. 00:03:33.228 04:10:10 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:33.228 04:10:10 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:33.228 04:10:10 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:33.228 04:10:10 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:33.228 04:10:10 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:34.166 Creating new GPT entries in memory. 00:03:34.166 The operation has completed successfully. 00:03:34.166 04:10:11 -- setup/common.sh@57 -- # (( part++ )) 00:03:34.166 04:10:11 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:34.166 04:10:11 -- setup/common.sh@62 -- # wait 3760721 00:03:34.166 04:10:11 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.166 04:10:11 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:34.166 04:10:11 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.166 04:10:11 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:34.166 04:10:11 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:34.166 04:10:11 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.166 04:10:11 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.166 04:10:11 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:34.166 04:10:11 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:34.166 04:10:11 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.166 04:10:11 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.166 04:10:11 -- setup/devices.sh@53 -- # local found=0 00:03:34.166 04:10:11 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:34.166 04:10:11 -- setup/devices.sh@56 -- # : 00:03:34.166 04:10:11 -- setup/devices.sh@59 -- # local pci status 00:03:34.166 04:10:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.166 04:10:11 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:34.166 04:10:11 -- setup/devices.sh@47 -- # setup output config 00:03:34.166 04:10:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:34.166 04:10:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:35.542 04:10:12 -- setup/devices.sh@63 -- # found=1 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.542 04:10:12 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:35.542 04:10:12 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:35.542 04:10:12 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.542 04:10:12 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:35.542 04:10:12 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.542 04:10:12 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:35.542 04:10:12 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.542 04:10:12 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.542 04:10:12 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:35.542 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:35.542 04:10:12 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:35.542 04:10:12 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:35.800 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:35.800 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:35.800 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:35.800 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:35.800 04:10:12 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:35.800 04:10:12 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:35.800 04:10:12 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.800 04:10:12 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:35.800 04:10:12 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:35.800 04:10:12 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.800 04:10:13 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.800 04:10:13 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:35.800 04:10:13 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:35.800 04:10:13 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.800 04:10:13 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.800 04:10:13 -- setup/devices.sh@53 -- # local found=0 00:03:35.800 04:10:13 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:35.800 04:10:13 -- setup/devices.sh@56 -- # : 00:03:35.800 04:10:13 -- setup/devices.sh@59 -- # local pci status 00:03:35.800 04:10:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:35.800 04:10:13 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:35.800 04:10:13 -- setup/devices.sh@47 -- # setup output config 00:03:35.800 04:10:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.800 04:10:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:36.735 04:10:14 -- setup/devices.sh@63 -- # found=1 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.735 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.735 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.993 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.993 04:10:14 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:36.993 04:10:14 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:36.993 04:10:14 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.993 04:10:14 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:36.993 04:10:14 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:36.993 04:10:14 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.993 04:10:14 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:36.993 04:10:14 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:36.993 04:10:14 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:36.993 04:10:14 -- setup/devices.sh@50 -- # local mount_point= 00:03:36.993 04:10:14 -- setup/devices.sh@51 -- # local test_file= 00:03:36.993 04:10:14 -- setup/devices.sh@53 -- # local found=0 00:03:36.993 04:10:14 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:36.994 04:10:14 -- setup/devices.sh@59 -- # local pci status 00:03:36.994 04:10:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.994 04:10:14 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:36.994 04:10:14 -- setup/devices.sh@47 -- # setup output config 00:03:36.994 04:10:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:36.994 04:10:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:38.368 04:10:15 -- setup/devices.sh@63 -- # found=1 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.368 04:10:15 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:38.368 04:10:15 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:38.368 04:10:15 -- setup/devices.sh@68 -- # return 0 00:03:38.368 04:10:15 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:38.368 04:10:15 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.368 04:10:15 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:38.368 04:10:15 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:38.368 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:38.368 00:03:38.368 real 0m6.355s 00:03:38.368 user 0m1.465s 00:03:38.368 sys 0m2.504s 00:03:38.368 04:10:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.368 04:10:15 -- common/autotest_common.sh@10 -- # set +x 00:03:38.368 ************************************ 00:03:38.368 END TEST nvme_mount 00:03:38.368 ************************************ 00:03:38.368 04:10:15 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:38.368 04:10:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.368 04:10:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.368 04:10:15 -- common/autotest_common.sh@10 -- # set +x 00:03:38.368 ************************************ 00:03:38.368 START TEST dm_mount 00:03:38.368 ************************************ 00:03:38.368 04:10:15 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:38.368 04:10:15 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:38.368 04:10:15 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:38.368 04:10:15 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:38.368 04:10:15 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:38.368 04:10:15 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:38.368 04:10:15 -- setup/common.sh@40 -- # local part_no=2 00:03:38.368 04:10:15 -- setup/common.sh@41 -- # local size=1073741824 00:03:38.368 04:10:15 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:38.368 04:10:15 -- setup/common.sh@44 -- # parts=() 00:03:38.368 04:10:15 -- setup/common.sh@44 -- # local parts 00:03:38.368 04:10:15 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:38.368 04:10:15 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.368 04:10:15 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:38.368 04:10:15 -- setup/common.sh@46 -- # (( part++ )) 00:03:38.368 04:10:15 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.368 04:10:15 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:38.368 04:10:15 -- setup/common.sh@46 -- # (( part++ )) 00:03:38.368 04:10:15 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:38.368 04:10:15 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:38.368 04:10:15 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:38.368 04:10:15 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:39.743 Creating new GPT entries in memory. 00:03:39.743 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:39.743 other utilities. 00:03:39.743 04:10:16 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:39.743 04:10:16 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:39.743 04:10:16 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:39.743 04:10:16 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:39.743 04:10:16 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:40.680 Creating new GPT entries in memory. 00:03:40.680 The operation has completed successfully. 00:03:40.680 04:10:17 -- setup/common.sh@57 -- # (( part++ )) 00:03:40.680 04:10:17 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:40.680 04:10:17 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:40.680 04:10:17 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:40.680 04:10:17 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:41.615 The operation has completed successfully. 00:03:41.615 04:10:18 -- setup/common.sh@57 -- # (( part++ )) 00:03:41.615 04:10:18 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.615 04:10:18 -- setup/common.sh@62 -- # wait 3763179 00:03:41.615 04:10:18 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:41.615 04:10:18 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.615 04:10:18 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.615 04:10:18 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:41.615 04:10:18 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:41.615 04:10:18 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.615 04:10:18 -- setup/devices.sh@161 -- # break 00:03:41.615 04:10:18 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.615 04:10:18 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:41.615 04:10:18 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:41.615 04:10:18 -- setup/devices.sh@166 -- # dm=dm-0 00:03:41.615 04:10:18 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:41.615 04:10:18 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:41.615 04:10:18 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.615 04:10:18 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:41.615 04:10:18 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.615 04:10:18 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:41.615 04:10:18 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:41.615 04:10:18 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.615 04:10:18 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.615 04:10:18 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:41.615 04:10:18 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:41.615 04:10:18 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.615 04:10:18 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.615 04:10:18 -- setup/devices.sh@53 -- # local found=0 00:03:41.615 04:10:18 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:41.615 04:10:18 -- setup/devices.sh@56 -- # : 00:03:41.615 04:10:18 -- setup/devices.sh@59 -- # local pci status 00:03:41.616 04:10:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.616 04:10:18 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:41.616 04:10:18 -- setup/devices.sh@47 -- # setup output config 00:03:41.616 04:10:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:41.616 04:10:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:42.991 04:10:19 -- setup/devices.sh@63 -- # found=1 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.991 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.991 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.992 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.992 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.992 04:10:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.992 04:10:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.992 04:10:20 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:42.992 04:10:20 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:42.992 04:10:20 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.992 04:10:20 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:42.992 04:10:20 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:42.992 04:10:20 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.992 04:10:20 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:42.992 04:10:20 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:42.992 04:10:20 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:42.992 04:10:20 -- setup/devices.sh@50 -- # local mount_point= 00:03:42.992 04:10:20 -- setup/devices.sh@51 -- # local test_file= 00:03:42.992 04:10:20 -- setup/devices.sh@53 -- # local found=0 00:03:42.992 04:10:20 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:42.992 04:10:20 -- setup/devices.sh@59 -- # local pci status 00:03:42.992 04:10:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.992 04:10:20 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:42.992 04:10:20 -- setup/devices.sh@47 -- # setup output config 00:03:42.992 04:10:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.992 04:10:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:43.926 04:10:21 -- setup/devices.sh@63 -- # found=1 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.926 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.926 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.927 04:10:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.927 04:10:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.185 04:10:21 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:44.185 04:10:21 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:44.185 04:10:21 -- setup/devices.sh@68 -- # return 0 00:03:44.185 04:10:21 -- setup/devices.sh@187 -- # cleanup_dm 00:03:44.185 04:10:21 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.185 04:10:21 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.185 04:10:21 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:44.185 04:10:21 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.185 04:10:21 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:44.185 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:44.185 04:10:21 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.185 04:10:21 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:44.185 00:03:44.185 real 0m5.835s 00:03:44.185 user 0m1.027s 00:03:44.185 sys 0m1.650s 00:03:44.185 04:10:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.185 04:10:21 -- common/autotest_common.sh@10 -- # set +x 00:03:44.185 ************************************ 00:03:44.185 END TEST dm_mount 00:03:44.185 ************************************ 00:03:44.185 04:10:21 -- setup/devices.sh@1 -- # cleanup 00:03:44.185 04:10:21 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:44.185 04:10:21 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.444 04:10:21 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.444 04:10:21 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:44.444 04:10:21 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.444 04:10:21 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:44.702 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:44.702 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:44.702 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:44.702 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:44.702 04:10:21 -- setup/devices.sh@12 -- # cleanup_dm 00:03:44.702 04:10:21 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.702 04:10:21 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.702 04:10:21 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.702 04:10:21 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.702 04:10:21 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.702 04:10:21 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:44.702 00:03:44.702 real 0m14.301s 00:03:44.702 user 0m3.301s 00:03:44.702 sys 0m5.232s 00:03:44.702 04:10:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.702 04:10:21 -- common/autotest_common.sh@10 -- # set +x 00:03:44.702 ************************************ 00:03:44.702 END TEST devices 00:03:44.702 ************************************ 00:03:44.702 00:03:44.702 real 0m44.117s 00:03:44.702 user 0m12.822s 00:03:44.702 sys 0m19.806s 00:03:44.702 04:10:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.702 04:10:21 -- common/autotest_common.sh@10 -- # set +x 00:03:44.702 ************************************ 00:03:44.702 END TEST setup.sh 00:03:44.702 ************************************ 00:03:44.702 04:10:21 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:45.637 Hugepages 00:03:45.637 node hugesize free / total 00:03:45.637 node0 1048576kB 0 / 0 00:03:45.637 node0 2048kB 2048 / 2048 00:03:45.637 node1 1048576kB 0 / 0 00:03:45.637 node1 2048kB 0 / 0 00:03:45.637 00:03:45.637 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:45.637 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:45.637 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:45.637 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:45.637 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:45.637 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:45.637 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:45.637 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:45.637 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:45.637 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:45.896 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:45.896 04:10:23 -- spdk/autotest.sh@128 -- # uname -s 00:03:45.896 04:10:23 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:45.896 04:10:23 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:45.896 04:10:23 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:47.271 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:47.271 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:47.271 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:47.271 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:47.271 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:47.271 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:47.271 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:47.271 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:47.271 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:47.838 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:48.095 04:10:25 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:49.029 04:10:26 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:49.029 04:10:26 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:49.029 04:10:26 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:49.029 04:10:26 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:49.029 04:10:26 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:49.029 04:10:26 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:49.029 04:10:26 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:49.029 04:10:26 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:49.029 04:10:26 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:49.287 04:10:26 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:49.287 04:10:26 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:49.287 04:10:26 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:50.222 Waiting for block devices as requested 00:03:50.222 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:50.489 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:50.489 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:50.811 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:50.811 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:50.811 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:50.811 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:50.811 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:51.095 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:51.095 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:51.095 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:51.095 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:51.095 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:51.353 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:51.354 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:51.354 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:51.612 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:51.612 04:10:28 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:51.612 04:10:28 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:51.612 04:10:28 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:51.612 04:10:28 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:51.612 04:10:28 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:51.612 04:10:28 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:51.612 04:10:28 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:51.612 04:10:28 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:51.612 04:10:28 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:51.612 04:10:28 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:51.612 04:10:28 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:51.612 04:10:28 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:51.612 04:10:28 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:51.612 04:10:28 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:51.612 04:10:28 -- common/autotest_common.sh@1552 -- # continue 00:03:51.612 04:10:28 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:51.612 04:10:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:51.612 04:10:28 -- common/autotest_common.sh@10 -- # set +x 00:03:51.612 04:10:28 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:51.612 04:10:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:51.612 04:10:28 -- common/autotest_common.sh@10 -- # set +x 00:03:51.612 04:10:28 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:52.987 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:52.987 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:52.987 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:52.987 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:52.987 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:52.987 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:52.987 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:52.987 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:52.987 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:53.921 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:53.921 04:10:31 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:53.921 04:10:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:53.921 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:03:53.921 04:10:31 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:53.921 04:10:31 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:53.921 04:10:31 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:53.921 04:10:31 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:53.921 04:10:31 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:53.921 04:10:31 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:53.921 04:10:31 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:53.921 04:10:31 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:53.921 04:10:31 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:53.921 04:10:31 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:53.921 04:10:31 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:54.178 04:10:31 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:54.178 04:10:31 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:54.178 04:10:31 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:54.178 04:10:31 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:54.178 04:10:31 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:54.178 04:10:31 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:54.178 04:10:31 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:54.178 04:10:31 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:54.178 04:10:31 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:54.178 04:10:31 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3768608 00:03:54.178 04:10:31 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:54.178 04:10:31 -- common/autotest_common.sh@1593 -- # waitforlisten 3768608 00:03:54.179 04:10:31 -- common/autotest_common.sh@829 -- # '[' -z 3768608 ']' 00:03:54.179 04:10:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:54.179 04:10:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:54.179 04:10:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:54.179 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:54.179 04:10:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:54.179 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:03:54.179 [2024-11-28 04:10:31.296063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:54.179 [2024-11-28 04:10:31.296145] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3768608 ] 00:03:54.179 EAL: No free 2048 kB hugepages reported on node 1 00:03:54.179 [2024-11-28 04:10:31.353509] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:54.179 [2024-11-28 04:10:31.458810] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:54.179 [2024-11-28 04:10:31.458980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:55.112 04:10:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:55.113 04:10:32 -- common/autotest_common.sh@862 -- # return 0 00:03:55.113 04:10:32 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:55.113 04:10:32 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:55.113 04:10:32 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:58.395 nvme0n1 00:03:58.395 04:10:35 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:58.395 [2024-11-28 04:10:35.628553] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:58.395 [2024-11-28 04:10:35.628610] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:58.395 request: 00:03:58.395 { 00:03:58.395 "nvme_ctrlr_name": "nvme0", 00:03:58.395 "password": "test", 00:03:58.395 "method": "bdev_nvme_opal_revert", 00:03:58.395 "req_id": 1 00:03:58.395 } 00:03:58.395 Got JSON-RPC error response 00:03:58.395 response: 00:03:58.395 { 00:03:58.395 "code": -32603, 00:03:58.395 "message": "Internal error" 00:03:58.395 } 00:03:58.395 04:10:35 -- common/autotest_common.sh@1599 -- # true 00:03:58.395 04:10:35 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:58.395 04:10:35 -- common/autotest_common.sh@1603 -- # killprocess 3768608 00:03:58.395 04:10:35 -- common/autotest_common.sh@936 -- # '[' -z 3768608 ']' 00:03:58.395 04:10:35 -- common/autotest_common.sh@940 -- # kill -0 3768608 00:03:58.396 04:10:35 -- common/autotest_common.sh@941 -- # uname 00:03:58.396 04:10:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:58.396 04:10:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3768608 00:03:58.396 04:10:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:58.396 04:10:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:58.396 04:10:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3768608' 00:03:58.396 killing process with pid 3768608 00:03:58.396 04:10:35 -- common/autotest_common.sh@955 -- # kill 3768608 00:03:58.396 04:10:35 -- common/autotest_common.sh@960 -- # wait 3768608 00:04:00.295 04:10:37 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:00.295 04:10:37 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:00.295 04:10:37 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:00.295 04:10:37 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:00.295 04:10:37 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:00.295 04:10:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:00.295 04:10:37 -- common/autotest_common.sh@10 -- # set +x 00:04:00.295 04:10:37 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.295 04:10:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.295 04:10:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.295 04:10:37 -- common/autotest_common.sh@10 -- # set +x 00:04:00.295 ************************************ 00:04:00.295 START TEST env 00:04:00.295 ************************************ 00:04:00.295 04:10:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.295 * Looking for test storage... 00:04:00.295 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:00.295 04:10:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:00.295 04:10:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:00.295 04:10:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:00.554 04:10:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:00.554 04:10:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:00.554 04:10:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:00.554 04:10:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:00.554 04:10:37 -- scripts/common.sh@335 -- # IFS=.-: 00:04:00.554 04:10:37 -- scripts/common.sh@335 -- # read -ra ver1 00:04:00.554 04:10:37 -- scripts/common.sh@336 -- # IFS=.-: 00:04:00.554 04:10:37 -- scripts/common.sh@336 -- # read -ra ver2 00:04:00.554 04:10:37 -- scripts/common.sh@337 -- # local 'op=<' 00:04:00.554 04:10:37 -- scripts/common.sh@339 -- # ver1_l=2 00:04:00.554 04:10:37 -- scripts/common.sh@340 -- # ver2_l=1 00:04:00.554 04:10:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:00.554 04:10:37 -- scripts/common.sh@343 -- # case "$op" in 00:04:00.554 04:10:37 -- scripts/common.sh@344 -- # : 1 00:04:00.554 04:10:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:00.554 04:10:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:00.554 04:10:37 -- scripts/common.sh@364 -- # decimal 1 00:04:00.554 04:10:37 -- scripts/common.sh@352 -- # local d=1 00:04:00.554 04:10:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:00.554 04:10:37 -- scripts/common.sh@354 -- # echo 1 00:04:00.554 04:10:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:00.554 04:10:37 -- scripts/common.sh@365 -- # decimal 2 00:04:00.554 04:10:37 -- scripts/common.sh@352 -- # local d=2 00:04:00.554 04:10:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:00.554 04:10:37 -- scripts/common.sh@354 -- # echo 2 00:04:00.554 04:10:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:00.554 04:10:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:00.554 04:10:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:00.554 04:10:37 -- scripts/common.sh@367 -- # return 0 00:04:00.554 04:10:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:00.554 04:10:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:00.554 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.554 --rc genhtml_branch_coverage=1 00:04:00.554 --rc genhtml_function_coverage=1 00:04:00.554 --rc genhtml_legend=1 00:04:00.554 --rc geninfo_all_blocks=1 00:04:00.554 --rc geninfo_unexecuted_blocks=1 00:04:00.554 00:04:00.554 ' 00:04:00.554 04:10:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:00.554 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.554 --rc genhtml_branch_coverage=1 00:04:00.554 --rc genhtml_function_coverage=1 00:04:00.554 --rc genhtml_legend=1 00:04:00.554 --rc geninfo_all_blocks=1 00:04:00.554 --rc geninfo_unexecuted_blocks=1 00:04:00.554 00:04:00.554 ' 00:04:00.554 04:10:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:00.554 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.555 --rc genhtml_branch_coverage=1 00:04:00.555 --rc genhtml_function_coverage=1 00:04:00.555 --rc genhtml_legend=1 00:04:00.555 --rc geninfo_all_blocks=1 00:04:00.555 --rc geninfo_unexecuted_blocks=1 00:04:00.555 00:04:00.555 ' 00:04:00.555 04:10:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:00.555 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.555 --rc genhtml_branch_coverage=1 00:04:00.555 --rc genhtml_function_coverage=1 00:04:00.555 --rc genhtml_legend=1 00:04:00.555 --rc geninfo_all_blocks=1 00:04:00.555 --rc geninfo_unexecuted_blocks=1 00:04:00.555 00:04:00.555 ' 00:04:00.555 04:10:37 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.555 04:10:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.555 04:10:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.555 04:10:37 -- common/autotest_common.sh@10 -- # set +x 00:04:00.555 ************************************ 00:04:00.555 START TEST env_memory 00:04:00.555 ************************************ 00:04:00.555 04:10:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.555 00:04:00.555 00:04:00.555 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.555 http://cunit.sourceforge.net/ 00:04:00.555 00:04:00.555 00:04:00.555 Suite: memory 00:04:00.555 Test: alloc and free memory map ...[2024-11-28 04:10:37.699594] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:00.555 passed 00:04:00.555 Test: mem map translation ...[2024-11-28 04:10:37.720027] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:00.555 [2024-11-28 04:10:37.720049] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:00.555 [2024-11-28 04:10:37.720104] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:00.555 [2024-11-28 04:10:37.720116] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:00.555 passed 00:04:00.555 Test: mem map registration ...[2024-11-28 04:10:37.762083] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:00.555 [2024-11-28 04:10:37.762102] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:00.555 passed 00:04:00.555 Test: mem map adjacent registrations ...passed 00:04:00.555 00:04:00.555 Run Summary: Type Total Ran Passed Failed Inactive 00:04:00.555 suites 1 1 n/a 0 0 00:04:00.555 tests 4 4 4 0 0 00:04:00.555 asserts 152 152 152 0 n/a 00:04:00.555 00:04:00.555 Elapsed time = 0.143 seconds 00:04:00.555 00:04:00.555 real 0m0.151s 00:04:00.555 user 0m0.143s 00:04:00.555 sys 0m0.007s 00:04:00.555 04:10:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:00.555 04:10:37 -- common/autotest_common.sh@10 -- # set +x 00:04:00.555 ************************************ 00:04:00.555 END TEST env_memory 00:04:00.555 ************************************ 00:04:00.555 04:10:37 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.555 04:10:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.555 04:10:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.555 04:10:37 -- common/autotest_common.sh@10 -- # set +x 00:04:00.555 ************************************ 00:04:00.555 START TEST env_vtophys 00:04:00.555 ************************************ 00:04:00.555 04:10:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.555 EAL: lib.eal log level changed from notice to debug 00:04:00.555 EAL: Detected lcore 0 as core 0 on socket 0 00:04:00.555 EAL: Detected lcore 1 as core 1 on socket 0 00:04:00.555 EAL: Detected lcore 2 as core 2 on socket 0 00:04:00.555 EAL: Detected lcore 3 as core 3 on socket 0 00:04:00.555 EAL: Detected lcore 4 as core 4 on socket 0 00:04:00.555 EAL: Detected lcore 5 as core 5 on socket 0 00:04:00.555 EAL: Detected lcore 6 as core 8 on socket 0 00:04:00.555 EAL: Detected lcore 7 as core 9 on socket 0 00:04:00.555 EAL: Detected lcore 8 as core 10 on socket 0 00:04:00.555 EAL: Detected lcore 9 as core 11 on socket 0 00:04:00.555 EAL: Detected lcore 10 as core 12 on socket 0 00:04:00.555 EAL: Detected lcore 11 as core 13 on socket 0 00:04:00.555 EAL: Detected lcore 12 as core 0 on socket 1 00:04:00.555 EAL: Detected lcore 13 as core 1 on socket 1 00:04:00.555 EAL: Detected lcore 14 as core 2 on socket 1 00:04:00.555 EAL: Detected lcore 15 as core 3 on socket 1 00:04:00.555 EAL: Detected lcore 16 as core 4 on socket 1 00:04:00.555 EAL: Detected lcore 17 as core 5 on socket 1 00:04:00.555 EAL: Detected lcore 18 as core 8 on socket 1 00:04:00.555 EAL: Detected lcore 19 as core 9 on socket 1 00:04:00.555 EAL: Detected lcore 20 as core 10 on socket 1 00:04:00.555 EAL: Detected lcore 21 as core 11 on socket 1 00:04:00.555 EAL: Detected lcore 22 as core 12 on socket 1 00:04:00.555 EAL: Detected lcore 23 as core 13 on socket 1 00:04:00.555 EAL: Detected lcore 24 as core 0 on socket 0 00:04:00.555 EAL: Detected lcore 25 as core 1 on socket 0 00:04:00.555 EAL: Detected lcore 26 as core 2 on socket 0 00:04:00.555 EAL: Detected lcore 27 as core 3 on socket 0 00:04:00.555 EAL: Detected lcore 28 as core 4 on socket 0 00:04:00.555 EAL: Detected lcore 29 as core 5 on socket 0 00:04:00.555 EAL: Detected lcore 30 as core 8 on socket 0 00:04:00.555 EAL: Detected lcore 31 as core 9 on socket 0 00:04:00.555 EAL: Detected lcore 32 as core 10 on socket 0 00:04:00.555 EAL: Detected lcore 33 as core 11 on socket 0 00:04:00.555 EAL: Detected lcore 34 as core 12 on socket 0 00:04:00.555 EAL: Detected lcore 35 as core 13 on socket 0 00:04:00.555 EAL: Detected lcore 36 as core 0 on socket 1 00:04:00.555 EAL: Detected lcore 37 as core 1 on socket 1 00:04:00.555 EAL: Detected lcore 38 as core 2 on socket 1 00:04:00.555 EAL: Detected lcore 39 as core 3 on socket 1 00:04:00.555 EAL: Detected lcore 40 as core 4 on socket 1 00:04:00.555 EAL: Detected lcore 41 as core 5 on socket 1 00:04:00.555 EAL: Detected lcore 42 as core 8 on socket 1 00:04:00.555 EAL: Detected lcore 43 as core 9 on socket 1 00:04:00.555 EAL: Detected lcore 44 as core 10 on socket 1 00:04:00.555 EAL: Detected lcore 45 as core 11 on socket 1 00:04:00.555 EAL: Detected lcore 46 as core 12 on socket 1 00:04:00.555 EAL: Detected lcore 47 as core 13 on socket 1 00:04:00.555 EAL: Maximum logical cores by configuration: 128 00:04:00.555 EAL: Detected CPU lcores: 48 00:04:00.555 EAL: Detected NUMA nodes: 2 00:04:00.555 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:00.555 EAL: Detected shared linkage of DPDK 00:04:00.555 EAL: No shared files mode enabled, IPC will be disabled 00:04:00.813 EAL: Bus pci wants IOVA as 'DC' 00:04:00.813 EAL: Buses did not request a specific IOVA mode. 00:04:00.813 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:00.813 EAL: Selected IOVA mode 'VA' 00:04:00.813 EAL: No free 2048 kB hugepages reported on node 1 00:04:00.813 EAL: Probing VFIO support... 00:04:00.813 EAL: IOMMU type 1 (Type 1) is supported 00:04:00.813 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:00.813 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:00.813 EAL: VFIO support initialized 00:04:00.813 EAL: Ask a virtual area of 0x2e000 bytes 00:04:00.813 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:00.813 EAL: Setting up physically contiguous memory... 00:04:00.813 EAL: Setting maximum number of open files to 524288 00:04:00.813 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:00.813 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:00.813 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:00.813 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:00.813 EAL: Ask a virtual area of 0x61000 bytes 00:04:00.813 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:00.813 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:00.813 EAL: Ask a virtual area of 0x400000000 bytes 00:04:00.813 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:00.813 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:00.813 EAL: Hugepages will be freed exactly as allocated. 00:04:00.813 EAL: No shared files mode enabled, IPC is disabled 00:04:00.813 EAL: No shared files mode enabled, IPC is disabled 00:04:00.813 EAL: TSC frequency is ~2700000 KHz 00:04:00.813 EAL: Main lcore 0 is ready (tid=7fe78374da00;cpuset=[0]) 00:04:00.813 EAL: Trying to obtain current memory policy. 00:04:00.813 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.813 EAL: Restoring previous memory policy: 0 00:04:00.813 EAL: request: mp_malloc_sync 00:04:00.813 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 2MB 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:00.814 EAL: Mem event callback 'spdk:(nil)' registered 00:04:00.814 00:04:00.814 00:04:00.814 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.814 http://cunit.sourceforge.net/ 00:04:00.814 00:04:00.814 00:04:00.814 Suite: components_suite 00:04:00.814 Test: vtophys_malloc_test ...passed 00:04:00.814 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.814 EAL: Restoring previous memory policy: 4 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 4MB 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was shrunk by 4MB 00:04:00.814 EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.814 EAL: Restoring previous memory policy: 4 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 6MB 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was shrunk by 6MB 00:04:00.814 EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.814 EAL: Restoring previous memory policy: 4 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 10MB 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was shrunk by 10MB 00:04:00.814 EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.814 EAL: Restoring previous memory policy: 4 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 18MB 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was shrunk by 18MB 00:04:00.814 EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.814 EAL: Restoring previous memory policy: 4 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 34MB 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was shrunk by 34MB 00:04:00.814 EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.814 EAL: Restoring previous memory policy: 4 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 66MB 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was shrunk by 66MB 00:04:00.814 EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:00.814 EAL: Restoring previous memory policy: 4 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was expanded by 130MB 00:04:00.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:00.814 EAL: request: mp_malloc_sync 00:04:00.814 EAL: No shared files mode enabled, IPC is disabled 00:04:00.814 EAL: Heap on socket 0 was shrunk by 130MB 00:04:00.814 EAL: Trying to obtain current memory policy. 00:04:00.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.072 EAL: Restoring previous memory policy: 4 00:04:01.072 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.072 EAL: request: mp_malloc_sync 00:04:01.072 EAL: No shared files mode enabled, IPC is disabled 00:04:01.072 EAL: Heap on socket 0 was expanded by 258MB 00:04:01.072 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.072 EAL: request: mp_malloc_sync 00:04:01.072 EAL: No shared files mode enabled, IPC is disabled 00:04:01.072 EAL: Heap on socket 0 was shrunk by 258MB 00:04:01.072 EAL: Trying to obtain current memory policy. 00:04:01.072 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.330 EAL: Restoring previous memory policy: 4 00:04:01.330 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.330 EAL: request: mp_malloc_sync 00:04:01.330 EAL: No shared files mode enabled, IPC is disabled 00:04:01.330 EAL: Heap on socket 0 was expanded by 514MB 00:04:01.330 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.330 EAL: request: mp_malloc_sync 00:04:01.330 EAL: No shared files mode enabled, IPC is disabled 00:04:01.330 EAL: Heap on socket 0 was shrunk by 514MB 00:04:01.330 EAL: Trying to obtain current memory policy. 00:04:01.330 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.894 EAL: Restoring previous memory policy: 4 00:04:01.894 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.894 EAL: request: mp_malloc_sync 00:04:01.894 EAL: No shared files mode enabled, IPC is disabled 00:04:01.894 EAL: Heap on socket 0 was expanded by 1026MB 00:04:01.894 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.152 EAL: request: mp_malloc_sync 00:04:02.152 EAL: No shared files mode enabled, IPC is disabled 00:04:02.152 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:02.152 passed 00:04:02.152 00:04:02.152 Run Summary: Type Total Ran Passed Failed Inactive 00:04:02.152 suites 1 1 n/a 0 0 00:04:02.152 tests 2 2 2 0 0 00:04:02.152 asserts 497 497 497 0 n/a 00:04:02.152 00:04:02.152 Elapsed time = 1.389 seconds 00:04:02.152 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.152 EAL: request: mp_malloc_sync 00:04:02.152 EAL: No shared files mode enabled, IPC is disabled 00:04:02.152 EAL: Heap on socket 0 was shrunk by 2MB 00:04:02.152 EAL: No shared files mode enabled, IPC is disabled 00:04:02.152 EAL: No shared files mode enabled, IPC is disabled 00:04:02.152 EAL: No shared files mode enabled, IPC is disabled 00:04:02.152 00:04:02.152 real 0m1.507s 00:04:02.152 user 0m0.864s 00:04:02.152 sys 0m0.605s 00:04:02.152 04:10:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:02.152 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:04:02.152 ************************************ 00:04:02.152 END TEST env_vtophys 00:04:02.152 ************************************ 00:04:02.152 04:10:39 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:02.152 04:10:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.152 04:10:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.152 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:04:02.152 ************************************ 00:04:02.152 START TEST env_pci 00:04:02.152 ************************************ 00:04:02.152 04:10:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:02.152 00:04:02.152 00:04:02.152 CUnit - A unit testing framework for C - Version 2.1-3 00:04:02.152 http://cunit.sourceforge.net/ 00:04:02.152 00:04:02.152 00:04:02.152 Suite: pci 00:04:02.152 Test: pci_hook ...[2024-11-28 04:10:39.388722] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3769656 has claimed it 00:04:02.152 EAL: Cannot find device (10000:00:01.0) 00:04:02.152 EAL: Failed to attach device on primary process 00:04:02.152 passed 00:04:02.152 00:04:02.152 Run Summary: Type Total Ran Passed Failed Inactive 00:04:02.152 suites 1 1 n/a 0 0 00:04:02.152 tests 1 1 1 0 0 00:04:02.152 asserts 25 25 25 0 n/a 00:04:02.152 00:04:02.152 Elapsed time = 0.022 seconds 00:04:02.152 00:04:02.152 real 0m0.036s 00:04:02.152 user 0m0.014s 00:04:02.152 sys 0m0.021s 00:04:02.152 04:10:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:02.152 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:04:02.152 ************************************ 00:04:02.152 END TEST env_pci 00:04:02.152 ************************************ 00:04:02.152 04:10:39 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:02.152 04:10:39 -- env/env.sh@15 -- # uname 00:04:02.152 04:10:39 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:02.152 04:10:39 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:02.152 04:10:39 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:02.152 04:10:39 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:02.152 04:10:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.152 04:10:39 -- common/autotest_common.sh@10 -- # set +x 00:04:02.152 ************************************ 00:04:02.152 START TEST env_dpdk_post_init 00:04:02.152 ************************************ 00:04:02.152 04:10:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:02.410 EAL: Detected CPU lcores: 48 00:04:02.410 EAL: Detected NUMA nodes: 2 00:04:02.410 EAL: Detected shared linkage of DPDK 00:04:02.410 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:02.410 EAL: Selected IOVA mode 'VA' 00:04:02.410 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.410 EAL: VFIO support initialized 00:04:02.410 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:02.410 EAL: Using IOMMU type 1 (Type 1) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:02.410 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:02.668 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:02.668 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:02.668 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:03.235 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:06.515 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:06.515 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:06.773 Starting DPDK initialization... 00:04:06.773 Starting SPDK post initialization... 00:04:06.773 SPDK NVMe probe 00:04:06.773 Attaching to 0000:88:00.0 00:04:06.773 Attached to 0000:88:00.0 00:04:06.773 Cleaning up... 00:04:06.773 00:04:06.773 real 0m4.395s 00:04:06.773 user 0m3.288s 00:04:06.773 sys 0m0.164s 00:04:06.773 04:10:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.773 04:10:43 -- common/autotest_common.sh@10 -- # set +x 00:04:06.773 ************************************ 00:04:06.773 END TEST env_dpdk_post_init 00:04:06.773 ************************************ 00:04:06.773 04:10:43 -- env/env.sh@26 -- # uname 00:04:06.773 04:10:43 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:06.773 04:10:43 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:06.773 04:10:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.773 04:10:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.773 04:10:43 -- common/autotest_common.sh@10 -- # set +x 00:04:06.773 ************************************ 00:04:06.773 START TEST env_mem_callbacks 00:04:06.773 ************************************ 00:04:06.773 04:10:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:06.773 EAL: Detected CPU lcores: 48 00:04:06.773 EAL: Detected NUMA nodes: 2 00:04:06.773 EAL: Detected shared linkage of DPDK 00:04:06.773 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:06.773 EAL: Selected IOVA mode 'VA' 00:04:06.773 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.773 EAL: VFIO support initialized 00:04:06.773 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:06.773 00:04:06.773 00:04:06.773 CUnit - A unit testing framework for C - Version 2.1-3 00:04:06.773 http://cunit.sourceforge.net/ 00:04:06.773 00:04:06.773 00:04:06.773 Suite: memory 00:04:06.773 Test: test ... 00:04:06.773 register 0x200000200000 2097152 00:04:06.773 malloc 3145728 00:04:06.773 register 0x200000400000 4194304 00:04:06.773 buf 0x200000500000 len 3145728 PASSED 00:04:06.773 malloc 64 00:04:06.773 buf 0x2000004fff40 len 64 PASSED 00:04:06.773 malloc 4194304 00:04:06.773 register 0x200000800000 6291456 00:04:06.773 buf 0x200000a00000 len 4194304 PASSED 00:04:06.773 free 0x200000500000 3145728 00:04:06.773 free 0x2000004fff40 64 00:04:06.773 unregister 0x200000400000 4194304 PASSED 00:04:06.773 free 0x200000a00000 4194304 00:04:06.773 unregister 0x200000800000 6291456 PASSED 00:04:06.773 malloc 8388608 00:04:06.773 register 0x200000400000 10485760 00:04:06.773 buf 0x200000600000 len 8388608 PASSED 00:04:06.773 free 0x200000600000 8388608 00:04:06.773 unregister 0x200000400000 10485760 PASSED 00:04:06.773 passed 00:04:06.773 00:04:06.773 Run Summary: Type Total Ran Passed Failed Inactive 00:04:06.773 suites 1 1 n/a 0 0 00:04:06.773 tests 1 1 1 0 0 00:04:06.773 asserts 15 15 15 0 n/a 00:04:06.773 00:04:06.773 Elapsed time = 0.005 seconds 00:04:06.773 00:04:06.773 real 0m0.049s 00:04:06.773 user 0m0.009s 00:04:06.773 sys 0m0.040s 00:04:06.773 04:10:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.773 04:10:43 -- common/autotest_common.sh@10 -- # set +x 00:04:06.773 ************************************ 00:04:06.773 END TEST env_mem_callbacks 00:04:06.773 ************************************ 00:04:06.773 00:04:06.773 real 0m6.410s 00:04:06.773 user 0m4.469s 00:04:06.773 sys 0m0.989s 00:04:06.773 04:10:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.773 04:10:43 -- common/autotest_common.sh@10 -- # set +x 00:04:06.773 ************************************ 00:04:06.773 END TEST env 00:04:06.773 ************************************ 00:04:06.773 04:10:43 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:06.773 04:10:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.773 04:10:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.773 04:10:43 -- common/autotest_common.sh@10 -- # set +x 00:04:06.773 ************************************ 00:04:06.773 START TEST rpc 00:04:06.773 ************************************ 00:04:06.773 04:10:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:06.774 * Looking for test storage... 00:04:06.774 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:06.774 04:10:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:06.774 04:10:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:06.774 04:10:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:07.032 04:10:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:07.032 04:10:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:07.032 04:10:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:07.032 04:10:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:07.032 04:10:44 -- scripts/common.sh@335 -- # IFS=.-: 00:04:07.032 04:10:44 -- scripts/common.sh@335 -- # read -ra ver1 00:04:07.032 04:10:44 -- scripts/common.sh@336 -- # IFS=.-: 00:04:07.032 04:10:44 -- scripts/common.sh@336 -- # read -ra ver2 00:04:07.032 04:10:44 -- scripts/common.sh@337 -- # local 'op=<' 00:04:07.032 04:10:44 -- scripts/common.sh@339 -- # ver1_l=2 00:04:07.032 04:10:44 -- scripts/common.sh@340 -- # ver2_l=1 00:04:07.032 04:10:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:07.032 04:10:44 -- scripts/common.sh@343 -- # case "$op" in 00:04:07.032 04:10:44 -- scripts/common.sh@344 -- # : 1 00:04:07.032 04:10:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:07.032 04:10:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:07.032 04:10:44 -- scripts/common.sh@364 -- # decimal 1 00:04:07.032 04:10:44 -- scripts/common.sh@352 -- # local d=1 00:04:07.032 04:10:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:07.032 04:10:44 -- scripts/common.sh@354 -- # echo 1 00:04:07.032 04:10:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:07.032 04:10:44 -- scripts/common.sh@365 -- # decimal 2 00:04:07.032 04:10:44 -- scripts/common.sh@352 -- # local d=2 00:04:07.032 04:10:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:07.032 04:10:44 -- scripts/common.sh@354 -- # echo 2 00:04:07.032 04:10:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:07.032 04:10:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:07.032 04:10:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:07.032 04:10:44 -- scripts/common.sh@367 -- # return 0 00:04:07.032 04:10:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:07.032 04:10:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:07.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.032 --rc genhtml_branch_coverage=1 00:04:07.032 --rc genhtml_function_coverage=1 00:04:07.032 --rc genhtml_legend=1 00:04:07.032 --rc geninfo_all_blocks=1 00:04:07.032 --rc geninfo_unexecuted_blocks=1 00:04:07.032 00:04:07.032 ' 00:04:07.032 04:10:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:07.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.032 --rc genhtml_branch_coverage=1 00:04:07.032 --rc genhtml_function_coverage=1 00:04:07.032 --rc genhtml_legend=1 00:04:07.032 --rc geninfo_all_blocks=1 00:04:07.032 --rc geninfo_unexecuted_blocks=1 00:04:07.032 00:04:07.032 ' 00:04:07.032 04:10:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:07.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.032 --rc genhtml_branch_coverage=1 00:04:07.032 --rc genhtml_function_coverage=1 00:04:07.032 --rc genhtml_legend=1 00:04:07.032 --rc geninfo_all_blocks=1 00:04:07.032 --rc geninfo_unexecuted_blocks=1 00:04:07.032 00:04:07.032 ' 00:04:07.032 04:10:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:07.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.032 --rc genhtml_branch_coverage=1 00:04:07.032 --rc genhtml_function_coverage=1 00:04:07.032 --rc genhtml_legend=1 00:04:07.032 --rc geninfo_all_blocks=1 00:04:07.032 --rc geninfo_unexecuted_blocks=1 00:04:07.032 00:04:07.032 ' 00:04:07.032 04:10:44 -- rpc/rpc.sh@65 -- # spdk_pid=3770324 00:04:07.032 04:10:44 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:07.032 04:10:44 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:07.032 04:10:44 -- rpc/rpc.sh@67 -- # waitforlisten 3770324 00:04:07.032 04:10:44 -- common/autotest_common.sh@829 -- # '[' -z 3770324 ']' 00:04:07.032 04:10:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:07.032 04:10:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:07.032 04:10:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:07.032 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:07.032 04:10:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:07.032 04:10:44 -- common/autotest_common.sh@10 -- # set +x 00:04:07.032 [2024-11-28 04:10:44.145953] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:07.033 [2024-11-28 04:10:44.146045] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3770324 ] 00:04:07.033 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.033 [2024-11-28 04:10:44.202976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:07.033 [2024-11-28 04:10:44.311191] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:07.033 [2024-11-28 04:10:44.311369] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:07.033 [2024-11-28 04:10:44.311397] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3770324' to capture a snapshot of events at runtime. 00:04:07.033 [2024-11-28 04:10:44.311412] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3770324 for offline analysis/debug. 00:04:07.033 [2024-11-28 04:10:44.311446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.966 04:10:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:07.966 04:10:45 -- common/autotest_common.sh@862 -- # return 0 00:04:07.966 04:10:45 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.966 04:10:45 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.966 04:10:45 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:07.966 04:10:45 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:07.966 04:10:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.966 04:10:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.966 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.966 ************************************ 00:04:07.966 START TEST rpc_integrity 00:04:07.966 ************************************ 00:04:07.966 04:10:45 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:07.966 04:10:45 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:07.966 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.966 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.966 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.966 04:10:45 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:07.966 04:10:45 -- rpc/rpc.sh@13 -- # jq length 00:04:07.966 04:10:45 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:07.966 04:10:45 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:07.966 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.966 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.966 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.966 04:10:45 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:07.966 04:10:45 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:07.966 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.966 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.966 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.966 04:10:45 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:07.966 { 00:04:07.966 "name": "Malloc0", 00:04:07.966 "aliases": [ 00:04:07.966 "b8aaa265-21b5-4836-9d12-b32d868d971e" 00:04:07.966 ], 00:04:07.966 "product_name": "Malloc disk", 00:04:07.966 "block_size": 512, 00:04:07.966 "num_blocks": 16384, 00:04:07.966 "uuid": "b8aaa265-21b5-4836-9d12-b32d868d971e", 00:04:07.966 "assigned_rate_limits": { 00:04:07.966 "rw_ios_per_sec": 0, 00:04:07.966 "rw_mbytes_per_sec": 0, 00:04:07.966 "r_mbytes_per_sec": 0, 00:04:07.966 "w_mbytes_per_sec": 0 00:04:07.966 }, 00:04:07.966 "claimed": false, 00:04:07.966 "zoned": false, 00:04:07.966 "supported_io_types": { 00:04:07.966 "read": true, 00:04:07.966 "write": true, 00:04:07.966 "unmap": true, 00:04:07.966 "write_zeroes": true, 00:04:07.966 "flush": true, 00:04:07.966 "reset": true, 00:04:07.966 "compare": false, 00:04:07.966 "compare_and_write": false, 00:04:07.966 "abort": true, 00:04:07.966 "nvme_admin": false, 00:04:07.966 "nvme_io": false 00:04:07.966 }, 00:04:07.966 "memory_domains": [ 00:04:07.966 { 00:04:07.966 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.966 "dma_device_type": 2 00:04:07.966 } 00:04:07.966 ], 00:04:07.966 "driver_specific": {} 00:04:07.966 } 00:04:07.966 ]' 00:04:07.966 04:10:45 -- rpc/rpc.sh@17 -- # jq length 00:04:07.966 04:10:45 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:07.966 04:10:45 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:07.966 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.966 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.966 [2024-11-28 04:10:45.196326] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:07.967 [2024-11-28 04:10:45.196381] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:07.967 [2024-11-28 04:10:45.196407] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x107ecb0 00:04:07.967 [2024-11-28 04:10:45.196422] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:07.967 [2024-11-28 04:10:45.197926] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:07.967 [2024-11-28 04:10:45.197957] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:07.967 Passthru0 00:04:07.967 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.967 04:10:45 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:07.967 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.967 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.967 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.967 04:10:45 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:07.967 { 00:04:07.967 "name": "Malloc0", 00:04:07.967 "aliases": [ 00:04:07.967 "b8aaa265-21b5-4836-9d12-b32d868d971e" 00:04:07.967 ], 00:04:07.967 "product_name": "Malloc disk", 00:04:07.967 "block_size": 512, 00:04:07.967 "num_blocks": 16384, 00:04:07.967 "uuid": "b8aaa265-21b5-4836-9d12-b32d868d971e", 00:04:07.967 "assigned_rate_limits": { 00:04:07.967 "rw_ios_per_sec": 0, 00:04:07.967 "rw_mbytes_per_sec": 0, 00:04:07.967 "r_mbytes_per_sec": 0, 00:04:07.967 "w_mbytes_per_sec": 0 00:04:07.967 }, 00:04:07.967 "claimed": true, 00:04:07.967 "claim_type": "exclusive_write", 00:04:07.967 "zoned": false, 00:04:07.967 "supported_io_types": { 00:04:07.967 "read": true, 00:04:07.967 "write": true, 00:04:07.967 "unmap": true, 00:04:07.967 "write_zeroes": true, 00:04:07.967 "flush": true, 00:04:07.967 "reset": true, 00:04:07.967 "compare": false, 00:04:07.967 "compare_and_write": false, 00:04:07.967 "abort": true, 00:04:07.967 "nvme_admin": false, 00:04:07.967 "nvme_io": false 00:04:07.967 }, 00:04:07.967 "memory_domains": [ 00:04:07.967 { 00:04:07.967 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.967 "dma_device_type": 2 00:04:07.967 } 00:04:07.967 ], 00:04:07.967 "driver_specific": {} 00:04:07.967 }, 00:04:07.967 { 00:04:07.967 "name": "Passthru0", 00:04:07.967 "aliases": [ 00:04:07.967 "e9b59f0c-216f-593f-969f-31e1d1dd18c8" 00:04:07.967 ], 00:04:07.967 "product_name": "passthru", 00:04:07.967 "block_size": 512, 00:04:07.967 "num_blocks": 16384, 00:04:07.967 "uuid": "e9b59f0c-216f-593f-969f-31e1d1dd18c8", 00:04:07.967 "assigned_rate_limits": { 00:04:07.967 "rw_ios_per_sec": 0, 00:04:07.967 "rw_mbytes_per_sec": 0, 00:04:07.967 "r_mbytes_per_sec": 0, 00:04:07.967 "w_mbytes_per_sec": 0 00:04:07.967 }, 00:04:07.967 "claimed": false, 00:04:07.967 "zoned": false, 00:04:07.967 "supported_io_types": { 00:04:07.967 "read": true, 00:04:07.967 "write": true, 00:04:07.967 "unmap": true, 00:04:07.967 "write_zeroes": true, 00:04:07.967 "flush": true, 00:04:07.967 "reset": true, 00:04:07.967 "compare": false, 00:04:07.967 "compare_and_write": false, 00:04:07.967 "abort": true, 00:04:07.967 "nvme_admin": false, 00:04:07.967 "nvme_io": false 00:04:07.967 }, 00:04:07.967 "memory_domains": [ 00:04:07.967 { 00:04:07.967 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:07.967 "dma_device_type": 2 00:04:07.967 } 00:04:07.967 ], 00:04:07.967 "driver_specific": { 00:04:07.967 "passthru": { 00:04:07.967 "name": "Passthru0", 00:04:07.967 "base_bdev_name": "Malloc0" 00:04:07.967 } 00:04:07.967 } 00:04:07.967 } 00:04:07.967 ]' 00:04:07.967 04:10:45 -- rpc/rpc.sh@21 -- # jq length 00:04:07.967 04:10:45 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:07.967 04:10:45 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:07.967 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.967 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.967 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.967 04:10:45 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:07.967 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.967 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.967 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.967 04:10:45 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:07.967 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:07.967 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:07.967 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:07.967 04:10:45 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:07.967 04:10:45 -- rpc/rpc.sh@26 -- # jq length 00:04:08.224 04:10:45 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:08.224 00:04:08.224 real 0m0.223s 00:04:08.224 user 0m0.145s 00:04:08.224 sys 0m0.024s 00:04:08.224 04:10:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.224 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.224 ************************************ 00:04:08.224 END TEST rpc_integrity 00:04:08.224 ************************************ 00:04:08.224 04:10:45 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:08.224 04:10:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.224 04:10:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.224 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.224 ************************************ 00:04:08.224 START TEST rpc_plugins 00:04:08.224 ************************************ 00:04:08.224 04:10:45 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:08.224 04:10:45 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:08.224 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.224 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.224 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.224 04:10:45 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:08.224 04:10:45 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:08.224 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.224 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.224 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.224 04:10:45 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:08.224 { 00:04:08.224 "name": "Malloc1", 00:04:08.224 "aliases": [ 00:04:08.224 "13bcd81e-c674-442b-b90d-c6549e77af2c" 00:04:08.224 ], 00:04:08.224 "product_name": "Malloc disk", 00:04:08.224 "block_size": 4096, 00:04:08.224 "num_blocks": 256, 00:04:08.224 "uuid": "13bcd81e-c674-442b-b90d-c6549e77af2c", 00:04:08.224 "assigned_rate_limits": { 00:04:08.224 "rw_ios_per_sec": 0, 00:04:08.224 "rw_mbytes_per_sec": 0, 00:04:08.224 "r_mbytes_per_sec": 0, 00:04:08.224 "w_mbytes_per_sec": 0 00:04:08.224 }, 00:04:08.224 "claimed": false, 00:04:08.224 "zoned": false, 00:04:08.224 "supported_io_types": { 00:04:08.224 "read": true, 00:04:08.224 "write": true, 00:04:08.224 "unmap": true, 00:04:08.224 "write_zeroes": true, 00:04:08.224 "flush": true, 00:04:08.224 "reset": true, 00:04:08.224 "compare": false, 00:04:08.224 "compare_and_write": false, 00:04:08.224 "abort": true, 00:04:08.224 "nvme_admin": false, 00:04:08.224 "nvme_io": false 00:04:08.224 }, 00:04:08.224 "memory_domains": [ 00:04:08.224 { 00:04:08.224 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.224 "dma_device_type": 2 00:04:08.224 } 00:04:08.224 ], 00:04:08.224 "driver_specific": {} 00:04:08.224 } 00:04:08.224 ]' 00:04:08.224 04:10:45 -- rpc/rpc.sh@32 -- # jq length 00:04:08.224 04:10:45 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:08.224 04:10:45 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:08.224 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.224 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.224 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.224 04:10:45 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:08.224 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.224 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.224 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.224 04:10:45 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:08.224 04:10:45 -- rpc/rpc.sh@36 -- # jq length 00:04:08.224 04:10:45 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:08.224 00:04:08.224 real 0m0.111s 00:04:08.224 user 0m0.078s 00:04:08.224 sys 0m0.006s 00:04:08.224 04:10:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.224 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.224 ************************************ 00:04:08.225 END TEST rpc_plugins 00:04:08.225 ************************************ 00:04:08.225 04:10:45 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:08.225 04:10:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.225 04:10:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.225 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.225 ************************************ 00:04:08.225 START TEST rpc_trace_cmd_test 00:04:08.225 ************************************ 00:04:08.225 04:10:45 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:08.225 04:10:45 -- rpc/rpc.sh@40 -- # local info 00:04:08.225 04:10:45 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:08.225 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.225 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.225 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.225 04:10:45 -- rpc/rpc.sh@42 -- # info='{ 00:04:08.225 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3770324", 00:04:08.225 "tpoint_group_mask": "0x8", 00:04:08.225 "iscsi_conn": { 00:04:08.225 "mask": "0x2", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "scsi": { 00:04:08.225 "mask": "0x4", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "bdev": { 00:04:08.225 "mask": "0x8", 00:04:08.225 "tpoint_mask": "0xffffffffffffffff" 00:04:08.225 }, 00:04:08.225 "nvmf_rdma": { 00:04:08.225 "mask": "0x10", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "nvmf_tcp": { 00:04:08.225 "mask": "0x20", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "ftl": { 00:04:08.225 "mask": "0x40", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "blobfs": { 00:04:08.225 "mask": "0x80", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "dsa": { 00:04:08.225 "mask": "0x200", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "thread": { 00:04:08.225 "mask": "0x400", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "nvme_pcie": { 00:04:08.225 "mask": "0x800", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "iaa": { 00:04:08.225 "mask": "0x1000", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "nvme_tcp": { 00:04:08.225 "mask": "0x2000", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 }, 00:04:08.225 "bdev_nvme": { 00:04:08.225 "mask": "0x4000", 00:04:08.225 "tpoint_mask": "0x0" 00:04:08.225 } 00:04:08.225 }' 00:04:08.225 04:10:45 -- rpc/rpc.sh@43 -- # jq length 00:04:08.225 04:10:45 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:08.225 04:10:45 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:08.483 04:10:45 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:08.483 04:10:45 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:08.483 04:10:45 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:08.483 04:10:45 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:08.483 04:10:45 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:08.483 04:10:45 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:08.483 04:10:45 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:08.483 00:04:08.483 real 0m0.189s 00:04:08.483 user 0m0.173s 00:04:08.483 sys 0m0.010s 00:04:08.483 04:10:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.483 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.483 ************************************ 00:04:08.483 END TEST rpc_trace_cmd_test 00:04:08.483 ************************************ 00:04:08.483 04:10:45 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:08.483 04:10:45 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:08.483 04:10:45 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:08.483 04:10:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.483 04:10:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.483 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.483 ************************************ 00:04:08.483 START TEST rpc_daemon_integrity 00:04:08.483 ************************************ 00:04:08.483 04:10:45 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:08.483 04:10:45 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:08.483 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.483 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.483 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.483 04:10:45 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:08.483 04:10:45 -- rpc/rpc.sh@13 -- # jq length 00:04:08.483 04:10:45 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:08.483 04:10:45 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:08.483 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.483 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.483 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.483 04:10:45 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:08.483 04:10:45 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:08.483 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.483 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.483 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.483 04:10:45 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:08.483 { 00:04:08.483 "name": "Malloc2", 00:04:08.483 "aliases": [ 00:04:08.483 "95244206-620f-4b48-821e-49e12d2cc4f6" 00:04:08.483 ], 00:04:08.483 "product_name": "Malloc disk", 00:04:08.483 "block_size": 512, 00:04:08.483 "num_blocks": 16384, 00:04:08.483 "uuid": "95244206-620f-4b48-821e-49e12d2cc4f6", 00:04:08.483 "assigned_rate_limits": { 00:04:08.483 "rw_ios_per_sec": 0, 00:04:08.483 "rw_mbytes_per_sec": 0, 00:04:08.483 "r_mbytes_per_sec": 0, 00:04:08.483 "w_mbytes_per_sec": 0 00:04:08.483 }, 00:04:08.483 "claimed": false, 00:04:08.483 "zoned": false, 00:04:08.483 "supported_io_types": { 00:04:08.483 "read": true, 00:04:08.483 "write": true, 00:04:08.483 "unmap": true, 00:04:08.483 "write_zeroes": true, 00:04:08.483 "flush": true, 00:04:08.483 "reset": true, 00:04:08.483 "compare": false, 00:04:08.483 "compare_and_write": false, 00:04:08.483 "abort": true, 00:04:08.483 "nvme_admin": false, 00:04:08.483 "nvme_io": false 00:04:08.483 }, 00:04:08.483 "memory_domains": [ 00:04:08.483 { 00:04:08.484 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.484 "dma_device_type": 2 00:04:08.484 } 00:04:08.484 ], 00:04:08.484 "driver_specific": {} 00:04:08.484 } 00:04:08.484 ]' 00:04:08.484 04:10:45 -- rpc/rpc.sh@17 -- # jq length 00:04:08.741 04:10:45 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:08.741 04:10:45 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:08.741 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.741 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.741 [2024-11-28 04:10:45.798730] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:08.741 [2024-11-28 04:10:45.798775] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:08.741 [2024-11-28 04:10:45.798797] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1080590 00:04:08.741 [2024-11-28 04:10:45.798828] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:08.741 [2024-11-28 04:10:45.800200] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:08.741 [2024-11-28 04:10:45.800230] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:08.741 Passthru0 00:04:08.741 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.741 04:10:45 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:08.741 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.741 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.741 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.741 04:10:45 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:08.741 { 00:04:08.741 "name": "Malloc2", 00:04:08.741 "aliases": [ 00:04:08.741 "95244206-620f-4b48-821e-49e12d2cc4f6" 00:04:08.741 ], 00:04:08.741 "product_name": "Malloc disk", 00:04:08.741 "block_size": 512, 00:04:08.741 "num_blocks": 16384, 00:04:08.741 "uuid": "95244206-620f-4b48-821e-49e12d2cc4f6", 00:04:08.741 "assigned_rate_limits": { 00:04:08.741 "rw_ios_per_sec": 0, 00:04:08.741 "rw_mbytes_per_sec": 0, 00:04:08.741 "r_mbytes_per_sec": 0, 00:04:08.741 "w_mbytes_per_sec": 0 00:04:08.741 }, 00:04:08.741 "claimed": true, 00:04:08.741 "claim_type": "exclusive_write", 00:04:08.741 "zoned": false, 00:04:08.741 "supported_io_types": { 00:04:08.741 "read": true, 00:04:08.741 "write": true, 00:04:08.741 "unmap": true, 00:04:08.741 "write_zeroes": true, 00:04:08.741 "flush": true, 00:04:08.742 "reset": true, 00:04:08.742 "compare": false, 00:04:08.742 "compare_and_write": false, 00:04:08.742 "abort": true, 00:04:08.742 "nvme_admin": false, 00:04:08.742 "nvme_io": false 00:04:08.742 }, 00:04:08.742 "memory_domains": [ 00:04:08.742 { 00:04:08.742 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.742 "dma_device_type": 2 00:04:08.742 } 00:04:08.742 ], 00:04:08.742 "driver_specific": {} 00:04:08.742 }, 00:04:08.742 { 00:04:08.742 "name": "Passthru0", 00:04:08.742 "aliases": [ 00:04:08.742 "4f01f3f4-7e51-5e83-bc67-2e1f1762f22c" 00:04:08.742 ], 00:04:08.742 "product_name": "passthru", 00:04:08.742 "block_size": 512, 00:04:08.742 "num_blocks": 16384, 00:04:08.742 "uuid": "4f01f3f4-7e51-5e83-bc67-2e1f1762f22c", 00:04:08.742 "assigned_rate_limits": { 00:04:08.742 "rw_ios_per_sec": 0, 00:04:08.742 "rw_mbytes_per_sec": 0, 00:04:08.742 "r_mbytes_per_sec": 0, 00:04:08.742 "w_mbytes_per_sec": 0 00:04:08.742 }, 00:04:08.742 "claimed": false, 00:04:08.742 "zoned": false, 00:04:08.742 "supported_io_types": { 00:04:08.742 "read": true, 00:04:08.742 "write": true, 00:04:08.742 "unmap": true, 00:04:08.742 "write_zeroes": true, 00:04:08.742 "flush": true, 00:04:08.742 "reset": true, 00:04:08.742 "compare": false, 00:04:08.742 "compare_and_write": false, 00:04:08.742 "abort": true, 00:04:08.742 "nvme_admin": false, 00:04:08.742 "nvme_io": false 00:04:08.742 }, 00:04:08.742 "memory_domains": [ 00:04:08.742 { 00:04:08.742 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.742 "dma_device_type": 2 00:04:08.742 } 00:04:08.742 ], 00:04:08.742 "driver_specific": { 00:04:08.742 "passthru": { 00:04:08.742 "name": "Passthru0", 00:04:08.742 "base_bdev_name": "Malloc2" 00:04:08.742 } 00:04:08.742 } 00:04:08.742 } 00:04:08.742 ]' 00:04:08.742 04:10:45 -- rpc/rpc.sh@21 -- # jq length 00:04:08.742 04:10:45 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:08.742 04:10:45 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:08.742 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.742 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.742 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.742 04:10:45 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:08.742 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.742 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.742 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.742 04:10:45 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:08.742 04:10:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.742 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.742 04:10:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.742 04:10:45 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:08.742 04:10:45 -- rpc/rpc.sh@26 -- # jq length 00:04:08.742 04:10:45 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:08.742 00:04:08.742 real 0m0.225s 00:04:08.742 user 0m0.145s 00:04:08.742 sys 0m0.025s 00:04:08.742 04:10:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.742 04:10:45 -- common/autotest_common.sh@10 -- # set +x 00:04:08.742 ************************************ 00:04:08.742 END TEST rpc_daemon_integrity 00:04:08.742 ************************************ 00:04:08.742 04:10:45 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:08.742 04:10:45 -- rpc/rpc.sh@84 -- # killprocess 3770324 00:04:08.742 04:10:45 -- common/autotest_common.sh@936 -- # '[' -z 3770324 ']' 00:04:08.742 04:10:45 -- common/autotest_common.sh@940 -- # kill -0 3770324 00:04:08.742 04:10:45 -- common/autotest_common.sh@941 -- # uname 00:04:08.742 04:10:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:08.742 04:10:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3770324 00:04:08.742 04:10:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:08.742 04:10:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:08.742 04:10:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3770324' 00:04:08.742 killing process with pid 3770324 00:04:08.742 04:10:45 -- common/autotest_common.sh@955 -- # kill 3770324 00:04:08.742 04:10:45 -- common/autotest_common.sh@960 -- # wait 3770324 00:04:09.308 00:04:09.308 real 0m2.490s 00:04:09.308 user 0m3.147s 00:04:09.308 sys 0m0.574s 00:04:09.308 04:10:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.308 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:04:09.308 ************************************ 00:04:09.308 END TEST rpc 00:04:09.308 ************************************ 00:04:09.308 04:10:46 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:09.308 04:10:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.308 04:10:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.308 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:04:09.308 ************************************ 00:04:09.308 START TEST rpc_client 00:04:09.308 ************************************ 00:04:09.308 04:10:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:09.308 * Looking for test storage... 00:04:09.308 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:09.308 04:10:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:09.308 04:10:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:09.308 04:10:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:09.308 04:10:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:09.308 04:10:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:09.308 04:10:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:09.308 04:10:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:09.308 04:10:46 -- scripts/common.sh@335 -- # IFS=.-: 00:04:09.308 04:10:46 -- scripts/common.sh@335 -- # read -ra ver1 00:04:09.308 04:10:46 -- scripts/common.sh@336 -- # IFS=.-: 00:04:09.308 04:10:46 -- scripts/common.sh@336 -- # read -ra ver2 00:04:09.308 04:10:46 -- scripts/common.sh@337 -- # local 'op=<' 00:04:09.308 04:10:46 -- scripts/common.sh@339 -- # ver1_l=2 00:04:09.308 04:10:46 -- scripts/common.sh@340 -- # ver2_l=1 00:04:09.308 04:10:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:09.308 04:10:46 -- scripts/common.sh@343 -- # case "$op" in 00:04:09.308 04:10:46 -- scripts/common.sh@344 -- # : 1 00:04:09.308 04:10:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:09.308 04:10:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:09.308 04:10:46 -- scripts/common.sh@364 -- # decimal 1 00:04:09.308 04:10:46 -- scripts/common.sh@352 -- # local d=1 00:04:09.308 04:10:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:09.308 04:10:46 -- scripts/common.sh@354 -- # echo 1 00:04:09.308 04:10:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:09.569 04:10:46 -- scripts/common.sh@365 -- # decimal 2 00:04:09.569 04:10:46 -- scripts/common.sh@352 -- # local d=2 00:04:09.569 04:10:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:09.569 04:10:46 -- scripts/common.sh@354 -- # echo 2 00:04:09.569 04:10:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:09.569 04:10:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:09.569 04:10:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:09.569 04:10:46 -- scripts/common.sh@367 -- # return 0 00:04:09.569 04:10:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:09.569 OK 00:04:09.569 04:10:46 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:09.569 00:04:09.569 real 0m0.159s 00:04:09.569 user 0m0.097s 00:04:09.569 sys 0m0.070s 00:04:09.569 04:10:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.569 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:04:09.569 ************************************ 00:04:09.569 END TEST rpc_client 00:04:09.569 ************************************ 00:04:09.569 04:10:46 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:09.569 04:10:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.569 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:04:09.569 ************************************ 00:04:09.569 START TEST json_config 00:04:09.569 ************************************ 00:04:09.569 04:10:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:09.569 04:10:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:09.569 04:10:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:09.569 04:10:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:09.569 04:10:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:09.569 04:10:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:09.569 04:10:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:09.569 04:10:46 -- scripts/common.sh@335 -- # IFS=.-: 00:04:09.569 04:10:46 -- scripts/common.sh@335 -- # read -ra ver1 00:04:09.569 04:10:46 -- scripts/common.sh@336 -- # IFS=.-: 00:04:09.569 04:10:46 -- scripts/common.sh@336 -- # read -ra ver2 00:04:09.569 04:10:46 -- scripts/common.sh@337 -- # local 'op=<' 00:04:09.569 04:10:46 -- scripts/common.sh@339 -- # ver1_l=2 00:04:09.569 04:10:46 -- scripts/common.sh@340 -- # ver2_l=1 00:04:09.569 04:10:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:09.569 04:10:46 -- scripts/common.sh@343 -- # case "$op" in 00:04:09.569 04:10:46 -- scripts/common.sh@344 -- # : 1 00:04:09.569 04:10:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:09.569 04:10:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:09.569 04:10:46 -- scripts/common.sh@364 -- # decimal 1 00:04:09.569 04:10:46 -- scripts/common.sh@352 -- # local d=1 00:04:09.569 04:10:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:09.569 04:10:46 -- scripts/common.sh@354 -- # echo 1 00:04:09.569 04:10:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:09.569 04:10:46 -- scripts/common.sh@365 -- # decimal 2 00:04:09.569 04:10:46 -- scripts/common.sh@352 -- # local d=2 00:04:09.569 04:10:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:09.569 04:10:46 -- scripts/common.sh@354 -- # echo 2 00:04:09.569 04:10:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:09.569 04:10:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:09.569 04:10:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:09.569 04:10:46 -- scripts/common.sh@367 -- # return 0 00:04:09.569 04:10:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:09.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.569 --rc genhtml_branch_coverage=1 00:04:09.569 --rc genhtml_function_coverage=1 00:04:09.569 --rc genhtml_legend=1 00:04:09.569 --rc geninfo_all_blocks=1 00:04:09.569 --rc geninfo_unexecuted_blocks=1 00:04:09.569 00:04:09.569 ' 00:04:09.569 04:10:46 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:09.569 04:10:46 -- nvmf/common.sh@7 -- # uname -s 00:04:09.569 04:10:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:09.569 04:10:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:09.569 04:10:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:09.569 04:10:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:09.569 04:10:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:09.570 04:10:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:09.570 04:10:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:09.570 04:10:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:09.570 04:10:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:09.570 04:10:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:09.570 04:10:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:09.570 04:10:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:09.570 04:10:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:09.570 04:10:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:09.570 04:10:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:09.570 04:10:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:09.570 04:10:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:09.570 04:10:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:09.570 04:10:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:09.570 04:10:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.570 04:10:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.570 04:10:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.570 04:10:46 -- paths/export.sh@5 -- # export PATH 00:04:09.570 04:10:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.570 04:10:46 -- nvmf/common.sh@46 -- # : 0 00:04:09.570 04:10:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:09.570 04:10:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:09.570 04:10:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:09.570 04:10:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:09.570 04:10:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:09.570 04:10:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:09.570 04:10:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:09.570 04:10:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:09.570 04:10:46 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:09.570 04:10:46 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:09.570 04:10:46 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:09.570 04:10:46 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:09.570 04:10:46 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:09.570 04:10:46 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:09.570 04:10:46 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:09.570 04:10:46 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:09.570 04:10:46 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:09.570 04:10:46 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:09.570 04:10:46 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:09.570 04:10:46 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:09.570 04:10:46 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:09.570 04:10:46 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:09.570 04:10:46 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:09.570 INFO: JSON configuration test init 00:04:09.570 04:10:46 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:09.570 04:10:46 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:09.570 04:10:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:09.570 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:04:09.570 04:10:46 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:09.570 04:10:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:09.570 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:04:09.570 04:10:46 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:09.570 04:10:46 -- json_config/json_config.sh@98 -- # local app=target 00:04:09.570 04:10:46 -- json_config/json_config.sh@99 -- # shift 00:04:09.570 04:10:46 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:09.570 04:10:46 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:09.570 04:10:46 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:09.570 04:10:46 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:09.570 04:10:46 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:09.570 04:10:46 -- json_config/json_config.sh@111 -- # app_pid[$app]=3770854 00:04:09.570 04:10:46 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:09.570 04:10:46 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:09.570 Waiting for target to run... 00:04:09.570 04:10:46 -- json_config/json_config.sh@114 -- # waitforlisten 3770854 /var/tmp/spdk_tgt.sock 00:04:09.570 04:10:46 -- common/autotest_common.sh@829 -- # '[' -z 3770854 ']' 00:04:09.570 04:10:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:09.570 04:10:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:09.570 04:10:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:09.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:09.570 04:10:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:09.570 04:10:46 -- common/autotest_common.sh@10 -- # set +x 00:04:09.570 [2024-11-28 04:10:46.857923] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:09.570 [2024-11-28 04:10:46.858017] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3770854 ] 00:04:09.830 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.088 [2024-11-28 04:10:47.356965] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:10.346 [2024-11-28 04:10:47.461840] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:10.346 [2024-11-28 04:10:47.462015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:10.604 04:10:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:10.604 04:10:47 -- common/autotest_common.sh@862 -- # return 0 00:04:10.604 04:10:47 -- json_config/json_config.sh@115 -- # echo '' 00:04:10.604 00:04:10.604 04:10:47 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:10.604 04:10:47 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:10.604 04:10:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:10.604 04:10:47 -- common/autotest_common.sh@10 -- # set +x 00:04:10.604 04:10:47 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:10.604 04:10:47 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:10.604 04:10:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:10.604 04:10:47 -- common/autotest_common.sh@10 -- # set +x 00:04:10.604 04:10:47 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:10.604 04:10:47 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:10.604 04:10:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:13.889 04:10:51 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:13.889 04:10:51 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:13.889 04:10:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:13.889 04:10:51 -- common/autotest_common.sh@10 -- # set +x 00:04:13.889 04:10:51 -- json_config/json_config.sh@48 -- # local ret=0 00:04:13.889 04:10:51 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:13.889 04:10:51 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:13.889 04:10:51 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:13.889 04:10:51 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:13.889 04:10:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:14.147 04:10:51 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:14.147 04:10:51 -- json_config/json_config.sh@51 -- # local get_types 00:04:14.147 04:10:51 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:14.147 04:10:51 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:14.147 04:10:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:14.147 04:10:51 -- common/autotest_common.sh@10 -- # set +x 00:04:14.147 04:10:51 -- json_config/json_config.sh@58 -- # return 0 00:04:14.147 04:10:51 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:14.147 04:10:51 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:14.147 04:10:51 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:14.147 04:10:51 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:14.147 04:10:51 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:14.147 04:10:51 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:14.147 04:10:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:14.147 04:10:51 -- common/autotest_common.sh@10 -- # set +x 00:04:14.147 04:10:51 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:14.147 04:10:51 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:14.147 04:10:51 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:14.147 04:10:51 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:14.147 04:10:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:14.405 MallocForNvmf0 00:04:14.405 04:10:51 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:14.405 04:10:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:14.664 MallocForNvmf1 00:04:14.664 04:10:51 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:14.664 04:10:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:14.922 [2024-11-28 04:10:52.016223] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:14.922 04:10:52 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:14.922 04:10:52 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:15.180 04:10:52 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:15.180 04:10:52 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:15.438 04:10:52 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:15.438 04:10:52 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:15.696 04:10:52 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:15.696 04:10:52 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:15.954 [2024-11-28 04:10:53.019553] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:15.954 04:10:53 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:15.954 04:10:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:15.954 04:10:53 -- common/autotest_common.sh@10 -- # set +x 00:04:15.954 04:10:53 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:15.954 04:10:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:15.954 04:10:53 -- common/autotest_common.sh@10 -- # set +x 00:04:15.954 04:10:53 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:15.954 04:10:53 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:15.954 04:10:53 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:16.212 MallocBdevForConfigChangeCheck 00:04:16.212 04:10:53 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:16.212 04:10:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:16.212 04:10:53 -- common/autotest_common.sh@10 -- # set +x 00:04:16.212 04:10:53 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:16.212 04:10:53 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:16.470 04:10:53 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:16.470 INFO: shutting down applications... 00:04:16.470 04:10:53 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:16.470 04:10:53 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:16.470 04:10:53 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:16.470 04:10:53 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:18.370 Calling clear_iscsi_subsystem 00:04:18.370 Calling clear_nvmf_subsystem 00:04:18.370 Calling clear_nbd_subsystem 00:04:18.370 Calling clear_ublk_subsystem 00:04:18.370 Calling clear_vhost_blk_subsystem 00:04:18.370 Calling clear_vhost_scsi_subsystem 00:04:18.370 Calling clear_scheduler_subsystem 00:04:18.370 Calling clear_bdev_subsystem 00:04:18.370 Calling clear_accel_subsystem 00:04:18.370 Calling clear_vmd_subsystem 00:04:18.370 Calling clear_sock_subsystem 00:04:18.370 Calling clear_iobuf_subsystem 00:04:18.370 04:10:55 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:18.370 04:10:55 -- json_config/json_config.sh@396 -- # count=100 00:04:18.370 04:10:55 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:18.370 04:10:55 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:18.370 04:10:55 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:18.370 04:10:55 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:18.628 04:10:55 -- json_config/json_config.sh@398 -- # break 00:04:18.628 04:10:55 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:18.628 04:10:55 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:18.629 04:10:55 -- json_config/json_config.sh@120 -- # local app=target 00:04:18.629 04:10:55 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:18.629 04:10:55 -- json_config/json_config.sh@124 -- # [[ -n 3770854 ]] 00:04:18.629 04:10:55 -- json_config/json_config.sh@127 -- # kill -SIGINT 3770854 00:04:18.629 04:10:55 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:18.629 04:10:55 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:18.629 04:10:55 -- json_config/json_config.sh@130 -- # kill -0 3770854 00:04:18.629 04:10:55 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:19.196 04:10:56 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:19.196 04:10:56 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:19.196 04:10:56 -- json_config/json_config.sh@130 -- # kill -0 3770854 00:04:19.196 04:10:56 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:19.196 04:10:56 -- json_config/json_config.sh@132 -- # break 00:04:19.196 04:10:56 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:19.196 04:10:56 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:19.196 SPDK target shutdown done 00:04:19.196 04:10:56 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:19.196 INFO: relaunching applications... 00:04:19.196 04:10:56 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.196 04:10:56 -- json_config/json_config.sh@98 -- # local app=target 00:04:19.196 04:10:56 -- json_config/json_config.sh@99 -- # shift 00:04:19.196 04:10:56 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:19.196 04:10:56 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:19.196 04:10:56 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:19.196 04:10:56 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:19.196 04:10:56 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:19.196 04:10:56 -- json_config/json_config.sh@111 -- # app_pid[$app]=3772170 00:04:19.196 04:10:56 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.196 04:10:56 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:19.196 Waiting for target to run... 00:04:19.196 04:10:56 -- json_config/json_config.sh@114 -- # waitforlisten 3772170 /var/tmp/spdk_tgt.sock 00:04:19.196 04:10:56 -- common/autotest_common.sh@829 -- # '[' -z 3772170 ']' 00:04:19.196 04:10:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:19.196 04:10:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:19.196 04:10:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:19.196 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:19.196 04:10:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:19.196 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:04:19.196 [2024-11-28 04:10:56.268952] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:19.196 [2024-11-28 04:10:56.269059] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3772170 ] 00:04:19.196 EAL: No free 2048 kB hugepages reported on node 1 00:04:19.763 [2024-11-28 04:10:56.788867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:19.763 [2024-11-28 04:10:56.891501] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:19.763 [2024-11-28 04:10:56.891706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.047 [2024-11-28 04:10:59.931292] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:23.047 [2024-11-28 04:10:59.963786] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:23.047 04:11:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:23.047 04:11:00 -- common/autotest_common.sh@862 -- # return 0 00:04:23.047 04:11:00 -- json_config/json_config.sh@115 -- # echo '' 00:04:23.047 00:04:23.047 04:11:00 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:23.047 04:11:00 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:23.047 INFO: Checking if target configuration is the same... 00:04:23.047 04:11:00 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.047 04:11:00 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:23.047 04:11:00 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:23.047 + '[' 2 -ne 2 ']' 00:04:23.047 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:23.047 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:23.047 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:23.047 +++ basename /dev/fd/62 00:04:23.047 ++ mktemp /tmp/62.XXX 00:04:23.047 + tmp_file_1=/tmp/62.YDI 00:04:23.047 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.047 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:23.047 + tmp_file_2=/tmp/spdk_tgt_config.json.XUg 00:04:23.047 + ret=0 00:04:23.047 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:23.305 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:23.563 + diff -u /tmp/62.YDI /tmp/spdk_tgt_config.json.XUg 00:04:23.563 + echo 'INFO: JSON config files are the same' 00:04:23.563 INFO: JSON config files are the same 00:04:23.563 + rm /tmp/62.YDI /tmp/spdk_tgt_config.json.XUg 00:04:23.563 + exit 0 00:04:23.563 04:11:00 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:23.563 04:11:00 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:23.563 INFO: changing configuration and checking if this can be detected... 00:04:23.563 04:11:00 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:23.563 04:11:00 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:23.821 04:11:00 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.821 04:11:00 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:23.821 04:11:00 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:23.821 + '[' 2 -ne 2 ']' 00:04:23.821 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:23.821 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:23.821 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:23.821 +++ basename /dev/fd/62 00:04:23.821 ++ mktemp /tmp/62.XXX 00:04:23.821 + tmp_file_1=/tmp/62.1bA 00:04:23.821 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.821 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:23.821 + tmp_file_2=/tmp/spdk_tgt_config.json.7Sl 00:04:23.821 + ret=0 00:04:23.821 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:24.080 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:24.080 + diff -u /tmp/62.1bA /tmp/spdk_tgt_config.json.7Sl 00:04:24.080 + ret=1 00:04:24.080 + echo '=== Start of file: /tmp/62.1bA ===' 00:04:24.080 + cat /tmp/62.1bA 00:04:24.080 + echo '=== End of file: /tmp/62.1bA ===' 00:04:24.080 + echo '' 00:04:24.080 + echo '=== Start of file: /tmp/spdk_tgt_config.json.7Sl ===' 00:04:24.080 + cat /tmp/spdk_tgt_config.json.7Sl 00:04:24.080 + echo '=== End of file: /tmp/spdk_tgt_config.json.7Sl ===' 00:04:24.080 + echo '' 00:04:24.080 + rm /tmp/62.1bA /tmp/spdk_tgt_config.json.7Sl 00:04:24.080 + exit 1 00:04:24.080 04:11:01 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:24.080 INFO: configuration change detected. 00:04:24.080 04:11:01 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:24.080 04:11:01 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:24.080 04:11:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:24.080 04:11:01 -- common/autotest_common.sh@10 -- # set +x 00:04:24.080 04:11:01 -- json_config/json_config.sh@360 -- # local ret=0 00:04:24.080 04:11:01 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:24.080 04:11:01 -- json_config/json_config.sh@370 -- # [[ -n 3772170 ]] 00:04:24.080 04:11:01 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:24.080 04:11:01 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:24.080 04:11:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:24.080 04:11:01 -- common/autotest_common.sh@10 -- # set +x 00:04:24.080 04:11:01 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:24.080 04:11:01 -- json_config/json_config.sh@246 -- # uname -s 00:04:24.080 04:11:01 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:24.080 04:11:01 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:24.080 04:11:01 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:24.080 04:11:01 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:24.080 04:11:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.080 04:11:01 -- common/autotest_common.sh@10 -- # set +x 00:04:24.080 04:11:01 -- json_config/json_config.sh@376 -- # killprocess 3772170 00:04:24.080 04:11:01 -- common/autotest_common.sh@936 -- # '[' -z 3772170 ']' 00:04:24.080 04:11:01 -- common/autotest_common.sh@940 -- # kill -0 3772170 00:04:24.080 04:11:01 -- common/autotest_common.sh@941 -- # uname 00:04:24.080 04:11:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:24.080 04:11:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3772170 00:04:24.080 04:11:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:24.080 04:11:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:24.080 04:11:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3772170' 00:04:24.080 killing process with pid 3772170 00:04:24.080 04:11:01 -- common/autotest_common.sh@955 -- # kill 3772170 00:04:24.080 04:11:01 -- common/autotest_common.sh@960 -- # wait 3772170 00:04:25.981 04:11:03 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:25.981 04:11:03 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:25.981 04:11:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:25.981 04:11:03 -- common/autotest_common.sh@10 -- # set +x 00:04:25.981 04:11:03 -- json_config/json_config.sh@381 -- # return 0 00:04:25.981 04:11:03 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:25.981 INFO: Success 00:04:25.981 00:04:25.981 real 0m16.449s 00:04:25.981 user 0m18.878s 00:04:25.981 sys 0m2.239s 00:04:25.981 04:11:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:25.981 04:11:03 -- common/autotest_common.sh@10 -- # set +x 00:04:25.981 ************************************ 00:04:25.981 END TEST json_config 00:04:25.981 ************************************ 00:04:25.981 04:11:03 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:25.981 04:11:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.981 04:11:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.981 04:11:03 -- common/autotest_common.sh@10 -- # set +x 00:04:25.981 ************************************ 00:04:25.981 START TEST json_config_extra_key 00:04:25.981 ************************************ 00:04:25.981 04:11:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:25.981 04:11:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:25.981 04:11:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:25.981 04:11:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:25.981 04:11:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:25.981 04:11:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:25.981 04:11:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:25.981 04:11:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:25.981 04:11:03 -- scripts/common.sh@335 -- # IFS=.-: 00:04:25.981 04:11:03 -- scripts/common.sh@335 -- # read -ra ver1 00:04:25.981 04:11:03 -- scripts/common.sh@336 -- # IFS=.-: 00:04:25.981 04:11:03 -- scripts/common.sh@336 -- # read -ra ver2 00:04:25.981 04:11:03 -- scripts/common.sh@337 -- # local 'op=<' 00:04:25.981 04:11:03 -- scripts/common.sh@339 -- # ver1_l=2 00:04:25.981 04:11:03 -- scripts/common.sh@340 -- # ver2_l=1 00:04:25.981 04:11:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:25.981 04:11:03 -- scripts/common.sh@343 -- # case "$op" in 00:04:25.981 04:11:03 -- scripts/common.sh@344 -- # : 1 00:04:25.981 04:11:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:25.981 04:11:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:25.981 04:11:03 -- scripts/common.sh@364 -- # decimal 1 00:04:25.981 04:11:03 -- scripts/common.sh@352 -- # local d=1 00:04:25.981 04:11:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:25.981 04:11:03 -- scripts/common.sh@354 -- # echo 1 00:04:25.981 04:11:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:25.981 04:11:03 -- scripts/common.sh@365 -- # decimal 2 00:04:25.981 04:11:03 -- scripts/common.sh@352 -- # local d=2 00:04:25.981 04:11:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:25.981 04:11:03 -- scripts/common.sh@354 -- # echo 2 00:04:25.981 04:11:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:25.981 04:11:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:25.981 04:11:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:25.981 04:11:03 -- scripts/common.sh@367 -- # return 0 00:04:25.981 04:11:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:25.981 04:11:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:25.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.981 --rc genhtml_branch_coverage=1 00:04:25.981 --rc genhtml_function_coverage=1 00:04:25.981 --rc genhtml_legend=1 00:04:25.981 --rc geninfo_all_blocks=1 00:04:25.981 --rc geninfo_unexecuted_blocks=1 00:04:25.981 00:04:25.981 ' 00:04:25.981 04:11:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:25.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.981 --rc genhtml_branch_coverage=1 00:04:25.981 --rc genhtml_function_coverage=1 00:04:25.981 --rc genhtml_legend=1 00:04:25.981 --rc geninfo_all_blocks=1 00:04:25.981 --rc geninfo_unexecuted_blocks=1 00:04:25.981 00:04:25.981 ' 00:04:25.981 04:11:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:25.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.981 --rc genhtml_branch_coverage=1 00:04:25.981 --rc genhtml_function_coverage=1 00:04:25.981 --rc genhtml_legend=1 00:04:25.981 --rc geninfo_all_blocks=1 00:04:25.981 --rc geninfo_unexecuted_blocks=1 00:04:25.981 00:04:25.981 ' 00:04:25.981 04:11:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:25.981 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.981 --rc genhtml_branch_coverage=1 00:04:25.981 --rc genhtml_function_coverage=1 00:04:25.981 --rc genhtml_legend=1 00:04:25.981 --rc geninfo_all_blocks=1 00:04:25.981 --rc geninfo_unexecuted_blocks=1 00:04:25.981 00:04:25.981 ' 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:25.981 04:11:03 -- nvmf/common.sh@7 -- # uname -s 00:04:25.981 04:11:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:25.981 04:11:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:25.981 04:11:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:25.981 04:11:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:25.981 04:11:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:25.981 04:11:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:25.981 04:11:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:25.981 04:11:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:25.981 04:11:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:25.981 04:11:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:25.981 04:11:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:25.981 04:11:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:25.981 04:11:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:25.981 04:11:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:25.981 04:11:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:25.981 04:11:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:25.981 04:11:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:25.981 04:11:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:25.981 04:11:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:25.981 04:11:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:25.981 04:11:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:25.981 04:11:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:25.981 04:11:03 -- paths/export.sh@5 -- # export PATH 00:04:25.981 04:11:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:25.981 04:11:03 -- nvmf/common.sh@46 -- # : 0 00:04:25.981 04:11:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:25.981 04:11:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:25.981 04:11:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:25.981 04:11:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:25.981 04:11:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:25.981 04:11:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:25.981 04:11:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:25.981 04:11:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:25.981 INFO: launching applications... 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:25.981 04:11:03 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:25.982 04:11:03 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:25.982 04:11:03 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:25.982 04:11:03 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:25.982 04:11:03 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3773120 00:04:25.982 04:11:03 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:25.982 04:11:03 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:25.982 Waiting for target to run... 00:04:25.982 04:11:03 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3773120 /var/tmp/spdk_tgt.sock 00:04:25.982 04:11:03 -- common/autotest_common.sh@829 -- # '[' -z 3773120 ']' 00:04:25.982 04:11:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:25.982 04:11:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:25.982 04:11:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:25.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:25.982 04:11:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:25.982 04:11:03 -- common/autotest_common.sh@10 -- # set +x 00:04:26.240 [2024-11-28 04:11:03.312773] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:26.240 [2024-11-28 04:11:03.312865] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3773120 ] 00:04:26.240 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.498 [2024-11-28 04:11:03.646469] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.498 [2024-11-28 04:11:03.732948] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.498 [2024-11-28 04:11:03.733138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.102 04:11:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:27.102 04:11:04 -- common/autotest_common.sh@862 -- # return 0 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:27.102 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:27.102 INFO: shutting down applications... 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3773120 ]] 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3773120 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3773120 00:04:27.102 04:11:04 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3773120 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:27.712 SPDK target shutdown done 00:04:27.712 04:11:04 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:27.712 Success 00:04:27.712 00:04:27.713 real 0m1.645s 00:04:27.713 user 0m1.663s 00:04:27.713 sys 0m0.446s 00:04:27.713 04:11:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:27.713 04:11:04 -- common/autotest_common.sh@10 -- # set +x 00:04:27.713 ************************************ 00:04:27.713 END TEST json_config_extra_key 00:04:27.713 ************************************ 00:04:27.713 04:11:04 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:27.713 04:11:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.713 04:11:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.713 04:11:04 -- common/autotest_common.sh@10 -- # set +x 00:04:27.713 ************************************ 00:04:27.713 START TEST alias_rpc 00:04:27.713 ************************************ 00:04:27.713 04:11:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:27.713 * Looking for test storage... 00:04:27.713 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:27.713 04:11:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.713 04:11:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.713 04:11:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.713 04:11:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.713 04:11:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.713 04:11:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.713 04:11:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.713 04:11:04 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.713 04:11:04 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.713 04:11:04 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.713 04:11:04 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.713 04:11:04 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.713 04:11:04 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.713 04:11:04 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.713 04:11:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.713 04:11:04 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.713 04:11:04 -- scripts/common.sh@344 -- # : 1 00:04:27.713 04:11:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.713 04:11:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.713 04:11:04 -- scripts/common.sh@364 -- # decimal 1 00:04:27.713 04:11:04 -- scripts/common.sh@352 -- # local d=1 00:04:27.713 04:11:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.713 04:11:04 -- scripts/common.sh@354 -- # echo 1 00:04:27.713 04:11:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.713 04:11:04 -- scripts/common.sh@365 -- # decimal 2 00:04:27.713 04:11:04 -- scripts/common.sh@352 -- # local d=2 00:04:27.713 04:11:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.713 04:11:04 -- scripts/common.sh@354 -- # echo 2 00:04:27.713 04:11:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.713 04:11:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.713 04:11:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.713 04:11:04 -- scripts/common.sh@367 -- # return 0 00:04:27.713 04:11:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.713 04:11:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.713 --rc genhtml_branch_coverage=1 00:04:27.713 --rc genhtml_function_coverage=1 00:04:27.713 --rc genhtml_legend=1 00:04:27.713 --rc geninfo_all_blocks=1 00:04:27.713 --rc geninfo_unexecuted_blocks=1 00:04:27.713 00:04:27.713 ' 00:04:27.713 04:11:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.713 --rc genhtml_branch_coverage=1 00:04:27.713 --rc genhtml_function_coverage=1 00:04:27.713 --rc genhtml_legend=1 00:04:27.713 --rc geninfo_all_blocks=1 00:04:27.713 --rc geninfo_unexecuted_blocks=1 00:04:27.713 00:04:27.713 ' 00:04:27.713 04:11:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.713 --rc genhtml_branch_coverage=1 00:04:27.713 --rc genhtml_function_coverage=1 00:04:27.713 --rc genhtml_legend=1 00:04:27.713 --rc geninfo_all_blocks=1 00:04:27.713 --rc geninfo_unexecuted_blocks=1 00:04:27.713 00:04:27.713 ' 00:04:27.713 04:11:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.713 --rc genhtml_branch_coverage=1 00:04:27.713 --rc genhtml_function_coverage=1 00:04:27.713 --rc genhtml_legend=1 00:04:27.713 --rc geninfo_all_blocks=1 00:04:27.713 --rc geninfo_unexecuted_blocks=1 00:04:27.713 00:04:27.713 ' 00:04:27.713 04:11:04 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:27.713 04:11:04 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3773444 00:04:27.713 04:11:04 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:27.713 04:11:04 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3773444 00:04:27.713 04:11:04 -- common/autotest_common.sh@829 -- # '[' -z 3773444 ']' 00:04:27.713 04:11:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:27.713 04:11:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:27.713 04:11:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:27.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:27.713 04:11:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:27.713 04:11:04 -- common/autotest_common.sh@10 -- # set +x 00:04:27.713 [2024-11-28 04:11:04.990246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:27.713 [2024-11-28 04:11:04.990344] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3773444 ] 00:04:27.713 EAL: No free 2048 kB hugepages reported on node 1 00:04:27.970 [2024-11-28 04:11:05.046940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:27.970 [2024-11-28 04:11:05.154474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:27.970 [2024-11-28 04:11:05.154666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:28.905 04:11:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:28.905 04:11:05 -- common/autotest_common.sh@862 -- # return 0 00:04:28.905 04:11:05 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:29.164 04:11:06 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3773444 00:04:29.164 04:11:06 -- common/autotest_common.sh@936 -- # '[' -z 3773444 ']' 00:04:29.164 04:11:06 -- common/autotest_common.sh@940 -- # kill -0 3773444 00:04:29.164 04:11:06 -- common/autotest_common.sh@941 -- # uname 00:04:29.164 04:11:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:29.164 04:11:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3773444 00:04:29.164 04:11:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:29.164 04:11:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:29.164 04:11:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3773444' 00:04:29.164 killing process with pid 3773444 00:04:29.164 04:11:06 -- common/autotest_common.sh@955 -- # kill 3773444 00:04:29.164 04:11:06 -- common/autotest_common.sh@960 -- # wait 3773444 00:04:29.422 00:04:29.422 real 0m1.907s 00:04:29.422 user 0m2.188s 00:04:29.422 sys 0m0.475s 00:04:29.422 04:11:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:29.422 04:11:06 -- common/autotest_common.sh@10 -- # set +x 00:04:29.422 ************************************ 00:04:29.422 END TEST alias_rpc 00:04:29.422 ************************************ 00:04:29.681 04:11:06 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:29.681 04:11:06 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:29.681 04:11:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:29.681 04:11:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:29.681 04:11:06 -- common/autotest_common.sh@10 -- # set +x 00:04:29.681 ************************************ 00:04:29.681 START TEST spdkcli_tcp 00:04:29.681 ************************************ 00:04:29.681 04:11:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:29.681 * Looking for test storage... 00:04:29.681 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:29.681 04:11:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:29.681 04:11:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:29.681 04:11:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:29.681 04:11:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:29.681 04:11:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:29.681 04:11:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:29.681 04:11:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:29.681 04:11:06 -- scripts/common.sh@335 -- # IFS=.-: 00:04:29.681 04:11:06 -- scripts/common.sh@335 -- # read -ra ver1 00:04:29.681 04:11:06 -- scripts/common.sh@336 -- # IFS=.-: 00:04:29.681 04:11:06 -- scripts/common.sh@336 -- # read -ra ver2 00:04:29.681 04:11:06 -- scripts/common.sh@337 -- # local 'op=<' 00:04:29.681 04:11:06 -- scripts/common.sh@339 -- # ver1_l=2 00:04:29.681 04:11:06 -- scripts/common.sh@340 -- # ver2_l=1 00:04:29.681 04:11:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:29.681 04:11:06 -- scripts/common.sh@343 -- # case "$op" in 00:04:29.681 04:11:06 -- scripts/common.sh@344 -- # : 1 00:04:29.681 04:11:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:29.681 04:11:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:29.681 04:11:06 -- scripts/common.sh@364 -- # decimal 1 00:04:29.681 04:11:06 -- scripts/common.sh@352 -- # local d=1 00:04:29.681 04:11:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:29.681 04:11:06 -- scripts/common.sh@354 -- # echo 1 00:04:29.681 04:11:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:29.681 04:11:06 -- scripts/common.sh@365 -- # decimal 2 00:04:29.681 04:11:06 -- scripts/common.sh@352 -- # local d=2 00:04:29.681 04:11:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:29.681 04:11:06 -- scripts/common.sh@354 -- # echo 2 00:04:29.681 04:11:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:29.681 04:11:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:29.681 04:11:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:29.681 04:11:06 -- scripts/common.sh@367 -- # return 0 00:04:29.681 04:11:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:29.681 04:11:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:29.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.681 --rc genhtml_branch_coverage=1 00:04:29.681 --rc genhtml_function_coverage=1 00:04:29.681 --rc genhtml_legend=1 00:04:29.681 --rc geninfo_all_blocks=1 00:04:29.681 --rc geninfo_unexecuted_blocks=1 00:04:29.681 00:04:29.681 ' 00:04:29.681 04:11:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:29.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.681 --rc genhtml_branch_coverage=1 00:04:29.681 --rc genhtml_function_coverage=1 00:04:29.681 --rc genhtml_legend=1 00:04:29.681 --rc geninfo_all_blocks=1 00:04:29.681 --rc geninfo_unexecuted_blocks=1 00:04:29.681 00:04:29.681 ' 00:04:29.681 04:11:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:29.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.681 --rc genhtml_branch_coverage=1 00:04:29.681 --rc genhtml_function_coverage=1 00:04:29.681 --rc genhtml_legend=1 00:04:29.681 --rc geninfo_all_blocks=1 00:04:29.681 --rc geninfo_unexecuted_blocks=1 00:04:29.681 00:04:29.681 ' 00:04:29.681 04:11:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:29.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:29.681 --rc genhtml_branch_coverage=1 00:04:29.681 --rc genhtml_function_coverage=1 00:04:29.681 --rc genhtml_legend=1 00:04:29.681 --rc geninfo_all_blocks=1 00:04:29.681 --rc geninfo_unexecuted_blocks=1 00:04:29.681 00:04:29.681 ' 00:04:29.681 04:11:06 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:29.681 04:11:06 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:29.681 04:11:06 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:29.681 04:11:06 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:29.681 04:11:06 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:29.681 04:11:06 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:29.681 04:11:06 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:29.682 04:11:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:29.682 04:11:06 -- common/autotest_common.sh@10 -- # set +x 00:04:29.682 04:11:06 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3773658 00:04:29.682 04:11:06 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:29.682 04:11:06 -- spdkcli/tcp.sh@27 -- # waitforlisten 3773658 00:04:29.682 04:11:06 -- common/autotest_common.sh@829 -- # '[' -z 3773658 ']' 00:04:29.682 04:11:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:29.682 04:11:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:29.682 04:11:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:29.682 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:29.682 04:11:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:29.682 04:11:06 -- common/autotest_common.sh@10 -- # set +x 00:04:29.682 [2024-11-28 04:11:06.925568] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:29.682 [2024-11-28 04:11:06.925665] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3773658 ] 00:04:29.682 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.682 [2024-11-28 04:11:06.988109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:29.940 [2024-11-28 04:11:07.107904] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:29.940 [2024-11-28 04:11:07.108105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:29.940 [2024-11-28 04:11:07.108111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.876 04:11:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:30.876 04:11:07 -- common/autotest_common.sh@862 -- # return 0 00:04:30.876 04:11:07 -- spdkcli/tcp.sh@31 -- # socat_pid=3773798 00:04:30.876 04:11:07 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:30.876 04:11:07 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:30.876 [ 00:04:30.876 "bdev_malloc_delete", 00:04:30.876 "bdev_malloc_create", 00:04:30.876 "bdev_null_resize", 00:04:30.876 "bdev_null_delete", 00:04:30.876 "bdev_null_create", 00:04:30.876 "bdev_nvme_cuse_unregister", 00:04:30.876 "bdev_nvme_cuse_register", 00:04:30.876 "bdev_opal_new_user", 00:04:30.876 "bdev_opal_set_lock_state", 00:04:30.876 "bdev_opal_delete", 00:04:30.876 "bdev_opal_get_info", 00:04:30.876 "bdev_opal_create", 00:04:30.876 "bdev_nvme_opal_revert", 00:04:30.876 "bdev_nvme_opal_init", 00:04:30.876 "bdev_nvme_send_cmd", 00:04:30.876 "bdev_nvme_get_path_iostat", 00:04:30.876 "bdev_nvme_get_mdns_discovery_info", 00:04:30.876 "bdev_nvme_stop_mdns_discovery", 00:04:30.876 "bdev_nvme_start_mdns_discovery", 00:04:30.876 "bdev_nvme_set_multipath_policy", 00:04:30.876 "bdev_nvme_set_preferred_path", 00:04:30.876 "bdev_nvme_get_io_paths", 00:04:30.876 "bdev_nvme_remove_error_injection", 00:04:30.876 "bdev_nvme_add_error_injection", 00:04:30.876 "bdev_nvme_get_discovery_info", 00:04:30.876 "bdev_nvme_stop_discovery", 00:04:30.876 "bdev_nvme_start_discovery", 00:04:30.876 "bdev_nvme_get_controller_health_info", 00:04:30.876 "bdev_nvme_disable_controller", 00:04:30.876 "bdev_nvme_enable_controller", 00:04:30.876 "bdev_nvme_reset_controller", 00:04:30.876 "bdev_nvme_get_transport_statistics", 00:04:30.876 "bdev_nvme_apply_firmware", 00:04:30.876 "bdev_nvme_detach_controller", 00:04:30.876 "bdev_nvme_get_controllers", 00:04:30.876 "bdev_nvme_attach_controller", 00:04:30.876 "bdev_nvme_set_hotplug", 00:04:30.876 "bdev_nvme_set_options", 00:04:30.876 "bdev_passthru_delete", 00:04:30.876 "bdev_passthru_create", 00:04:30.876 "bdev_lvol_grow_lvstore", 00:04:30.876 "bdev_lvol_get_lvols", 00:04:30.876 "bdev_lvol_get_lvstores", 00:04:30.876 "bdev_lvol_delete", 00:04:30.876 "bdev_lvol_set_read_only", 00:04:30.876 "bdev_lvol_resize", 00:04:30.876 "bdev_lvol_decouple_parent", 00:04:30.876 "bdev_lvol_inflate", 00:04:30.876 "bdev_lvol_rename", 00:04:30.876 "bdev_lvol_clone_bdev", 00:04:30.876 "bdev_lvol_clone", 00:04:30.876 "bdev_lvol_snapshot", 00:04:30.876 "bdev_lvol_create", 00:04:30.876 "bdev_lvol_delete_lvstore", 00:04:30.876 "bdev_lvol_rename_lvstore", 00:04:30.876 "bdev_lvol_create_lvstore", 00:04:30.876 "bdev_raid_set_options", 00:04:30.876 "bdev_raid_remove_base_bdev", 00:04:30.876 "bdev_raid_add_base_bdev", 00:04:30.876 "bdev_raid_delete", 00:04:30.876 "bdev_raid_create", 00:04:30.876 "bdev_raid_get_bdevs", 00:04:30.876 "bdev_error_inject_error", 00:04:30.876 "bdev_error_delete", 00:04:30.876 "bdev_error_create", 00:04:30.876 "bdev_split_delete", 00:04:30.876 "bdev_split_create", 00:04:30.876 "bdev_delay_delete", 00:04:30.876 "bdev_delay_create", 00:04:30.876 "bdev_delay_update_latency", 00:04:30.876 "bdev_zone_block_delete", 00:04:30.876 "bdev_zone_block_create", 00:04:30.876 "blobfs_create", 00:04:30.876 "blobfs_detect", 00:04:30.876 "blobfs_set_cache_size", 00:04:30.876 "bdev_aio_delete", 00:04:30.876 "bdev_aio_rescan", 00:04:30.876 "bdev_aio_create", 00:04:30.876 "bdev_ftl_set_property", 00:04:30.876 "bdev_ftl_get_properties", 00:04:30.876 "bdev_ftl_get_stats", 00:04:30.876 "bdev_ftl_unmap", 00:04:30.876 "bdev_ftl_unload", 00:04:30.876 "bdev_ftl_delete", 00:04:30.876 "bdev_ftl_load", 00:04:30.876 "bdev_ftl_create", 00:04:30.876 "bdev_virtio_attach_controller", 00:04:30.876 "bdev_virtio_scsi_get_devices", 00:04:30.876 "bdev_virtio_detach_controller", 00:04:30.876 "bdev_virtio_blk_set_hotplug", 00:04:30.876 "bdev_iscsi_delete", 00:04:30.876 "bdev_iscsi_create", 00:04:30.876 "bdev_iscsi_set_options", 00:04:30.876 "accel_error_inject_error", 00:04:30.876 "ioat_scan_accel_module", 00:04:30.876 "dsa_scan_accel_module", 00:04:30.876 "iaa_scan_accel_module", 00:04:30.876 "iscsi_set_options", 00:04:30.876 "iscsi_get_auth_groups", 00:04:30.876 "iscsi_auth_group_remove_secret", 00:04:30.876 "iscsi_auth_group_add_secret", 00:04:30.876 "iscsi_delete_auth_group", 00:04:30.876 "iscsi_create_auth_group", 00:04:30.876 "iscsi_set_discovery_auth", 00:04:30.876 "iscsi_get_options", 00:04:30.876 "iscsi_target_node_request_logout", 00:04:30.876 "iscsi_target_node_set_redirect", 00:04:30.876 "iscsi_target_node_set_auth", 00:04:30.877 "iscsi_target_node_add_lun", 00:04:30.877 "iscsi_get_connections", 00:04:30.877 "iscsi_portal_group_set_auth", 00:04:30.877 "iscsi_start_portal_group", 00:04:30.877 "iscsi_delete_portal_group", 00:04:30.877 "iscsi_create_portal_group", 00:04:30.877 "iscsi_get_portal_groups", 00:04:30.877 "iscsi_delete_target_node", 00:04:30.877 "iscsi_target_node_remove_pg_ig_maps", 00:04:30.877 "iscsi_target_node_add_pg_ig_maps", 00:04:30.877 "iscsi_create_target_node", 00:04:30.877 "iscsi_get_target_nodes", 00:04:30.877 "iscsi_delete_initiator_group", 00:04:30.877 "iscsi_initiator_group_remove_initiators", 00:04:30.877 "iscsi_initiator_group_add_initiators", 00:04:30.877 "iscsi_create_initiator_group", 00:04:30.877 "iscsi_get_initiator_groups", 00:04:30.877 "nvmf_set_crdt", 00:04:30.877 "nvmf_set_config", 00:04:30.877 "nvmf_set_max_subsystems", 00:04:30.877 "nvmf_subsystem_get_listeners", 00:04:30.877 "nvmf_subsystem_get_qpairs", 00:04:30.877 "nvmf_subsystem_get_controllers", 00:04:30.877 "nvmf_get_stats", 00:04:30.877 "nvmf_get_transports", 00:04:30.877 "nvmf_create_transport", 00:04:30.877 "nvmf_get_targets", 00:04:30.877 "nvmf_delete_target", 00:04:30.877 "nvmf_create_target", 00:04:30.877 "nvmf_subsystem_allow_any_host", 00:04:30.877 "nvmf_subsystem_remove_host", 00:04:30.877 "nvmf_subsystem_add_host", 00:04:30.877 "nvmf_subsystem_remove_ns", 00:04:30.877 "nvmf_subsystem_add_ns", 00:04:30.877 "nvmf_subsystem_listener_set_ana_state", 00:04:30.877 "nvmf_discovery_get_referrals", 00:04:30.877 "nvmf_discovery_remove_referral", 00:04:30.877 "nvmf_discovery_add_referral", 00:04:30.877 "nvmf_subsystem_remove_listener", 00:04:30.877 "nvmf_subsystem_add_listener", 00:04:30.877 "nvmf_delete_subsystem", 00:04:30.877 "nvmf_create_subsystem", 00:04:30.877 "nvmf_get_subsystems", 00:04:30.877 "env_dpdk_get_mem_stats", 00:04:30.877 "nbd_get_disks", 00:04:30.877 "nbd_stop_disk", 00:04:30.877 "nbd_start_disk", 00:04:30.877 "ublk_recover_disk", 00:04:30.877 "ublk_get_disks", 00:04:30.877 "ublk_stop_disk", 00:04:30.877 "ublk_start_disk", 00:04:30.877 "ublk_destroy_target", 00:04:30.877 "ublk_create_target", 00:04:30.877 "virtio_blk_create_transport", 00:04:30.877 "virtio_blk_get_transports", 00:04:30.877 "vhost_controller_set_coalescing", 00:04:30.877 "vhost_get_controllers", 00:04:30.877 "vhost_delete_controller", 00:04:30.877 "vhost_create_blk_controller", 00:04:30.877 "vhost_scsi_controller_remove_target", 00:04:30.877 "vhost_scsi_controller_add_target", 00:04:30.877 "vhost_start_scsi_controller", 00:04:30.877 "vhost_create_scsi_controller", 00:04:30.877 "thread_set_cpumask", 00:04:30.877 "framework_get_scheduler", 00:04:30.877 "framework_set_scheduler", 00:04:30.877 "framework_get_reactors", 00:04:30.877 "thread_get_io_channels", 00:04:30.877 "thread_get_pollers", 00:04:30.877 "thread_get_stats", 00:04:30.877 "framework_monitor_context_switch", 00:04:30.877 "spdk_kill_instance", 00:04:30.877 "log_enable_timestamps", 00:04:30.877 "log_get_flags", 00:04:30.877 "log_clear_flag", 00:04:30.877 "log_set_flag", 00:04:30.877 "log_get_level", 00:04:30.877 "log_set_level", 00:04:30.877 "log_get_print_level", 00:04:30.877 "log_set_print_level", 00:04:30.877 "framework_enable_cpumask_locks", 00:04:30.877 "framework_disable_cpumask_locks", 00:04:30.877 "framework_wait_init", 00:04:30.877 "framework_start_init", 00:04:30.877 "scsi_get_devices", 00:04:30.877 "bdev_get_histogram", 00:04:30.877 "bdev_enable_histogram", 00:04:30.877 "bdev_set_qos_limit", 00:04:30.877 "bdev_set_qd_sampling_period", 00:04:30.877 "bdev_get_bdevs", 00:04:30.877 "bdev_reset_iostat", 00:04:30.877 "bdev_get_iostat", 00:04:30.877 "bdev_examine", 00:04:30.877 "bdev_wait_for_examine", 00:04:30.877 "bdev_set_options", 00:04:30.877 "notify_get_notifications", 00:04:30.877 "notify_get_types", 00:04:30.877 "accel_get_stats", 00:04:30.877 "accel_set_options", 00:04:30.877 "accel_set_driver", 00:04:30.877 "accel_crypto_key_destroy", 00:04:30.877 "accel_crypto_keys_get", 00:04:30.877 "accel_crypto_key_create", 00:04:30.877 "accel_assign_opc", 00:04:30.877 "accel_get_module_info", 00:04:30.877 "accel_get_opc_assignments", 00:04:30.877 "vmd_rescan", 00:04:30.877 "vmd_remove_device", 00:04:30.877 "vmd_enable", 00:04:30.877 "sock_set_default_impl", 00:04:30.877 "sock_impl_set_options", 00:04:30.877 "sock_impl_get_options", 00:04:30.877 "iobuf_get_stats", 00:04:30.877 "iobuf_set_options", 00:04:30.877 "framework_get_pci_devices", 00:04:30.877 "framework_get_config", 00:04:30.877 "framework_get_subsystems", 00:04:30.877 "trace_get_info", 00:04:30.877 "trace_get_tpoint_group_mask", 00:04:30.877 "trace_disable_tpoint_group", 00:04:30.877 "trace_enable_tpoint_group", 00:04:30.877 "trace_clear_tpoint_mask", 00:04:30.877 "trace_set_tpoint_mask", 00:04:30.877 "spdk_get_version", 00:04:30.877 "rpc_get_methods" 00:04:30.877 ] 00:04:30.877 04:11:08 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:30.877 04:11:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:30.877 04:11:08 -- common/autotest_common.sh@10 -- # set +x 00:04:30.877 04:11:08 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:30.877 04:11:08 -- spdkcli/tcp.sh@38 -- # killprocess 3773658 00:04:30.877 04:11:08 -- common/autotest_common.sh@936 -- # '[' -z 3773658 ']' 00:04:30.877 04:11:08 -- common/autotest_common.sh@940 -- # kill -0 3773658 00:04:30.877 04:11:08 -- common/autotest_common.sh@941 -- # uname 00:04:30.877 04:11:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:30.877 04:11:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3773658 00:04:30.877 04:11:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:30.877 04:11:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:30.877 04:11:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3773658' 00:04:30.877 killing process with pid 3773658 00:04:30.877 04:11:08 -- common/autotest_common.sh@955 -- # kill 3773658 00:04:30.877 04:11:08 -- common/autotest_common.sh@960 -- # wait 3773658 00:04:31.442 00:04:31.442 real 0m1.894s 00:04:31.442 user 0m3.569s 00:04:31.442 sys 0m0.488s 00:04:31.442 04:11:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:31.442 04:11:08 -- common/autotest_common.sh@10 -- # set +x 00:04:31.443 ************************************ 00:04:31.443 END TEST spdkcli_tcp 00:04:31.443 ************************************ 00:04:31.443 04:11:08 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:31.443 04:11:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.443 04:11:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.443 04:11:08 -- common/autotest_common.sh@10 -- # set +x 00:04:31.443 ************************************ 00:04:31.443 START TEST dpdk_mem_utility 00:04:31.443 ************************************ 00:04:31.443 04:11:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:31.443 * Looking for test storage... 00:04:31.443 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:31.443 04:11:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:31.443 04:11:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:31.443 04:11:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:31.701 04:11:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:31.701 04:11:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:31.701 04:11:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:31.701 04:11:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:31.701 04:11:08 -- scripts/common.sh@335 -- # IFS=.-: 00:04:31.701 04:11:08 -- scripts/common.sh@335 -- # read -ra ver1 00:04:31.701 04:11:08 -- scripts/common.sh@336 -- # IFS=.-: 00:04:31.701 04:11:08 -- scripts/common.sh@336 -- # read -ra ver2 00:04:31.701 04:11:08 -- scripts/common.sh@337 -- # local 'op=<' 00:04:31.701 04:11:08 -- scripts/common.sh@339 -- # ver1_l=2 00:04:31.701 04:11:08 -- scripts/common.sh@340 -- # ver2_l=1 00:04:31.701 04:11:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:31.701 04:11:08 -- scripts/common.sh@343 -- # case "$op" in 00:04:31.701 04:11:08 -- scripts/common.sh@344 -- # : 1 00:04:31.701 04:11:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:31.701 04:11:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:31.701 04:11:08 -- scripts/common.sh@364 -- # decimal 1 00:04:31.701 04:11:08 -- scripts/common.sh@352 -- # local d=1 00:04:31.701 04:11:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:31.701 04:11:08 -- scripts/common.sh@354 -- # echo 1 00:04:31.701 04:11:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:31.701 04:11:08 -- scripts/common.sh@365 -- # decimal 2 00:04:31.701 04:11:08 -- scripts/common.sh@352 -- # local d=2 00:04:31.701 04:11:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:31.701 04:11:08 -- scripts/common.sh@354 -- # echo 2 00:04:31.701 04:11:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:31.701 04:11:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:31.701 04:11:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:31.701 04:11:08 -- scripts/common.sh@367 -- # return 0 00:04:31.701 04:11:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:31.701 04:11:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:31.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.701 --rc genhtml_branch_coverage=1 00:04:31.701 --rc genhtml_function_coverage=1 00:04:31.701 --rc genhtml_legend=1 00:04:31.701 --rc geninfo_all_blocks=1 00:04:31.701 --rc geninfo_unexecuted_blocks=1 00:04:31.701 00:04:31.701 ' 00:04:31.701 04:11:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:31.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.701 --rc genhtml_branch_coverage=1 00:04:31.701 --rc genhtml_function_coverage=1 00:04:31.701 --rc genhtml_legend=1 00:04:31.701 --rc geninfo_all_blocks=1 00:04:31.701 --rc geninfo_unexecuted_blocks=1 00:04:31.701 00:04:31.701 ' 00:04:31.701 04:11:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:31.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.701 --rc genhtml_branch_coverage=1 00:04:31.701 --rc genhtml_function_coverage=1 00:04:31.701 --rc genhtml_legend=1 00:04:31.701 --rc geninfo_all_blocks=1 00:04:31.701 --rc geninfo_unexecuted_blocks=1 00:04:31.701 00:04:31.701 ' 00:04:31.701 04:11:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:31.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.701 --rc genhtml_branch_coverage=1 00:04:31.701 --rc genhtml_function_coverage=1 00:04:31.701 --rc genhtml_legend=1 00:04:31.701 --rc geninfo_all_blocks=1 00:04:31.701 --rc geninfo_unexecuted_blocks=1 00:04:31.701 00:04:31.701 ' 00:04:31.701 04:11:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:31.701 04:11:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3773999 00:04:31.701 04:11:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:31.701 04:11:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3773999 00:04:31.701 04:11:08 -- common/autotest_common.sh@829 -- # '[' -z 3773999 ']' 00:04:31.701 04:11:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:31.701 04:11:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:31.701 04:11:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:31.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:31.701 04:11:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:31.701 04:11:08 -- common/autotest_common.sh@10 -- # set +x 00:04:31.701 [2024-11-28 04:11:08.860150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:31.701 [2024-11-28 04:11:08.860227] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3773999 ] 00:04:31.701 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.701 [2024-11-28 04:11:08.917166] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.959 [2024-11-28 04:11:09.024592] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:31.959 [2024-11-28 04:11:09.024754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:32.525 04:11:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:32.525 04:11:09 -- common/autotest_common.sh@862 -- # return 0 00:04:32.525 04:11:09 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:32.525 04:11:09 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:32.525 04:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:32.525 04:11:09 -- common/autotest_common.sh@10 -- # set +x 00:04:32.784 { 00:04:32.784 "filename": "/tmp/spdk_mem_dump.txt" 00:04:32.784 } 00:04:32.784 04:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:32.784 04:11:09 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:32.784 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:32.784 1 heaps totaling size 814.000000 MiB 00:04:32.784 size: 814.000000 MiB heap id: 0 00:04:32.784 end heaps---------- 00:04:32.784 8 mempools totaling size 598.116089 MiB 00:04:32.784 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:32.784 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:32.784 size: 84.521057 MiB name: bdev_io_3773999 00:04:32.784 size: 51.011292 MiB name: evtpool_3773999 00:04:32.784 size: 50.003479 MiB name: msgpool_3773999 00:04:32.784 size: 21.763794 MiB name: PDU_Pool 00:04:32.784 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:32.784 size: 0.026123 MiB name: Session_Pool 00:04:32.784 end mempools------- 00:04:32.784 6 memzones totaling size 4.142822 MiB 00:04:32.784 size: 1.000366 MiB name: RG_ring_0_3773999 00:04:32.784 size: 1.000366 MiB name: RG_ring_1_3773999 00:04:32.784 size: 1.000366 MiB name: RG_ring_4_3773999 00:04:32.784 size: 1.000366 MiB name: RG_ring_5_3773999 00:04:32.784 size: 0.125366 MiB name: RG_ring_2_3773999 00:04:32.784 size: 0.015991 MiB name: RG_ring_3_3773999 00:04:32.784 end memzones------- 00:04:32.784 04:11:09 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:32.784 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:32.784 list of free elements. size: 12.519348 MiB 00:04:32.784 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:32.784 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:32.784 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:32.784 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:32.784 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:32.784 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:32.784 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:32.784 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:32.784 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:32.784 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:32.784 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:32.784 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:32.784 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:32.784 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:32.784 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:32.784 list of standard malloc elements. size: 199.218079 MiB 00:04:32.784 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:32.784 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:32.784 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:32.784 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:32.784 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:32.784 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:32.784 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:32.784 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:32.784 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:32.784 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:32.784 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:32.784 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:32.784 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:32.784 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:32.784 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:32.784 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:32.784 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:32.784 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:32.784 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:32.784 list of memzone associated elements. size: 602.262573 MiB 00:04:32.784 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:32.784 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:32.784 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:32.784 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:32.784 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:32.784 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3773999_0 00:04:32.784 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:32.784 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3773999_0 00:04:32.784 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:32.784 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3773999_0 00:04:32.784 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:32.784 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:32.784 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:32.784 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:32.784 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:32.784 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3773999 00:04:32.784 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:32.784 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3773999 00:04:32.784 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:32.784 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3773999 00:04:32.784 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:32.784 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:32.784 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:32.784 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:32.784 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:32.784 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:32.784 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:32.784 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:32.784 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:32.784 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3773999 00:04:32.784 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:32.784 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3773999 00:04:32.784 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:32.784 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3773999 00:04:32.784 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:32.784 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3773999 00:04:32.785 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:32.785 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3773999 00:04:32.785 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:32.785 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:32.785 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:32.785 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:32.785 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:32.785 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:32.785 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:32.785 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3773999 00:04:32.785 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:32.785 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:32.785 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:32.785 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:32.785 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:32.785 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3773999 00:04:32.785 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:32.785 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:32.785 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:32.785 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3773999 00:04:32.785 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:32.785 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3773999 00:04:32.785 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:32.785 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:32.785 04:11:09 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:32.785 04:11:09 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3773999 00:04:32.785 04:11:09 -- common/autotest_common.sh@936 -- # '[' -z 3773999 ']' 00:04:32.785 04:11:09 -- common/autotest_common.sh@940 -- # kill -0 3773999 00:04:32.785 04:11:09 -- common/autotest_common.sh@941 -- # uname 00:04:32.785 04:11:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:32.785 04:11:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3773999 00:04:32.785 04:11:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:32.785 04:11:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:32.785 04:11:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3773999' 00:04:32.785 killing process with pid 3773999 00:04:32.785 04:11:09 -- common/autotest_common.sh@955 -- # kill 3773999 00:04:32.785 04:11:09 -- common/autotest_common.sh@960 -- # wait 3773999 00:04:33.351 00:04:33.351 real 0m1.778s 00:04:33.351 user 0m1.969s 00:04:33.351 sys 0m0.448s 00:04:33.351 04:11:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.351 04:11:10 -- common/autotest_common.sh@10 -- # set +x 00:04:33.351 ************************************ 00:04:33.351 END TEST dpdk_mem_utility 00:04:33.351 ************************************ 00:04:33.351 04:11:10 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:33.351 04:11:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.351 04:11:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.351 04:11:10 -- common/autotest_common.sh@10 -- # set +x 00:04:33.351 ************************************ 00:04:33.351 START TEST event 00:04:33.351 ************************************ 00:04:33.351 04:11:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:33.351 * Looking for test storage... 00:04:33.351 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:33.351 04:11:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:33.351 04:11:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:33.351 04:11:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:33.351 04:11:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:33.351 04:11:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:33.351 04:11:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:33.351 04:11:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:33.351 04:11:10 -- scripts/common.sh@335 -- # IFS=.-: 00:04:33.351 04:11:10 -- scripts/common.sh@335 -- # read -ra ver1 00:04:33.351 04:11:10 -- scripts/common.sh@336 -- # IFS=.-: 00:04:33.351 04:11:10 -- scripts/common.sh@336 -- # read -ra ver2 00:04:33.351 04:11:10 -- scripts/common.sh@337 -- # local 'op=<' 00:04:33.351 04:11:10 -- scripts/common.sh@339 -- # ver1_l=2 00:04:33.351 04:11:10 -- scripts/common.sh@340 -- # ver2_l=1 00:04:33.351 04:11:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:33.351 04:11:10 -- scripts/common.sh@343 -- # case "$op" in 00:04:33.351 04:11:10 -- scripts/common.sh@344 -- # : 1 00:04:33.351 04:11:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:33.351 04:11:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:33.351 04:11:10 -- scripts/common.sh@364 -- # decimal 1 00:04:33.351 04:11:10 -- scripts/common.sh@352 -- # local d=1 00:04:33.351 04:11:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:33.351 04:11:10 -- scripts/common.sh@354 -- # echo 1 00:04:33.351 04:11:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:33.351 04:11:10 -- scripts/common.sh@365 -- # decimal 2 00:04:33.351 04:11:10 -- scripts/common.sh@352 -- # local d=2 00:04:33.351 04:11:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:33.351 04:11:10 -- scripts/common.sh@354 -- # echo 2 00:04:33.351 04:11:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:33.351 04:11:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:33.351 04:11:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:33.351 04:11:10 -- scripts/common.sh@367 -- # return 0 00:04:33.351 04:11:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:33.351 04:11:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:33.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.351 --rc genhtml_branch_coverage=1 00:04:33.351 --rc genhtml_function_coverage=1 00:04:33.351 --rc genhtml_legend=1 00:04:33.351 --rc geninfo_all_blocks=1 00:04:33.351 --rc geninfo_unexecuted_blocks=1 00:04:33.351 00:04:33.351 ' 00:04:33.351 04:11:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:33.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.351 --rc genhtml_branch_coverage=1 00:04:33.351 --rc genhtml_function_coverage=1 00:04:33.351 --rc genhtml_legend=1 00:04:33.351 --rc geninfo_all_blocks=1 00:04:33.351 --rc geninfo_unexecuted_blocks=1 00:04:33.351 00:04:33.351 ' 00:04:33.352 04:11:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:33.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.352 --rc genhtml_branch_coverage=1 00:04:33.352 --rc genhtml_function_coverage=1 00:04:33.352 --rc genhtml_legend=1 00:04:33.352 --rc geninfo_all_blocks=1 00:04:33.352 --rc geninfo_unexecuted_blocks=1 00:04:33.352 00:04:33.352 ' 00:04:33.352 04:11:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:33.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.352 --rc genhtml_branch_coverage=1 00:04:33.352 --rc genhtml_function_coverage=1 00:04:33.352 --rc genhtml_legend=1 00:04:33.352 --rc geninfo_all_blocks=1 00:04:33.352 --rc geninfo_unexecuted_blocks=1 00:04:33.352 00:04:33.352 ' 00:04:33.352 04:11:10 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:33.352 04:11:10 -- bdev/nbd_common.sh@6 -- # set -e 00:04:33.352 04:11:10 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:33.352 04:11:10 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:33.352 04:11:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.352 04:11:10 -- common/autotest_common.sh@10 -- # set +x 00:04:33.352 ************************************ 00:04:33.352 START TEST event_perf 00:04:33.352 ************************************ 00:04:33.352 04:11:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:33.352 Running I/O for 1 seconds...[2024-11-28 04:11:10.628476] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.352 [2024-11-28 04:11:10.628584] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3774328 ] 00:04:33.352 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.609 [2024-11-28 04:11:10.692797] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:33.609 [2024-11-28 04:11:10.810583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:33.609 [2024-11-28 04:11:10.810639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:33.609 [2024-11-28 04:11:10.810758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:33.609 [2024-11-28 04:11:10.810762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.977 Running I/O for 1 seconds... 00:04:34.977 lcore 0: 230325 00:04:34.977 lcore 1: 230323 00:04:34.977 lcore 2: 230322 00:04:34.977 lcore 3: 230324 00:04:34.977 done. 00:04:34.977 00:04:34.977 real 0m1.320s 00:04:34.977 user 0m4.224s 00:04:34.977 sys 0m0.092s 00:04:34.977 04:11:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.977 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:04:34.977 ************************************ 00:04:34.977 END TEST event_perf 00:04:34.977 ************************************ 00:04:34.977 04:11:11 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:34.977 04:11:11 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:34.977 04:11:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.977 04:11:11 -- common/autotest_common.sh@10 -- # set +x 00:04:34.977 ************************************ 00:04:34.977 START TEST event_reactor 00:04:34.977 ************************************ 00:04:34.977 04:11:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:34.977 [2024-11-28 04:11:11.974371] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.977 [2024-11-28 04:11:11.974455] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3774489 ] 00:04:34.977 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.977 [2024-11-28 04:11:12.037703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:34.977 [2024-11-28 04:11:12.154839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.348 test_start 00:04:36.348 oneshot 00:04:36.348 tick 100 00:04:36.348 tick 100 00:04:36.348 tick 250 00:04:36.348 tick 100 00:04:36.348 tick 100 00:04:36.348 tick 100 00:04:36.348 tick 250 00:04:36.348 tick 500 00:04:36.348 tick 100 00:04:36.348 tick 100 00:04:36.348 tick 250 00:04:36.348 tick 100 00:04:36.348 tick 100 00:04:36.348 test_end 00:04:36.348 00:04:36.348 real 0m1.318s 00:04:36.348 user 0m1.230s 00:04:36.348 sys 0m0.082s 00:04:36.348 04:11:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:36.348 04:11:13 -- common/autotest_common.sh@10 -- # set +x 00:04:36.348 ************************************ 00:04:36.348 END TEST event_reactor 00:04:36.348 ************************************ 00:04:36.348 04:11:13 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:36.348 04:11:13 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:36.348 04:11:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.348 04:11:13 -- common/autotest_common.sh@10 -- # set +x 00:04:36.348 ************************************ 00:04:36.348 START TEST event_reactor_perf 00:04:36.348 ************************************ 00:04:36.348 04:11:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:36.348 [2024-11-28 04:11:13.317634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.348 [2024-11-28 04:11:13.317709] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3774646 ] 00:04:36.348 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.348 [2024-11-28 04:11:13.378368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.348 [2024-11-28 04:11:13.492952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.724 test_start 00:04:37.724 test_end 00:04:37.724 Performance: 353137 events per second 00:04:37.724 00:04:37.724 real 0m1.306s 00:04:37.724 user 0m1.220s 00:04:37.724 sys 0m0.080s 00:04:37.724 04:11:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.724 04:11:14 -- common/autotest_common.sh@10 -- # set +x 00:04:37.724 ************************************ 00:04:37.724 END TEST event_reactor_perf 00:04:37.724 ************************************ 00:04:37.724 04:11:14 -- event/event.sh@49 -- # uname -s 00:04:37.724 04:11:14 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:37.724 04:11:14 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:37.724 04:11:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.724 04:11:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.724 04:11:14 -- common/autotest_common.sh@10 -- # set +x 00:04:37.724 ************************************ 00:04:37.724 START TEST event_scheduler 00:04:37.724 ************************************ 00:04:37.724 04:11:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:37.724 * Looking for test storage... 00:04:37.724 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:37.724 04:11:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:37.724 04:11:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:37.724 04:11:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:37.724 04:11:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:37.724 04:11:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:37.725 04:11:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:37.725 04:11:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:37.725 04:11:14 -- scripts/common.sh@335 -- # IFS=.-: 00:04:37.725 04:11:14 -- scripts/common.sh@335 -- # read -ra ver1 00:04:37.725 04:11:14 -- scripts/common.sh@336 -- # IFS=.-: 00:04:37.725 04:11:14 -- scripts/common.sh@336 -- # read -ra ver2 00:04:37.725 04:11:14 -- scripts/common.sh@337 -- # local 'op=<' 00:04:37.725 04:11:14 -- scripts/common.sh@339 -- # ver1_l=2 00:04:37.725 04:11:14 -- scripts/common.sh@340 -- # ver2_l=1 00:04:37.725 04:11:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:37.725 04:11:14 -- scripts/common.sh@343 -- # case "$op" in 00:04:37.725 04:11:14 -- scripts/common.sh@344 -- # : 1 00:04:37.725 04:11:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:37.725 04:11:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:37.725 04:11:14 -- scripts/common.sh@364 -- # decimal 1 00:04:37.725 04:11:14 -- scripts/common.sh@352 -- # local d=1 00:04:37.725 04:11:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:37.725 04:11:14 -- scripts/common.sh@354 -- # echo 1 00:04:37.725 04:11:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:37.725 04:11:14 -- scripts/common.sh@365 -- # decimal 2 00:04:37.725 04:11:14 -- scripts/common.sh@352 -- # local d=2 00:04:37.725 04:11:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:37.725 04:11:14 -- scripts/common.sh@354 -- # echo 2 00:04:37.725 04:11:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:37.725 04:11:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:37.725 04:11:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:37.725 04:11:14 -- scripts/common.sh@367 -- # return 0 00:04:37.725 04:11:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:37.725 04:11:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:37.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.725 --rc genhtml_branch_coverage=1 00:04:37.725 --rc genhtml_function_coverage=1 00:04:37.725 --rc genhtml_legend=1 00:04:37.725 --rc geninfo_all_blocks=1 00:04:37.725 --rc geninfo_unexecuted_blocks=1 00:04:37.725 00:04:37.725 ' 00:04:37.725 04:11:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:37.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.725 --rc genhtml_branch_coverage=1 00:04:37.725 --rc genhtml_function_coverage=1 00:04:37.725 --rc genhtml_legend=1 00:04:37.725 --rc geninfo_all_blocks=1 00:04:37.725 --rc geninfo_unexecuted_blocks=1 00:04:37.725 00:04:37.725 ' 00:04:37.725 04:11:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:37.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.725 --rc genhtml_branch_coverage=1 00:04:37.725 --rc genhtml_function_coverage=1 00:04:37.725 --rc genhtml_legend=1 00:04:37.725 --rc geninfo_all_blocks=1 00:04:37.725 --rc geninfo_unexecuted_blocks=1 00:04:37.725 00:04:37.725 ' 00:04:37.725 04:11:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:37.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.725 --rc genhtml_branch_coverage=1 00:04:37.725 --rc genhtml_function_coverage=1 00:04:37.725 --rc genhtml_legend=1 00:04:37.725 --rc geninfo_all_blocks=1 00:04:37.725 --rc geninfo_unexecuted_blocks=1 00:04:37.725 00:04:37.725 ' 00:04:37.725 04:11:14 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:37.725 04:11:14 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3774844 00:04:37.725 04:11:14 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:37.725 04:11:14 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:37.725 04:11:14 -- scheduler/scheduler.sh@37 -- # waitforlisten 3774844 00:04:37.725 04:11:14 -- common/autotest_common.sh@829 -- # '[' -z 3774844 ']' 00:04:37.725 04:11:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:37.725 04:11:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.725 04:11:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:37.725 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:37.725 04:11:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.725 04:11:14 -- common/autotest_common.sh@10 -- # set +x 00:04:37.725 [2024-11-28 04:11:14.813776] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.725 [2024-11-28 04:11:14.813872] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3774844 ] 00:04:37.725 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.725 [2024-11-28 04:11:14.870258] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:37.725 [2024-11-28 04:11:14.982740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.725 [2024-11-28 04:11:14.982807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:37.725 [2024-11-28 04:11:14.982867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:37.725 [2024-11-28 04:11:14.982870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:37.983 04:11:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:37.983 04:11:15 -- common/autotest_common.sh@862 -- # return 0 00:04:37.983 04:11:15 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:37.983 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.983 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.983 POWER: Env isn't set yet! 00:04:37.983 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:37.983 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:37.983 POWER: Cannot get available frequencies of lcore 0 00:04:37.983 POWER: Attempting to initialise PSTAT power management... 00:04:37.983 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:37.983 POWER: Initialized successfully for lcore 0 power management 00:04:37.983 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:37.983 POWER: Initialized successfully for lcore 1 power management 00:04:37.983 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:37.983 POWER: Initialized successfully for lcore 2 power management 00:04:37.983 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:37.983 POWER: Initialized successfully for lcore 3 power management 00:04:37.983 [2024-11-28 04:11:15.094730] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:37.983 [2024-11-28 04:11:15.094749] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:37.983 [2024-11-28 04:11:15.094761] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:37.983 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.983 04:11:15 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:37.983 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 [2024-11-28 04:11:15.199467] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:37.984 04:11:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.984 04:11:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 ************************************ 00:04:37.984 START TEST scheduler_create_thread 00:04:37.984 ************************************ 00:04:37.984 04:11:15 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 2 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 3 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 4 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 5 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 6 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 7 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 8 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:37.984 9 00:04:37.984 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.984 04:11:15 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:37.984 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.984 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:38.241 10 00:04:38.241 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.241 04:11:15 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:38.241 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.241 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:38.241 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.241 04:11:15 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:38.241 04:11:15 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:38.241 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.241 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:38.241 04:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.241 04:11:15 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:38.241 04:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.241 04:11:15 -- common/autotest_common.sh@10 -- # set +x 00:04:39.616 04:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:39.616 04:11:16 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:39.616 04:11:16 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:39.616 04:11:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:39.616 04:11:16 -- common/autotest_common.sh@10 -- # set +x 00:04:40.550 04:11:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.550 00:04:40.550 real 0m2.620s 00:04:40.550 user 0m0.010s 00:04:40.550 sys 0m0.004s 00:04:40.551 04:11:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.551 04:11:17 -- common/autotest_common.sh@10 -- # set +x 00:04:40.551 ************************************ 00:04:40.551 END TEST scheduler_create_thread 00:04:40.551 ************************************ 00:04:40.551 04:11:17 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:40.551 04:11:17 -- scheduler/scheduler.sh@46 -- # killprocess 3774844 00:04:40.551 04:11:17 -- common/autotest_common.sh@936 -- # '[' -z 3774844 ']' 00:04:40.551 04:11:17 -- common/autotest_common.sh@940 -- # kill -0 3774844 00:04:40.551 04:11:17 -- common/autotest_common.sh@941 -- # uname 00:04:40.551 04:11:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:40.551 04:11:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3774844 00:04:40.808 04:11:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:40.808 04:11:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:40.809 04:11:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3774844' 00:04:40.809 killing process with pid 3774844 00:04:40.809 04:11:17 -- common/autotest_common.sh@955 -- # kill 3774844 00:04:40.809 04:11:17 -- common/autotest_common.sh@960 -- # wait 3774844 00:04:41.067 [2024-11-28 04:11:18.306444] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:41.325 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:41.325 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:41.325 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:41.325 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:41.325 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:41.325 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:41.325 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:41.325 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:41.325 00:04:41.325 real 0m3.933s 00:04:41.325 user 0m5.954s 00:04:41.325 sys 0m0.323s 00:04:41.325 04:11:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.325 04:11:18 -- common/autotest_common.sh@10 -- # set +x 00:04:41.325 ************************************ 00:04:41.325 END TEST event_scheduler 00:04:41.325 ************************************ 00:04:41.325 04:11:18 -- event/event.sh@51 -- # modprobe -n nbd 00:04:41.325 04:11:18 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:41.325 04:11:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.325 04:11:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.325 04:11:18 -- common/autotest_common.sh@10 -- # set +x 00:04:41.325 ************************************ 00:04:41.325 START TEST app_repeat 00:04:41.325 ************************************ 00:04:41.325 04:11:18 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:41.325 04:11:18 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:41.325 04:11:18 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.325 04:11:18 -- event/event.sh@13 -- # local nbd_list 00:04:41.325 04:11:18 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:41.325 04:11:18 -- event/event.sh@14 -- # local bdev_list 00:04:41.325 04:11:18 -- event/event.sh@15 -- # local repeat_times=4 00:04:41.325 04:11:18 -- event/event.sh@17 -- # modprobe nbd 00:04:41.325 04:11:18 -- event/event.sh@19 -- # repeat_pid=3775427 00:04:41.325 04:11:18 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:41.325 04:11:18 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:41.325 04:11:18 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3775427' 00:04:41.325 Process app_repeat pid: 3775427 00:04:41.325 04:11:18 -- event/event.sh@23 -- # for i in {0..2} 00:04:41.325 04:11:18 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:41.325 spdk_app_start Round 0 00:04:41.325 04:11:18 -- event/event.sh@25 -- # waitforlisten 3775427 /var/tmp/spdk-nbd.sock 00:04:41.325 04:11:18 -- common/autotest_common.sh@829 -- # '[' -z 3775427 ']' 00:04:41.325 04:11:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:41.325 04:11:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:41.325 04:11:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:41.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:41.325 04:11:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:41.325 04:11:18 -- common/autotest_common.sh@10 -- # set +x 00:04:41.325 [2024-11-28 04:11:18.631609] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:41.325 [2024-11-28 04:11:18.631685] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3775427 ] 00:04:41.583 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.584 [2024-11-28 04:11:18.690400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:41.584 [2024-11-28 04:11:18.799666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:41.584 [2024-11-28 04:11:18.799670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.517 04:11:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:42.517 04:11:19 -- common/autotest_common.sh@862 -- # return 0 00:04:42.517 04:11:19 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:42.775 Malloc0 00:04:42.775 04:11:19 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:43.033 Malloc1 00:04:43.033 04:11:20 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@12 -- # local i 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:43.033 04:11:20 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:43.291 /dev/nbd0 00:04:43.291 04:11:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:43.291 04:11:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:43.291 04:11:20 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:43.292 04:11:20 -- common/autotest_common.sh@867 -- # local i 00:04:43.292 04:11:20 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:43.292 04:11:20 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:43.292 04:11:20 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:43.292 04:11:20 -- common/autotest_common.sh@871 -- # break 00:04:43.292 04:11:20 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:43.292 04:11:20 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:43.292 04:11:20 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:43.292 1+0 records in 00:04:43.292 1+0 records out 00:04:43.292 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000237305 s, 17.3 MB/s 00:04:43.292 04:11:20 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.292 04:11:20 -- common/autotest_common.sh@884 -- # size=4096 00:04:43.292 04:11:20 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.292 04:11:20 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:43.292 04:11:20 -- common/autotest_common.sh@887 -- # return 0 00:04:43.292 04:11:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:43.292 04:11:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:43.292 04:11:20 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:43.550 /dev/nbd1 00:04:43.550 04:11:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:43.550 04:11:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:43.550 04:11:20 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:43.550 04:11:20 -- common/autotest_common.sh@867 -- # local i 00:04:43.550 04:11:20 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:43.550 04:11:20 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:43.550 04:11:20 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:43.550 04:11:20 -- common/autotest_common.sh@871 -- # break 00:04:43.550 04:11:20 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:43.550 04:11:20 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:43.550 04:11:20 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:43.550 1+0 records in 00:04:43.550 1+0 records out 00:04:43.550 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000221523 s, 18.5 MB/s 00:04:43.550 04:11:20 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.550 04:11:20 -- common/autotest_common.sh@884 -- # size=4096 00:04:43.550 04:11:20 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.550 04:11:20 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:43.550 04:11:20 -- common/autotest_common.sh@887 -- # return 0 00:04:43.550 04:11:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:43.550 04:11:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:43.550 04:11:20 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:43.550 04:11:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.550 04:11:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:43.808 { 00:04:43.808 "nbd_device": "/dev/nbd0", 00:04:43.808 "bdev_name": "Malloc0" 00:04:43.808 }, 00:04:43.808 { 00:04:43.808 "nbd_device": "/dev/nbd1", 00:04:43.808 "bdev_name": "Malloc1" 00:04:43.808 } 00:04:43.808 ]' 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:43.808 { 00:04:43.808 "nbd_device": "/dev/nbd0", 00:04:43.808 "bdev_name": "Malloc0" 00:04:43.808 }, 00:04:43.808 { 00:04:43.808 "nbd_device": "/dev/nbd1", 00:04:43.808 "bdev_name": "Malloc1" 00:04:43.808 } 00:04:43.808 ]' 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:43.808 /dev/nbd1' 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:43.808 /dev/nbd1' 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@65 -- # count=2 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@95 -- # count=2 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:43.808 256+0 records in 00:04:43.808 256+0 records out 00:04:43.808 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00510258 s, 205 MB/s 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:43.808 256+0 records in 00:04:43.808 256+0 records out 00:04:43.808 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023324 s, 45.0 MB/s 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:43.808 04:11:21 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:44.066 256+0 records in 00:04:44.066 256+0 records out 00:04:44.066 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220234 s, 47.6 MB/s 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@51 -- # local i 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:44.066 04:11:21 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@41 -- # break 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@45 -- # return 0 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:44.324 04:11:21 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@41 -- # break 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@45 -- # return 0 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:44.582 04:11:21 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@65 -- # true 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@65 -- # count=0 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@104 -- # count=0 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:44.840 04:11:21 -- bdev/nbd_common.sh@109 -- # return 0 00:04:44.840 04:11:21 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:45.097 04:11:22 -- event/event.sh@35 -- # sleep 3 00:04:45.356 [2024-11-28 04:11:22.535452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:45.356 [2024-11-28 04:11:22.650694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:45.356 [2024-11-28 04:11:22.650694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.614 [2024-11-28 04:11:22.713082] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:45.614 [2024-11-28 04:11:22.713163] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:48.140 04:11:25 -- event/event.sh@23 -- # for i in {0..2} 00:04:48.140 04:11:25 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:48.140 spdk_app_start Round 1 00:04:48.140 04:11:25 -- event/event.sh@25 -- # waitforlisten 3775427 /var/tmp/spdk-nbd.sock 00:04:48.140 04:11:25 -- common/autotest_common.sh@829 -- # '[' -z 3775427 ']' 00:04:48.140 04:11:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:48.140 04:11:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.140 04:11:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:48.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:48.140 04:11:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.140 04:11:25 -- common/autotest_common.sh@10 -- # set +x 00:04:48.397 04:11:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:48.397 04:11:25 -- common/autotest_common.sh@862 -- # return 0 00:04:48.397 04:11:25 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:48.655 Malloc0 00:04:48.655 04:11:25 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:48.913 Malloc1 00:04:48.913 04:11:26 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@12 -- # local i 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:48.913 04:11:26 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:49.171 /dev/nbd0 00:04:49.172 04:11:26 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:49.172 04:11:26 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:49.172 04:11:26 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:49.172 04:11:26 -- common/autotest_common.sh@867 -- # local i 00:04:49.172 04:11:26 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:49.172 04:11:26 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:49.172 04:11:26 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:49.172 04:11:26 -- common/autotest_common.sh@871 -- # break 00:04:49.172 04:11:26 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:49.172 04:11:26 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:49.172 04:11:26 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:49.172 1+0 records in 00:04:49.172 1+0 records out 00:04:49.172 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000178633 s, 22.9 MB/s 00:04:49.172 04:11:26 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.172 04:11:26 -- common/autotest_common.sh@884 -- # size=4096 00:04:49.172 04:11:26 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.172 04:11:26 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:49.172 04:11:26 -- common/autotest_common.sh@887 -- # return 0 00:04:49.172 04:11:26 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:49.172 04:11:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:49.172 04:11:26 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:49.430 /dev/nbd1 00:04:49.430 04:11:26 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:49.430 04:11:26 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:49.430 04:11:26 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:49.430 04:11:26 -- common/autotest_common.sh@867 -- # local i 00:04:49.430 04:11:26 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:49.430 04:11:26 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:49.430 04:11:26 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:49.430 04:11:26 -- common/autotest_common.sh@871 -- # break 00:04:49.430 04:11:26 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:49.430 04:11:26 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:49.430 04:11:26 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:49.430 1+0 records in 00:04:49.430 1+0 records out 00:04:49.430 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000195658 s, 20.9 MB/s 00:04:49.430 04:11:26 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.430 04:11:26 -- common/autotest_common.sh@884 -- # size=4096 00:04:49.430 04:11:26 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.430 04:11:26 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:49.430 04:11:26 -- common/autotest_common.sh@887 -- # return 0 00:04:49.430 04:11:26 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:49.430 04:11:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:49.430 04:11:26 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:49.430 04:11:26 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:49.430 04:11:26 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:49.689 { 00:04:49.689 "nbd_device": "/dev/nbd0", 00:04:49.689 "bdev_name": "Malloc0" 00:04:49.689 }, 00:04:49.689 { 00:04:49.689 "nbd_device": "/dev/nbd1", 00:04:49.689 "bdev_name": "Malloc1" 00:04:49.689 } 00:04:49.689 ]' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:49.689 { 00:04:49.689 "nbd_device": "/dev/nbd0", 00:04:49.689 "bdev_name": "Malloc0" 00:04:49.689 }, 00:04:49.689 { 00:04:49.689 "nbd_device": "/dev/nbd1", 00:04:49.689 "bdev_name": "Malloc1" 00:04:49.689 } 00:04:49.689 ]' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:49.689 /dev/nbd1' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:49.689 /dev/nbd1' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@65 -- # count=2 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@95 -- # count=2 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:49.689 256+0 records in 00:04:49.689 256+0 records out 00:04:49.689 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0051139 s, 205 MB/s 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:49.689 256+0 records in 00:04:49.689 256+0 records out 00:04:49.689 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194312 s, 54.0 MB/s 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:49.689 256+0 records in 00:04:49.689 256+0 records out 00:04:49.689 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234898 s, 44.6 MB/s 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:49.689 04:11:26 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:49.947 04:11:26 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:49.947 04:11:26 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:49.947 04:11:26 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:49.947 04:11:26 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:49.947 04:11:26 -- bdev/nbd_common.sh@51 -- # local i 00:04:49.947 04:11:26 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:49.947 04:11:26 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@41 -- # break 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@45 -- # return 0 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:50.205 04:11:27 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@41 -- # break 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@45 -- # return 0 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.463 04:11:27 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@65 -- # true 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@65 -- # count=0 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@104 -- # count=0 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:50.722 04:11:27 -- bdev/nbd_common.sh@109 -- # return 0 00:04:50.722 04:11:27 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:50.980 04:11:28 -- event/event.sh@35 -- # sleep 3 00:04:51.238 [2024-11-28 04:11:28.415039] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:51.238 [2024-11-28 04:11:28.530486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:51.238 [2024-11-28 04:11:28.530490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.495 [2024-11-28 04:11:28.592752] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:51.495 [2024-11-28 04:11:28.592844] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:54.022 04:11:31 -- event/event.sh@23 -- # for i in {0..2} 00:04:54.022 04:11:31 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:54.022 spdk_app_start Round 2 00:04:54.022 04:11:31 -- event/event.sh@25 -- # waitforlisten 3775427 /var/tmp/spdk-nbd.sock 00:04:54.022 04:11:31 -- common/autotest_common.sh@829 -- # '[' -z 3775427 ']' 00:04:54.022 04:11:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:54.022 04:11:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:54.022 04:11:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:54.022 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:54.022 04:11:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:54.022 04:11:31 -- common/autotest_common.sh@10 -- # set +x 00:04:54.279 04:11:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:54.279 04:11:31 -- common/autotest_common.sh@862 -- # return 0 00:04:54.279 04:11:31 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:54.538 Malloc0 00:04:54.538 04:11:31 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:54.796 Malloc1 00:04:54.796 04:11:31 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@12 -- # local i 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:54.796 04:11:31 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:55.054 /dev/nbd0 00:04:55.054 04:11:32 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:55.054 04:11:32 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:55.054 04:11:32 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:55.054 04:11:32 -- common/autotest_common.sh@867 -- # local i 00:04:55.054 04:11:32 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:55.054 04:11:32 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:55.054 04:11:32 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:55.054 04:11:32 -- common/autotest_common.sh@871 -- # break 00:04:55.054 04:11:32 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:55.054 04:11:32 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:55.054 04:11:32 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:55.054 1+0 records in 00:04:55.054 1+0 records out 00:04:55.054 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000218931 s, 18.7 MB/s 00:04:55.054 04:11:32 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.054 04:11:32 -- common/autotest_common.sh@884 -- # size=4096 00:04:55.054 04:11:32 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.054 04:11:32 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:55.054 04:11:32 -- common/autotest_common.sh@887 -- # return 0 00:04:55.054 04:11:32 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:55.054 04:11:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:55.054 04:11:32 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:55.312 /dev/nbd1 00:04:55.312 04:11:32 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:55.312 04:11:32 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:55.312 04:11:32 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:55.312 04:11:32 -- common/autotest_common.sh@867 -- # local i 00:04:55.312 04:11:32 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:55.312 04:11:32 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:55.312 04:11:32 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:55.312 04:11:32 -- common/autotest_common.sh@871 -- # break 00:04:55.312 04:11:32 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:55.312 04:11:32 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:55.312 04:11:32 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:55.312 1+0 records in 00:04:55.312 1+0 records out 00:04:55.312 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000211462 s, 19.4 MB/s 00:04:55.312 04:11:32 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.312 04:11:32 -- common/autotest_common.sh@884 -- # size=4096 00:04:55.312 04:11:32 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:55.312 04:11:32 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:55.312 04:11:32 -- common/autotest_common.sh@887 -- # return 0 00:04:55.312 04:11:32 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:55.312 04:11:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:55.312 04:11:32 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:55.312 04:11:32 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:55.312 04:11:32 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:55.570 { 00:04:55.570 "nbd_device": "/dev/nbd0", 00:04:55.570 "bdev_name": "Malloc0" 00:04:55.570 }, 00:04:55.570 { 00:04:55.570 "nbd_device": "/dev/nbd1", 00:04:55.570 "bdev_name": "Malloc1" 00:04:55.570 } 00:04:55.570 ]' 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:55.570 { 00:04:55.570 "nbd_device": "/dev/nbd0", 00:04:55.570 "bdev_name": "Malloc0" 00:04:55.570 }, 00:04:55.570 { 00:04:55.570 "nbd_device": "/dev/nbd1", 00:04:55.570 "bdev_name": "Malloc1" 00:04:55.570 } 00:04:55.570 ]' 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:55.570 /dev/nbd1' 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:55.570 /dev/nbd1' 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@65 -- # count=2 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@95 -- # count=2 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:55.570 04:11:32 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:55.571 256+0 records in 00:04:55.571 256+0 records out 00:04:55.571 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00383759 s, 273 MB/s 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:55.571 256+0 records in 00:04:55.571 256+0 records out 00:04:55.571 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226736 s, 46.2 MB/s 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:55.571 256+0 records in 00:04:55.571 256+0 records out 00:04:55.571 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209096 s, 50.1 MB/s 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@51 -- # local i 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:55.571 04:11:32 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:56.136 04:11:33 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:56.136 04:11:33 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@41 -- # break 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@45 -- # return 0 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@41 -- # break 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@45 -- # return 0 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.137 04:11:33 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:56.395 04:11:33 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:56.395 04:11:33 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:56.395 04:11:33 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@65 -- # true 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@65 -- # count=0 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@104 -- # count=0 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:56.653 04:11:33 -- bdev/nbd_common.sh@109 -- # return 0 00:04:56.653 04:11:33 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:56.910 04:11:33 -- event/event.sh@35 -- # sleep 3 00:04:57.168 [2024-11-28 04:11:34.255356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:57.168 [2024-11-28 04:11:34.369901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.168 [2024-11-28 04:11:34.369901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:57.168 [2024-11-28 04:11:34.431582] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:57.168 [2024-11-28 04:11:34.431656] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:59.767 04:11:36 -- event/event.sh@38 -- # waitforlisten 3775427 /var/tmp/spdk-nbd.sock 00:04:59.767 04:11:36 -- common/autotest_common.sh@829 -- # '[' -z 3775427 ']' 00:04:59.767 04:11:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:59.767 04:11:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:59.767 04:11:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:59.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:59.767 04:11:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:59.767 04:11:36 -- common/autotest_common.sh@10 -- # set +x 00:05:00.025 04:11:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:00.025 04:11:37 -- common/autotest_common.sh@862 -- # return 0 00:05:00.025 04:11:37 -- event/event.sh@39 -- # killprocess 3775427 00:05:00.025 04:11:37 -- common/autotest_common.sh@936 -- # '[' -z 3775427 ']' 00:05:00.025 04:11:37 -- common/autotest_common.sh@940 -- # kill -0 3775427 00:05:00.025 04:11:37 -- common/autotest_common.sh@941 -- # uname 00:05:00.025 04:11:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:00.025 04:11:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3775427 00:05:00.025 04:11:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:00.025 04:11:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:00.025 04:11:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3775427' 00:05:00.025 killing process with pid 3775427 00:05:00.025 04:11:37 -- common/autotest_common.sh@955 -- # kill 3775427 00:05:00.025 04:11:37 -- common/autotest_common.sh@960 -- # wait 3775427 00:05:00.283 spdk_app_start is called in Round 0. 00:05:00.283 Shutdown signal received, stop current app iteration 00:05:00.283 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:00.283 spdk_app_start is called in Round 1. 00:05:00.283 Shutdown signal received, stop current app iteration 00:05:00.283 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:00.283 spdk_app_start is called in Round 2. 00:05:00.283 Shutdown signal received, stop current app iteration 00:05:00.283 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:00.283 spdk_app_start is called in Round 3. 00:05:00.283 Shutdown signal received, stop current app iteration 00:05:00.283 04:11:37 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:00.283 04:11:37 -- event/event.sh@42 -- # return 0 00:05:00.283 00:05:00.283 real 0m18.927s 00:05:00.283 user 0m41.304s 00:05:00.283 sys 0m3.163s 00:05:00.283 04:11:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:00.283 04:11:37 -- common/autotest_common.sh@10 -- # set +x 00:05:00.283 ************************************ 00:05:00.283 END TEST app_repeat 00:05:00.283 ************************************ 00:05:00.283 04:11:37 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:00.283 04:11:37 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:00.283 04:11:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:00.283 04:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.283 04:11:37 -- common/autotest_common.sh@10 -- # set +x 00:05:00.283 ************************************ 00:05:00.283 START TEST cpu_locks 00:05:00.283 ************************************ 00:05:00.283 04:11:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:00.542 * Looking for test storage... 00:05:00.542 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:00.542 04:11:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:00.542 04:11:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:00.542 04:11:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:00.542 04:11:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:00.542 04:11:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:00.542 04:11:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:00.542 04:11:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:00.542 04:11:37 -- scripts/common.sh@335 -- # IFS=.-: 00:05:00.542 04:11:37 -- scripts/common.sh@335 -- # read -ra ver1 00:05:00.542 04:11:37 -- scripts/common.sh@336 -- # IFS=.-: 00:05:00.542 04:11:37 -- scripts/common.sh@336 -- # read -ra ver2 00:05:00.542 04:11:37 -- scripts/common.sh@337 -- # local 'op=<' 00:05:00.542 04:11:37 -- scripts/common.sh@339 -- # ver1_l=2 00:05:00.542 04:11:37 -- scripts/common.sh@340 -- # ver2_l=1 00:05:00.542 04:11:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:00.542 04:11:37 -- scripts/common.sh@343 -- # case "$op" in 00:05:00.542 04:11:37 -- scripts/common.sh@344 -- # : 1 00:05:00.542 04:11:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:00.542 04:11:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:00.542 04:11:37 -- scripts/common.sh@364 -- # decimal 1 00:05:00.542 04:11:37 -- scripts/common.sh@352 -- # local d=1 00:05:00.542 04:11:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:00.542 04:11:37 -- scripts/common.sh@354 -- # echo 1 00:05:00.542 04:11:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:00.542 04:11:37 -- scripts/common.sh@365 -- # decimal 2 00:05:00.542 04:11:37 -- scripts/common.sh@352 -- # local d=2 00:05:00.542 04:11:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:00.542 04:11:37 -- scripts/common.sh@354 -- # echo 2 00:05:00.542 04:11:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:00.542 04:11:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:00.542 04:11:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:00.542 04:11:37 -- scripts/common.sh@367 -- # return 0 00:05:00.542 04:11:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:00.542 04:11:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:00.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.542 --rc genhtml_branch_coverage=1 00:05:00.542 --rc genhtml_function_coverage=1 00:05:00.542 --rc genhtml_legend=1 00:05:00.542 --rc geninfo_all_blocks=1 00:05:00.542 --rc geninfo_unexecuted_blocks=1 00:05:00.542 00:05:00.542 ' 00:05:00.542 04:11:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:00.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.542 --rc genhtml_branch_coverage=1 00:05:00.542 --rc genhtml_function_coverage=1 00:05:00.542 --rc genhtml_legend=1 00:05:00.542 --rc geninfo_all_blocks=1 00:05:00.542 --rc geninfo_unexecuted_blocks=1 00:05:00.542 00:05:00.542 ' 00:05:00.542 04:11:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:00.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.542 --rc genhtml_branch_coverage=1 00:05:00.542 --rc genhtml_function_coverage=1 00:05:00.542 --rc genhtml_legend=1 00:05:00.542 --rc geninfo_all_blocks=1 00:05:00.542 --rc geninfo_unexecuted_blocks=1 00:05:00.542 00:05:00.542 ' 00:05:00.542 04:11:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:00.542 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:00.542 --rc genhtml_branch_coverage=1 00:05:00.542 --rc genhtml_function_coverage=1 00:05:00.542 --rc genhtml_legend=1 00:05:00.542 --rc geninfo_all_blocks=1 00:05:00.542 --rc geninfo_unexecuted_blocks=1 00:05:00.542 00:05:00.542 ' 00:05:00.542 04:11:37 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:00.542 04:11:37 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:00.542 04:11:37 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:00.542 04:11:37 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:00.542 04:11:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:00.542 04:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.542 04:11:37 -- common/autotest_common.sh@10 -- # set +x 00:05:00.542 ************************************ 00:05:00.542 START TEST default_locks 00:05:00.542 ************************************ 00:05:00.542 04:11:37 -- common/autotest_common.sh@1114 -- # default_locks 00:05:00.542 04:11:37 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3777980 00:05:00.542 04:11:37 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:00.542 04:11:37 -- event/cpu_locks.sh@47 -- # waitforlisten 3777980 00:05:00.542 04:11:37 -- common/autotest_common.sh@829 -- # '[' -z 3777980 ']' 00:05:00.542 04:11:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:00.542 04:11:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:00.542 04:11:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:00.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:00.542 04:11:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:00.542 04:11:37 -- common/autotest_common.sh@10 -- # set +x 00:05:00.542 [2024-11-28 04:11:37.749149] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:00.542 [2024-11-28 04:11:37.749250] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3777980 ] 00:05:00.542 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.542 [2024-11-28 04:11:37.806409] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.800 [2024-11-28 04:11:37.917575] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:00.800 [2024-11-28 04:11:37.917741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.735 04:11:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:01.735 04:11:38 -- common/autotest_common.sh@862 -- # return 0 00:05:01.735 04:11:38 -- event/cpu_locks.sh@49 -- # locks_exist 3777980 00:05:01.735 04:11:38 -- event/cpu_locks.sh@22 -- # lslocks -p 3777980 00:05:01.735 04:11:38 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:01.735 lslocks: write error 00:05:01.735 04:11:38 -- event/cpu_locks.sh@50 -- # killprocess 3777980 00:05:01.735 04:11:38 -- common/autotest_common.sh@936 -- # '[' -z 3777980 ']' 00:05:01.735 04:11:38 -- common/autotest_common.sh@940 -- # kill -0 3777980 00:05:01.735 04:11:38 -- common/autotest_common.sh@941 -- # uname 00:05:01.735 04:11:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:01.735 04:11:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3777980 00:05:01.735 04:11:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:01.735 04:11:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:01.735 04:11:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3777980' 00:05:01.735 killing process with pid 3777980 00:05:01.735 04:11:39 -- common/autotest_common.sh@955 -- # kill 3777980 00:05:01.735 04:11:39 -- common/autotest_common.sh@960 -- # wait 3777980 00:05:02.301 04:11:39 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3777980 00:05:02.301 04:11:39 -- common/autotest_common.sh@650 -- # local es=0 00:05:02.301 04:11:39 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3777980 00:05:02.301 04:11:39 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:02.301 04:11:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:02.301 04:11:39 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:02.301 04:11:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:02.301 04:11:39 -- common/autotest_common.sh@653 -- # waitforlisten 3777980 00:05:02.301 04:11:39 -- common/autotest_common.sh@829 -- # '[' -z 3777980 ']' 00:05:02.301 04:11:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:02.301 04:11:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.301 04:11:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:02.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:02.301 04:11:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.301 04:11:39 -- common/autotest_common.sh@10 -- # set +x 00:05:02.301 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3777980) - No such process 00:05:02.301 ERROR: process (pid: 3777980) is no longer running 00:05:02.301 04:11:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:02.301 04:11:39 -- common/autotest_common.sh@862 -- # return 1 00:05:02.301 04:11:39 -- common/autotest_common.sh@653 -- # es=1 00:05:02.301 04:11:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:02.301 04:11:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:02.301 04:11:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:02.301 04:11:39 -- event/cpu_locks.sh@54 -- # no_locks 00:05:02.301 04:11:39 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:02.301 04:11:39 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:02.301 04:11:39 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:02.301 00:05:02.301 real 0m1.744s 00:05:02.301 user 0m1.888s 00:05:02.301 sys 0m0.555s 00:05:02.301 04:11:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.301 04:11:39 -- common/autotest_common.sh@10 -- # set +x 00:05:02.301 ************************************ 00:05:02.301 END TEST default_locks 00:05:02.301 ************************************ 00:05:02.301 04:11:39 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:02.301 04:11:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.301 04:11:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.301 04:11:39 -- common/autotest_common.sh@10 -- # set +x 00:05:02.301 ************************************ 00:05:02.301 START TEST default_locks_via_rpc 00:05:02.301 ************************************ 00:05:02.301 04:11:39 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:02.301 04:11:39 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3778163 00:05:02.301 04:11:39 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:02.301 04:11:39 -- event/cpu_locks.sh@63 -- # waitforlisten 3778163 00:05:02.301 04:11:39 -- common/autotest_common.sh@829 -- # '[' -z 3778163 ']' 00:05:02.301 04:11:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:02.301 04:11:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.301 04:11:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:02.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:02.301 04:11:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.301 04:11:39 -- common/autotest_common.sh@10 -- # set +x 00:05:02.301 [2024-11-28 04:11:39.523481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:02.301 [2024-11-28 04:11:39.523619] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3778163 ] 00:05:02.301 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.301 [2024-11-28 04:11:39.585757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.559 [2024-11-28 04:11:39.697491] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:02.559 [2024-11-28 04:11:39.697682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.493 04:11:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:03.493 04:11:40 -- common/autotest_common.sh@862 -- # return 0 00:05:03.493 04:11:40 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:03.493 04:11:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:03.493 04:11:40 -- common/autotest_common.sh@10 -- # set +x 00:05:03.493 04:11:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:03.493 04:11:40 -- event/cpu_locks.sh@67 -- # no_locks 00:05:03.493 04:11:40 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:03.493 04:11:40 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:03.493 04:11:40 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:03.493 04:11:40 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:03.493 04:11:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:03.493 04:11:40 -- common/autotest_common.sh@10 -- # set +x 00:05:03.493 04:11:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:03.493 04:11:40 -- event/cpu_locks.sh@71 -- # locks_exist 3778163 00:05:03.493 04:11:40 -- event/cpu_locks.sh@22 -- # lslocks -p 3778163 00:05:03.493 04:11:40 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:03.493 04:11:40 -- event/cpu_locks.sh@73 -- # killprocess 3778163 00:05:03.493 04:11:40 -- common/autotest_common.sh@936 -- # '[' -z 3778163 ']' 00:05:03.493 04:11:40 -- common/autotest_common.sh@940 -- # kill -0 3778163 00:05:03.493 04:11:40 -- common/autotest_common.sh@941 -- # uname 00:05:03.493 04:11:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.493 04:11:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3778163 00:05:03.493 04:11:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.493 04:11:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.493 04:11:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3778163' 00:05:03.493 killing process with pid 3778163 00:05:03.493 04:11:40 -- common/autotest_common.sh@955 -- # kill 3778163 00:05:03.493 04:11:40 -- common/autotest_common.sh@960 -- # wait 3778163 00:05:04.058 00:05:04.058 real 0m1.771s 00:05:04.058 user 0m1.904s 00:05:04.058 sys 0m0.573s 00:05:04.058 04:11:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.058 04:11:41 -- common/autotest_common.sh@10 -- # set +x 00:05:04.058 ************************************ 00:05:04.058 END TEST default_locks_via_rpc 00:05:04.058 ************************************ 00:05:04.058 04:11:41 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:04.058 04:11:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.058 04:11:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.058 04:11:41 -- common/autotest_common.sh@10 -- # set +x 00:05:04.058 ************************************ 00:05:04.058 START TEST non_locking_app_on_locked_coremask 00:05:04.058 ************************************ 00:05:04.058 04:11:41 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:04.058 04:11:41 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3778452 00:05:04.058 04:11:41 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:04.058 04:11:41 -- event/cpu_locks.sh@81 -- # waitforlisten 3778452 /var/tmp/spdk.sock 00:05:04.058 04:11:41 -- common/autotest_common.sh@829 -- # '[' -z 3778452 ']' 00:05:04.058 04:11:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:04.058 04:11:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.058 04:11:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:04.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:04.058 04:11:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.058 04:11:41 -- common/autotest_common.sh@10 -- # set +x 00:05:04.058 [2024-11-28 04:11:41.321375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:04.058 [2024-11-28 04:11:41.321469] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3778452 ] 00:05:04.058 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.314 [2024-11-28 04:11:41.382502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.314 [2024-11-28 04:11:41.495648] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:04.314 [2024-11-28 04:11:41.495846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.244 04:11:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:05.244 04:11:42 -- common/autotest_common.sh@862 -- # return 0 00:05:05.244 04:11:42 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3778594 00:05:05.244 04:11:42 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:05.244 04:11:42 -- event/cpu_locks.sh@85 -- # waitforlisten 3778594 /var/tmp/spdk2.sock 00:05:05.244 04:11:42 -- common/autotest_common.sh@829 -- # '[' -z 3778594 ']' 00:05:05.244 04:11:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:05.244 04:11:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.244 04:11:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:05.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:05.244 04:11:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.244 04:11:42 -- common/autotest_common.sh@10 -- # set +x 00:05:05.244 [2024-11-28 04:11:42.319479] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.244 [2024-11-28 04:11:42.319578] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3778594 ] 00:05:05.244 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.244 [2024-11-28 04:11:42.412379] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:05.244 [2024-11-28 04:11:42.412420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.501 [2024-11-28 04:11:42.643492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.501 [2024-11-28 04:11:42.643707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.065 04:11:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:06.065 04:11:43 -- common/autotest_common.sh@862 -- # return 0 00:05:06.065 04:11:43 -- event/cpu_locks.sh@87 -- # locks_exist 3778452 00:05:06.065 04:11:43 -- event/cpu_locks.sh@22 -- # lslocks -p 3778452 00:05:06.065 04:11:43 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:06.322 lslocks: write error 00:05:06.322 04:11:43 -- event/cpu_locks.sh@89 -- # killprocess 3778452 00:05:06.322 04:11:43 -- common/autotest_common.sh@936 -- # '[' -z 3778452 ']' 00:05:06.322 04:11:43 -- common/autotest_common.sh@940 -- # kill -0 3778452 00:05:06.322 04:11:43 -- common/autotest_common.sh@941 -- # uname 00:05:06.322 04:11:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:06.322 04:11:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3778452 00:05:06.322 04:11:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:06.322 04:11:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:06.322 04:11:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3778452' 00:05:06.322 killing process with pid 3778452 00:05:06.322 04:11:43 -- common/autotest_common.sh@955 -- # kill 3778452 00:05:06.579 04:11:43 -- common/autotest_common.sh@960 -- # wait 3778452 00:05:07.512 04:11:44 -- event/cpu_locks.sh@90 -- # killprocess 3778594 00:05:07.512 04:11:44 -- common/autotest_common.sh@936 -- # '[' -z 3778594 ']' 00:05:07.512 04:11:44 -- common/autotest_common.sh@940 -- # kill -0 3778594 00:05:07.512 04:11:44 -- common/autotest_common.sh@941 -- # uname 00:05:07.512 04:11:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:07.512 04:11:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3778594 00:05:07.512 04:11:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:07.512 04:11:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:07.512 04:11:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3778594' 00:05:07.512 killing process with pid 3778594 00:05:07.512 04:11:44 -- common/autotest_common.sh@955 -- # kill 3778594 00:05:07.512 04:11:44 -- common/autotest_common.sh@960 -- # wait 3778594 00:05:07.770 00:05:07.770 real 0m3.754s 00:05:07.770 user 0m4.121s 00:05:07.770 sys 0m1.039s 00:05:07.770 04:11:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:07.770 04:11:45 -- common/autotest_common.sh@10 -- # set +x 00:05:07.770 ************************************ 00:05:07.770 END TEST non_locking_app_on_locked_coremask 00:05:07.770 ************************************ 00:05:07.770 04:11:45 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:07.770 04:11:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:07.770 04:11:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.770 04:11:45 -- common/autotest_common.sh@10 -- # set +x 00:05:07.770 ************************************ 00:05:07.770 START TEST locking_app_on_unlocked_coremask 00:05:07.770 ************************************ 00:05:07.770 04:11:45 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:07.770 04:11:45 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3778911 00:05:07.770 04:11:45 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:07.770 04:11:45 -- event/cpu_locks.sh@99 -- # waitforlisten 3778911 /var/tmp/spdk.sock 00:05:07.770 04:11:45 -- common/autotest_common.sh@829 -- # '[' -z 3778911 ']' 00:05:07.770 04:11:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:07.770 04:11:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:07.770 04:11:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:07.770 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:07.770 04:11:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:07.770 04:11:45 -- common/autotest_common.sh@10 -- # set +x 00:05:08.030 [2024-11-28 04:11:45.106042] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.030 [2024-11-28 04:11:45.106121] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3778911 ] 00:05:08.030 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.030 [2024-11-28 04:11:45.167400] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:08.030 [2024-11-28 04:11:45.167441] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.030 [2024-11-28 04:11:45.276769] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:08.030 [2024-11-28 04:11:45.276944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.964 04:11:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:08.964 04:11:46 -- common/autotest_common.sh@862 -- # return 0 00:05:08.964 04:11:46 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3779051 00:05:08.964 04:11:46 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:08.964 04:11:46 -- event/cpu_locks.sh@103 -- # waitforlisten 3779051 /var/tmp/spdk2.sock 00:05:08.964 04:11:46 -- common/autotest_common.sh@829 -- # '[' -z 3779051 ']' 00:05:08.964 04:11:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:08.964 04:11:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.964 04:11:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:08.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:08.964 04:11:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.964 04:11:46 -- common/autotest_common.sh@10 -- # set +x 00:05:08.964 [2024-11-28 04:11:46.120139] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.965 [2024-11-28 04:11:46.120207] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3779051 ] 00:05:08.965 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.965 [2024-11-28 04:11:46.209794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.222 [2024-11-28 04:11:46.445429] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.222 [2024-11-28 04:11:46.445631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.787 04:11:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:09.787 04:11:47 -- common/autotest_common.sh@862 -- # return 0 00:05:09.787 04:11:47 -- event/cpu_locks.sh@105 -- # locks_exist 3779051 00:05:09.787 04:11:47 -- event/cpu_locks.sh@22 -- # lslocks -p 3779051 00:05:09.787 04:11:47 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:10.351 lslocks: write error 00:05:10.351 04:11:47 -- event/cpu_locks.sh@107 -- # killprocess 3778911 00:05:10.351 04:11:47 -- common/autotest_common.sh@936 -- # '[' -z 3778911 ']' 00:05:10.351 04:11:47 -- common/autotest_common.sh@940 -- # kill -0 3778911 00:05:10.352 04:11:47 -- common/autotest_common.sh@941 -- # uname 00:05:10.352 04:11:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.352 04:11:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3778911 00:05:10.352 04:11:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.352 04:11:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.352 04:11:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3778911' 00:05:10.352 killing process with pid 3778911 00:05:10.352 04:11:47 -- common/autotest_common.sh@955 -- # kill 3778911 00:05:10.352 04:11:47 -- common/autotest_common.sh@960 -- # wait 3778911 00:05:11.284 04:11:48 -- event/cpu_locks.sh@108 -- # killprocess 3779051 00:05:11.284 04:11:48 -- common/autotest_common.sh@936 -- # '[' -z 3779051 ']' 00:05:11.284 04:11:48 -- common/autotest_common.sh@940 -- # kill -0 3779051 00:05:11.284 04:11:48 -- common/autotest_common.sh@941 -- # uname 00:05:11.284 04:11:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:11.284 04:11:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3779051 00:05:11.284 04:11:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:11.284 04:11:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:11.284 04:11:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3779051' 00:05:11.284 killing process with pid 3779051 00:05:11.284 04:11:48 -- common/autotest_common.sh@955 -- # kill 3779051 00:05:11.284 04:11:48 -- common/autotest_common.sh@960 -- # wait 3779051 00:05:11.543 00:05:11.543 real 0m3.787s 00:05:11.543 user 0m4.158s 00:05:11.543 sys 0m1.050s 00:05:11.543 04:11:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.543 04:11:48 -- common/autotest_common.sh@10 -- # set +x 00:05:11.543 ************************************ 00:05:11.543 END TEST locking_app_on_unlocked_coremask 00:05:11.543 ************************************ 00:05:11.802 04:11:48 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:11.802 04:11:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.802 04:11:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.802 04:11:48 -- common/autotest_common.sh@10 -- # set +x 00:05:11.802 ************************************ 00:05:11.802 START TEST locking_app_on_locked_coremask 00:05:11.802 ************************************ 00:05:11.802 04:11:48 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:11.802 04:11:48 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3779462 00:05:11.802 04:11:48 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:11.802 04:11:48 -- event/cpu_locks.sh@116 -- # waitforlisten 3779462 /var/tmp/spdk.sock 00:05:11.802 04:11:48 -- common/autotest_common.sh@829 -- # '[' -z 3779462 ']' 00:05:11.802 04:11:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.802 04:11:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.802 04:11:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.802 04:11:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.802 04:11:48 -- common/autotest_common.sh@10 -- # set +x 00:05:11.802 [2024-11-28 04:11:48.920805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.802 [2024-11-28 04:11:48.920901] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3779462 ] 00:05:11.802 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.802 [2024-11-28 04:11:48.980356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.802 [2024-11-28 04:11:49.094392] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.802 [2024-11-28 04:11:49.094572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.735 04:11:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.735 04:11:49 -- common/autotest_common.sh@862 -- # return 0 00:05:12.735 04:11:49 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3779504 00:05:12.735 04:11:49 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:12.735 04:11:49 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3779504 /var/tmp/spdk2.sock 00:05:12.735 04:11:49 -- common/autotest_common.sh@650 -- # local es=0 00:05:12.735 04:11:49 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3779504 /var/tmp/spdk2.sock 00:05:12.735 04:11:49 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:12.735 04:11:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.735 04:11:49 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:12.735 04:11:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.735 04:11:49 -- common/autotest_common.sh@653 -- # waitforlisten 3779504 /var/tmp/spdk2.sock 00:05:12.735 04:11:49 -- common/autotest_common.sh@829 -- # '[' -z 3779504 ']' 00:05:12.735 04:11:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:12.735 04:11:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.735 04:11:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:12.735 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:12.735 04:11:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.735 04:11:49 -- common/autotest_common.sh@10 -- # set +x 00:05:12.735 [2024-11-28 04:11:49.918897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.735 [2024-11-28 04:11:49.918966] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3779504 ] 00:05:12.735 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.735 [2024-11-28 04:11:50.015155] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3779462 has claimed it. 00:05:12.735 [2024-11-28 04:11:50.015232] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:13.670 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3779504) - No such process 00:05:13.670 ERROR: process (pid: 3779504) is no longer running 00:05:13.670 04:11:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.670 04:11:50 -- common/autotest_common.sh@862 -- # return 1 00:05:13.670 04:11:50 -- common/autotest_common.sh@653 -- # es=1 00:05:13.670 04:11:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:13.670 04:11:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:13.670 04:11:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:13.670 04:11:50 -- event/cpu_locks.sh@122 -- # locks_exist 3779462 00:05:13.670 04:11:50 -- event/cpu_locks.sh@22 -- # lslocks -p 3779462 00:05:13.670 04:11:50 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:13.670 lslocks: write error 00:05:13.670 04:11:50 -- event/cpu_locks.sh@124 -- # killprocess 3779462 00:05:13.670 04:11:50 -- common/autotest_common.sh@936 -- # '[' -z 3779462 ']' 00:05:13.670 04:11:50 -- common/autotest_common.sh@940 -- # kill -0 3779462 00:05:13.670 04:11:50 -- common/autotest_common.sh@941 -- # uname 00:05:13.670 04:11:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.670 04:11:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3779462 00:05:13.670 04:11:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.670 04:11:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.670 04:11:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3779462' 00:05:13.670 killing process with pid 3779462 00:05:13.670 04:11:50 -- common/autotest_common.sh@955 -- # kill 3779462 00:05:13.670 04:11:50 -- common/autotest_common.sh@960 -- # wait 3779462 00:05:14.236 00:05:14.236 real 0m2.492s 00:05:14.236 user 0m2.890s 00:05:14.236 sys 0m0.639s 00:05:14.236 04:11:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.236 04:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:14.236 ************************************ 00:05:14.236 END TEST locking_app_on_locked_coremask 00:05:14.236 ************************************ 00:05:14.236 04:11:51 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:14.236 04:11:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.236 04:11:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.236 04:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:14.236 ************************************ 00:05:14.236 START TEST locking_overlapped_coremask 00:05:14.236 ************************************ 00:05:14.236 04:11:51 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:14.236 04:11:51 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3779795 00:05:14.236 04:11:51 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:14.236 04:11:51 -- event/cpu_locks.sh@133 -- # waitforlisten 3779795 /var/tmp/spdk.sock 00:05:14.236 04:11:51 -- common/autotest_common.sh@829 -- # '[' -z 3779795 ']' 00:05:14.236 04:11:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.236 04:11:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.236 04:11:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.236 04:11:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.236 04:11:51 -- common/autotest_common.sh@10 -- # set +x 00:05:14.236 [2024-11-28 04:11:51.441392] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.236 [2024-11-28 04:11:51.441502] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3779795 ] 00:05:14.236 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.236 [2024-11-28 04:11:51.502963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:14.494 [2024-11-28 04:11:51.616899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.494 [2024-11-28 04:11:51.617131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:14.494 [2024-11-28 04:11:51.617199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:14.494 [2024-11-28 04:11:51.617201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.428 04:11:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.428 04:11:52 -- common/autotest_common.sh@862 -- # return 0 00:05:15.428 04:11:52 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3779937 00:05:15.428 04:11:52 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3779937 /var/tmp/spdk2.sock 00:05:15.428 04:11:52 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:15.428 04:11:52 -- common/autotest_common.sh@650 -- # local es=0 00:05:15.428 04:11:52 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3779937 /var/tmp/spdk2.sock 00:05:15.428 04:11:52 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:15.428 04:11:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.428 04:11:52 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:15.428 04:11:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:15.428 04:11:52 -- common/autotest_common.sh@653 -- # waitforlisten 3779937 /var/tmp/spdk2.sock 00:05:15.428 04:11:52 -- common/autotest_common.sh@829 -- # '[' -z 3779937 ']' 00:05:15.428 04:11:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:15.428 04:11:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.428 04:11:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:15.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:15.428 04:11:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.428 04:11:52 -- common/autotest_common.sh@10 -- # set +x 00:05:15.428 [2024-11-28 04:11:52.450501] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.428 [2024-11-28 04:11:52.450621] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3779937 ] 00:05:15.428 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.428 [2024-11-28 04:11:52.536624] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3779795 has claimed it. 00:05:15.428 [2024-11-28 04:11:52.536696] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:15.993 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3779937) - No such process 00:05:15.993 ERROR: process (pid: 3779937) is no longer running 00:05:15.993 04:11:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.993 04:11:53 -- common/autotest_common.sh@862 -- # return 1 00:05:15.993 04:11:53 -- common/autotest_common.sh@653 -- # es=1 00:05:15.993 04:11:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:15.993 04:11:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:15.993 04:11:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:15.993 04:11:53 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:15.993 04:11:53 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:15.993 04:11:53 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:15.993 04:11:53 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:15.993 04:11:53 -- event/cpu_locks.sh@141 -- # killprocess 3779795 00:05:15.993 04:11:53 -- common/autotest_common.sh@936 -- # '[' -z 3779795 ']' 00:05:15.993 04:11:53 -- common/autotest_common.sh@940 -- # kill -0 3779795 00:05:15.993 04:11:53 -- common/autotest_common.sh@941 -- # uname 00:05:15.993 04:11:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.993 04:11:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3779795 00:05:15.993 04:11:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.993 04:11:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.993 04:11:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3779795' 00:05:15.993 killing process with pid 3779795 00:05:15.993 04:11:53 -- common/autotest_common.sh@955 -- # kill 3779795 00:05:15.993 04:11:53 -- common/autotest_common.sh@960 -- # wait 3779795 00:05:16.559 00:05:16.559 real 0m2.246s 00:05:16.559 user 0m6.334s 00:05:16.559 sys 0m0.503s 00:05:16.559 04:11:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.559 04:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:16.559 ************************************ 00:05:16.559 END TEST locking_overlapped_coremask 00:05:16.559 ************************************ 00:05:16.559 04:11:53 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:16.559 04:11:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:16.559 04:11:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:16.559 04:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:16.559 ************************************ 00:05:16.559 START TEST locking_overlapped_coremask_via_rpc 00:05:16.559 ************************************ 00:05:16.559 04:11:53 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:16.559 04:11:53 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3780101 00:05:16.559 04:11:53 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:16.559 04:11:53 -- event/cpu_locks.sh@149 -- # waitforlisten 3780101 /var/tmp/spdk.sock 00:05:16.559 04:11:53 -- common/autotest_common.sh@829 -- # '[' -z 3780101 ']' 00:05:16.560 04:11:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.560 04:11:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.560 04:11:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.560 04:11:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.560 04:11:53 -- common/autotest_common.sh@10 -- # set +x 00:05:16.560 [2024-11-28 04:11:53.715934] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.560 [2024-11-28 04:11:53.716043] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3780101 ] 00:05:16.560 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.560 [2024-11-28 04:11:53.777631] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:16.560 [2024-11-28 04:11:53.777672] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:16.818 [2024-11-28 04:11:53.890218] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.818 [2024-11-28 04:11:53.890452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:16.818 [2024-11-28 04:11:53.890545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:16.818 [2024-11-28 04:11:53.890550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.383 04:11:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:17.383 04:11:54 -- common/autotest_common.sh@862 -- # return 0 00:05:17.383 04:11:54 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3780245 00:05:17.383 04:11:54 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:17.383 04:11:54 -- event/cpu_locks.sh@153 -- # waitforlisten 3780245 /var/tmp/spdk2.sock 00:05:17.383 04:11:54 -- common/autotest_common.sh@829 -- # '[' -z 3780245 ']' 00:05:17.383 04:11:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:17.383 04:11:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:17.384 04:11:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:17.384 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:17.384 04:11:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:17.384 04:11:54 -- common/autotest_common.sh@10 -- # set +x 00:05:17.641 [2024-11-28 04:11:54.721981] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.641 [2024-11-28 04:11:54.722073] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3780245 ] 00:05:17.641 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.642 [2024-11-28 04:11:54.810766] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:17.642 [2024-11-28 04:11:54.810810] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:17.899 [2024-11-28 04:11:55.025115] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.899 [2024-11-28 04:11:55.025364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:17.899 [2024-11-28 04:11:55.028584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:17.899 [2024-11-28 04:11:55.028586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:18.465 04:11:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.465 04:11:55 -- common/autotest_common.sh@862 -- # return 0 00:05:18.465 04:11:55 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:18.465 04:11:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:18.465 04:11:55 -- common/autotest_common.sh@10 -- # set +x 00:05:18.465 04:11:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:18.465 04:11:55 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:18.465 04:11:55 -- common/autotest_common.sh@650 -- # local es=0 00:05:18.465 04:11:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:18.465 04:11:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:18.465 04:11:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:18.465 04:11:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:18.465 04:11:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:18.465 04:11:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:18.465 04:11:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:18.465 04:11:55 -- common/autotest_common.sh@10 -- # set +x 00:05:18.465 [2024-11-28 04:11:55.704617] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3780101 has claimed it. 00:05:18.465 request: 00:05:18.465 { 00:05:18.465 "method": "framework_enable_cpumask_locks", 00:05:18.465 "req_id": 1 00:05:18.465 } 00:05:18.465 Got JSON-RPC error response 00:05:18.465 response: 00:05:18.465 { 00:05:18.465 "code": -32603, 00:05:18.465 "message": "Failed to claim CPU core: 2" 00:05:18.465 } 00:05:18.465 04:11:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:18.465 04:11:55 -- common/autotest_common.sh@653 -- # es=1 00:05:18.465 04:11:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:18.465 04:11:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:18.465 04:11:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:18.465 04:11:55 -- event/cpu_locks.sh@158 -- # waitforlisten 3780101 /var/tmp/spdk.sock 00:05:18.465 04:11:55 -- common/autotest_common.sh@829 -- # '[' -z 3780101 ']' 00:05:18.465 04:11:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.465 04:11:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.465 04:11:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.465 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.465 04:11:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.465 04:11:55 -- common/autotest_common.sh@10 -- # set +x 00:05:18.723 04:11:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.723 04:11:55 -- common/autotest_common.sh@862 -- # return 0 00:05:18.723 04:11:55 -- event/cpu_locks.sh@159 -- # waitforlisten 3780245 /var/tmp/spdk2.sock 00:05:18.723 04:11:55 -- common/autotest_common.sh@829 -- # '[' -z 3780245 ']' 00:05:18.723 04:11:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:18.723 04:11:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.723 04:11:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:18.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:18.723 04:11:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.723 04:11:55 -- common/autotest_common.sh@10 -- # set +x 00:05:18.982 04:11:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.982 04:11:56 -- common/autotest_common.sh@862 -- # return 0 00:05:18.982 04:11:56 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:18.982 04:11:56 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:18.982 04:11:56 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:18.982 04:11:56 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:18.982 00:05:18.982 real 0m2.545s 00:05:18.982 user 0m1.273s 00:05:18.982 sys 0m0.200s 00:05:18.982 04:11:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.982 04:11:56 -- common/autotest_common.sh@10 -- # set +x 00:05:18.982 ************************************ 00:05:18.982 END TEST locking_overlapped_coremask_via_rpc 00:05:18.982 ************************************ 00:05:18.982 04:11:56 -- event/cpu_locks.sh@174 -- # cleanup 00:05:18.982 04:11:56 -- event/cpu_locks.sh@15 -- # [[ -z 3780101 ]] 00:05:18.982 04:11:56 -- event/cpu_locks.sh@15 -- # killprocess 3780101 00:05:18.982 04:11:56 -- common/autotest_common.sh@936 -- # '[' -z 3780101 ']' 00:05:18.982 04:11:56 -- common/autotest_common.sh@940 -- # kill -0 3780101 00:05:18.982 04:11:56 -- common/autotest_common.sh@941 -- # uname 00:05:18.982 04:11:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.982 04:11:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3780101 00:05:18.982 04:11:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.982 04:11:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.982 04:11:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3780101' 00:05:18.982 killing process with pid 3780101 00:05:18.982 04:11:56 -- common/autotest_common.sh@955 -- # kill 3780101 00:05:18.982 04:11:56 -- common/autotest_common.sh@960 -- # wait 3780101 00:05:19.550 04:11:56 -- event/cpu_locks.sh@16 -- # [[ -z 3780245 ]] 00:05:19.550 04:11:56 -- event/cpu_locks.sh@16 -- # killprocess 3780245 00:05:19.550 04:11:56 -- common/autotest_common.sh@936 -- # '[' -z 3780245 ']' 00:05:19.550 04:11:56 -- common/autotest_common.sh@940 -- # kill -0 3780245 00:05:19.550 04:11:56 -- common/autotest_common.sh@941 -- # uname 00:05:19.550 04:11:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:19.550 04:11:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3780245 00:05:19.550 04:11:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:19.550 04:11:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:19.550 04:11:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3780245' 00:05:19.550 killing process with pid 3780245 00:05:19.550 04:11:56 -- common/autotest_common.sh@955 -- # kill 3780245 00:05:19.550 04:11:56 -- common/autotest_common.sh@960 -- # wait 3780245 00:05:20.116 04:11:57 -- event/cpu_locks.sh@18 -- # rm -f 00:05:20.116 04:11:57 -- event/cpu_locks.sh@1 -- # cleanup 00:05:20.116 04:11:57 -- event/cpu_locks.sh@15 -- # [[ -z 3780101 ]] 00:05:20.116 04:11:57 -- event/cpu_locks.sh@15 -- # killprocess 3780101 00:05:20.116 04:11:57 -- common/autotest_common.sh@936 -- # '[' -z 3780101 ']' 00:05:20.116 04:11:57 -- common/autotest_common.sh@940 -- # kill -0 3780101 00:05:20.116 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3780101) - No such process 00:05:20.116 04:11:57 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3780101 is not found' 00:05:20.116 Process with pid 3780101 is not found 00:05:20.116 04:11:57 -- event/cpu_locks.sh@16 -- # [[ -z 3780245 ]] 00:05:20.116 04:11:57 -- event/cpu_locks.sh@16 -- # killprocess 3780245 00:05:20.116 04:11:57 -- common/autotest_common.sh@936 -- # '[' -z 3780245 ']' 00:05:20.116 04:11:57 -- common/autotest_common.sh@940 -- # kill -0 3780245 00:05:20.116 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3780245) - No such process 00:05:20.116 04:11:57 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3780245 is not found' 00:05:20.116 Process with pid 3780245 is not found 00:05:20.116 04:11:57 -- event/cpu_locks.sh@18 -- # rm -f 00:05:20.116 00:05:20.116 real 0m19.655s 00:05:20.116 user 0m35.398s 00:05:20.116 sys 0m5.403s 00:05:20.116 04:11:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.116 04:11:57 -- common/autotest_common.sh@10 -- # set +x 00:05:20.116 ************************************ 00:05:20.116 END TEST cpu_locks 00:05:20.116 ************************************ 00:05:20.116 00:05:20.116 real 0m46.771s 00:05:20.116 user 1m29.498s 00:05:20.116 sys 0m9.320s 00:05:20.116 04:11:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.116 04:11:57 -- common/autotest_common.sh@10 -- # set +x 00:05:20.116 ************************************ 00:05:20.116 END TEST event 00:05:20.116 ************************************ 00:05:20.116 04:11:57 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:20.116 04:11:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.116 04:11:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.116 04:11:57 -- common/autotest_common.sh@10 -- # set +x 00:05:20.116 ************************************ 00:05:20.116 START TEST thread 00:05:20.116 ************************************ 00:05:20.116 04:11:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:20.116 * Looking for test storage... 00:05:20.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:20.116 04:11:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:20.116 04:11:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:20.116 04:11:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:20.116 04:11:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:20.116 04:11:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:20.116 04:11:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:20.116 04:11:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:20.116 04:11:57 -- scripts/common.sh@335 -- # IFS=.-: 00:05:20.116 04:11:57 -- scripts/common.sh@335 -- # read -ra ver1 00:05:20.116 04:11:57 -- scripts/common.sh@336 -- # IFS=.-: 00:05:20.116 04:11:57 -- scripts/common.sh@336 -- # read -ra ver2 00:05:20.116 04:11:57 -- scripts/common.sh@337 -- # local 'op=<' 00:05:20.116 04:11:57 -- scripts/common.sh@339 -- # ver1_l=2 00:05:20.116 04:11:57 -- scripts/common.sh@340 -- # ver2_l=1 00:05:20.116 04:11:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:20.116 04:11:57 -- scripts/common.sh@343 -- # case "$op" in 00:05:20.116 04:11:57 -- scripts/common.sh@344 -- # : 1 00:05:20.116 04:11:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:20.116 04:11:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:20.116 04:11:57 -- scripts/common.sh@364 -- # decimal 1 00:05:20.116 04:11:57 -- scripts/common.sh@352 -- # local d=1 00:05:20.116 04:11:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:20.116 04:11:57 -- scripts/common.sh@354 -- # echo 1 00:05:20.116 04:11:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:20.116 04:11:57 -- scripts/common.sh@365 -- # decimal 2 00:05:20.116 04:11:57 -- scripts/common.sh@352 -- # local d=2 00:05:20.116 04:11:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:20.116 04:11:57 -- scripts/common.sh@354 -- # echo 2 00:05:20.116 04:11:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:20.116 04:11:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:20.116 04:11:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:20.116 04:11:57 -- scripts/common.sh@367 -- # return 0 00:05:20.116 04:11:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:20.116 04:11:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:20.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.116 --rc genhtml_branch_coverage=1 00:05:20.116 --rc genhtml_function_coverage=1 00:05:20.116 --rc genhtml_legend=1 00:05:20.116 --rc geninfo_all_blocks=1 00:05:20.116 --rc geninfo_unexecuted_blocks=1 00:05:20.116 00:05:20.116 ' 00:05:20.116 04:11:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:20.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.116 --rc genhtml_branch_coverage=1 00:05:20.116 --rc genhtml_function_coverage=1 00:05:20.116 --rc genhtml_legend=1 00:05:20.116 --rc geninfo_all_blocks=1 00:05:20.116 --rc geninfo_unexecuted_blocks=1 00:05:20.116 00:05:20.116 ' 00:05:20.116 04:11:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:20.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.116 --rc genhtml_branch_coverage=1 00:05:20.116 --rc genhtml_function_coverage=1 00:05:20.116 --rc genhtml_legend=1 00:05:20.117 --rc geninfo_all_blocks=1 00:05:20.117 --rc geninfo_unexecuted_blocks=1 00:05:20.117 00:05:20.117 ' 00:05:20.117 04:11:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:20.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.117 --rc genhtml_branch_coverage=1 00:05:20.117 --rc genhtml_function_coverage=1 00:05:20.117 --rc genhtml_legend=1 00:05:20.117 --rc geninfo_all_blocks=1 00:05:20.117 --rc geninfo_unexecuted_blocks=1 00:05:20.117 00:05:20.117 ' 00:05:20.117 04:11:57 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:20.117 04:11:57 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:20.117 04:11:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.117 04:11:57 -- common/autotest_common.sh@10 -- # set +x 00:05:20.117 ************************************ 00:05:20.117 START TEST thread_poller_perf 00:05:20.117 ************************************ 00:05:20.117 04:11:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:20.117 [2024-11-28 04:11:57.417699] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.117 [2024-11-28 04:11:57.417776] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3780630 ] 00:05:20.375 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.375 [2024-11-28 04:11:57.480741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.375 [2024-11-28 04:11:57.598680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.375 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:21.750 [2024-11-28T03:11:59.061Z] ====================================== 00:05:21.750 [2024-11-28T03:11:59.061Z] busy:2709468894 (cyc) 00:05:21.750 [2024-11-28T03:11:59.061Z] total_run_count: 279000 00:05:21.750 [2024-11-28T03:11:59.061Z] tsc_hz: 2700000000 (cyc) 00:05:21.750 [2024-11-28T03:11:59.061Z] ====================================== 00:05:21.750 [2024-11-28T03:11:59.061Z] poller_cost: 9711 (cyc), 3596 (nsec) 00:05:21.750 00:05:21.750 real 0m1.326s 00:05:21.750 user 0m1.230s 00:05:21.750 sys 0m0.090s 00:05:21.750 04:11:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.750 04:11:58 -- common/autotest_common.sh@10 -- # set +x 00:05:21.750 ************************************ 00:05:21.750 END TEST thread_poller_perf 00:05:21.750 ************************************ 00:05:21.750 04:11:58 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:21.750 04:11:58 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:21.750 04:11:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.750 04:11:58 -- common/autotest_common.sh@10 -- # set +x 00:05:21.750 ************************************ 00:05:21.750 START TEST thread_poller_perf 00:05:21.750 ************************************ 00:05:21.750 04:11:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:21.750 [2024-11-28 04:11:58.770929] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.750 [2024-11-28 04:11:58.771006] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3780786 ] 00:05:21.750 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.750 [2024-11-28 04:11:58.833768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.750 [2024-11-28 04:11:58.950015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.750 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:23.144 [2024-11-28T03:12:00.455Z] ====================================== 00:05:23.144 [2024-11-28T03:12:00.455Z] busy:2703665885 (cyc) 00:05:23.144 [2024-11-28T03:12:00.455Z] total_run_count: 3822000 00:05:23.144 [2024-11-28T03:12:00.455Z] tsc_hz: 2700000000 (cyc) 00:05:23.144 [2024-11-28T03:12:00.455Z] ====================================== 00:05:23.144 [2024-11-28T03:12:00.455Z] poller_cost: 707 (cyc), 261 (nsec) 00:05:23.144 00:05:23.144 real 0m1.316s 00:05:23.144 user 0m1.222s 00:05:23.144 sys 0m0.086s 00:05:23.144 04:12:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.144 04:12:00 -- common/autotest_common.sh@10 -- # set +x 00:05:23.144 ************************************ 00:05:23.144 END TEST thread_poller_perf 00:05:23.144 ************************************ 00:05:23.144 04:12:00 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:23.144 00:05:23.144 real 0m2.831s 00:05:23.144 user 0m2.566s 00:05:23.144 sys 0m0.270s 00:05:23.144 04:12:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.144 04:12:00 -- common/autotest_common.sh@10 -- # set +x 00:05:23.144 ************************************ 00:05:23.144 END TEST thread 00:05:23.144 ************************************ 00:05:23.144 04:12:00 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:23.144 04:12:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:23.144 04:12:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.144 04:12:00 -- common/autotest_common.sh@10 -- # set +x 00:05:23.144 ************************************ 00:05:23.144 START TEST accel 00:05:23.144 ************************************ 00:05:23.144 04:12:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:23.144 * Looking for test storage... 00:05:23.144 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:23.144 04:12:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:23.144 04:12:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:23.144 04:12:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:23.144 04:12:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:23.144 04:12:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:23.144 04:12:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:23.144 04:12:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:23.144 04:12:00 -- scripts/common.sh@335 -- # IFS=.-: 00:05:23.144 04:12:00 -- scripts/common.sh@335 -- # read -ra ver1 00:05:23.144 04:12:00 -- scripts/common.sh@336 -- # IFS=.-: 00:05:23.144 04:12:00 -- scripts/common.sh@336 -- # read -ra ver2 00:05:23.144 04:12:00 -- scripts/common.sh@337 -- # local 'op=<' 00:05:23.144 04:12:00 -- scripts/common.sh@339 -- # ver1_l=2 00:05:23.144 04:12:00 -- scripts/common.sh@340 -- # ver2_l=1 00:05:23.144 04:12:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:23.144 04:12:00 -- scripts/common.sh@343 -- # case "$op" in 00:05:23.144 04:12:00 -- scripts/common.sh@344 -- # : 1 00:05:23.144 04:12:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:23.144 04:12:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:23.144 04:12:00 -- scripts/common.sh@364 -- # decimal 1 00:05:23.144 04:12:00 -- scripts/common.sh@352 -- # local d=1 00:05:23.144 04:12:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:23.144 04:12:00 -- scripts/common.sh@354 -- # echo 1 00:05:23.144 04:12:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:23.144 04:12:00 -- scripts/common.sh@365 -- # decimal 2 00:05:23.144 04:12:00 -- scripts/common.sh@352 -- # local d=2 00:05:23.144 04:12:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:23.144 04:12:00 -- scripts/common.sh@354 -- # echo 2 00:05:23.144 04:12:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:23.145 04:12:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:23.145 04:12:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:23.145 04:12:00 -- scripts/common.sh@367 -- # return 0 00:05:23.145 04:12:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:23.145 04:12:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:23.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.145 --rc genhtml_branch_coverage=1 00:05:23.145 --rc genhtml_function_coverage=1 00:05:23.145 --rc genhtml_legend=1 00:05:23.145 --rc geninfo_all_blocks=1 00:05:23.145 --rc geninfo_unexecuted_blocks=1 00:05:23.145 00:05:23.145 ' 00:05:23.145 04:12:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:23.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.145 --rc genhtml_branch_coverage=1 00:05:23.145 --rc genhtml_function_coverage=1 00:05:23.145 --rc genhtml_legend=1 00:05:23.145 --rc geninfo_all_blocks=1 00:05:23.145 --rc geninfo_unexecuted_blocks=1 00:05:23.145 00:05:23.145 ' 00:05:23.145 04:12:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:23.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.145 --rc genhtml_branch_coverage=1 00:05:23.145 --rc genhtml_function_coverage=1 00:05:23.145 --rc genhtml_legend=1 00:05:23.145 --rc geninfo_all_blocks=1 00:05:23.145 --rc geninfo_unexecuted_blocks=1 00:05:23.145 00:05:23.145 ' 00:05:23.145 04:12:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:23.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.145 --rc genhtml_branch_coverage=1 00:05:23.145 --rc genhtml_function_coverage=1 00:05:23.145 --rc genhtml_legend=1 00:05:23.145 --rc geninfo_all_blocks=1 00:05:23.145 --rc geninfo_unexecuted_blocks=1 00:05:23.145 00:05:23.145 ' 00:05:23.145 04:12:00 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:23.145 04:12:00 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:23.145 04:12:00 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:23.145 04:12:00 -- accel/accel.sh@59 -- # spdk_tgt_pid=3781145 00:05:23.145 04:12:00 -- accel/accel.sh@60 -- # waitforlisten 3781145 00:05:23.145 04:12:00 -- common/autotest_common.sh@829 -- # '[' -z 3781145 ']' 00:05:23.145 04:12:00 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:23.145 04:12:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:23.145 04:12:00 -- accel/accel.sh@58 -- # build_accel_config 00:05:23.145 04:12:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.145 04:12:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:23.145 04:12:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:23.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:23.145 04:12:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:23.145 04:12:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.145 04:12:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:23.145 04:12:00 -- common/autotest_common.sh@10 -- # set +x 00:05:23.145 04:12:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:23.145 04:12:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:23.145 04:12:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:23.145 04:12:00 -- accel/accel.sh@42 -- # jq -r . 00:05:23.145 [2024-11-28 04:12:00.307480] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.145 [2024-11-28 04:12:00.307614] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3781145 ] 00:05:23.145 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.145 [2024-11-28 04:12:00.367655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.480 [2024-11-28 04:12:00.482785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:23.480 [2024-11-28 04:12:00.482953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.046 04:12:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:24.046 04:12:01 -- common/autotest_common.sh@862 -- # return 0 00:05:24.046 04:12:01 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:24.046 04:12:01 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:24.046 04:12:01 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:24.046 04:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:24.046 04:12:01 -- common/autotest_common.sh@10 -- # set +x 00:05:24.046 04:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.046 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.046 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.046 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.047 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.047 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.047 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.047 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.047 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.047 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.047 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.047 04:12:01 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # IFS== 00:05:24.047 04:12:01 -- accel/accel.sh@64 -- # read -r opc module 00:05:24.047 04:12:01 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:24.047 04:12:01 -- accel/accel.sh@67 -- # killprocess 3781145 00:05:24.047 04:12:01 -- common/autotest_common.sh@936 -- # '[' -z 3781145 ']' 00:05:24.047 04:12:01 -- common/autotest_common.sh@940 -- # kill -0 3781145 00:05:24.047 04:12:01 -- common/autotest_common.sh@941 -- # uname 00:05:24.047 04:12:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.047 04:12:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3781145 00:05:24.304 04:12:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.304 04:12:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.304 04:12:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3781145' 00:05:24.304 killing process with pid 3781145 00:05:24.305 04:12:01 -- common/autotest_common.sh@955 -- # kill 3781145 00:05:24.305 04:12:01 -- common/autotest_common.sh@960 -- # wait 3781145 00:05:24.563 04:12:01 -- accel/accel.sh@68 -- # trap - ERR 00:05:24.563 04:12:01 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:24.563 04:12:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:24.563 04:12:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.563 04:12:01 -- common/autotest_common.sh@10 -- # set +x 00:05:24.563 04:12:01 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:24.563 04:12:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:24.563 04:12:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.563 04:12:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.563 04:12:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.563 04:12:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.563 04:12:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.563 04:12:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.563 04:12:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.563 04:12:01 -- accel/accel.sh@42 -- # jq -r . 00:05:24.563 04:12:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.563 04:12:01 -- common/autotest_common.sh@10 -- # set +x 00:05:24.822 04:12:01 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:24.822 04:12:01 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:24.822 04:12:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.822 04:12:01 -- common/autotest_common.sh@10 -- # set +x 00:05:24.822 ************************************ 00:05:24.822 START TEST accel_missing_filename 00:05:24.822 ************************************ 00:05:24.822 04:12:01 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:24.822 04:12:01 -- common/autotest_common.sh@650 -- # local es=0 00:05:24.822 04:12:01 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:24.822 04:12:01 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:24.822 04:12:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:24.822 04:12:01 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:24.822 04:12:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:24.822 04:12:01 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:24.822 04:12:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:24.822 04:12:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.822 04:12:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.822 04:12:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.822 04:12:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.822 04:12:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.822 04:12:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.822 04:12:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.822 04:12:01 -- accel/accel.sh@42 -- # jq -r . 00:05:24.822 [2024-11-28 04:12:01.909268] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.822 [2024-11-28 04:12:01.909347] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3781407 ] 00:05:24.822 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.822 [2024-11-28 04:12:01.971759] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.822 [2024-11-28 04:12:02.088496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.081 [2024-11-28 04:12:02.150256] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:25.081 [2024-11-28 04:12:02.237049] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:25.081 A filename is required. 00:05:25.081 04:12:02 -- common/autotest_common.sh@653 -- # es=234 00:05:25.081 04:12:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:25.081 04:12:02 -- common/autotest_common.sh@662 -- # es=106 00:05:25.081 04:12:02 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:25.081 04:12:02 -- common/autotest_common.sh@670 -- # es=1 00:05:25.081 04:12:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:25.081 00:05:25.081 real 0m0.466s 00:05:25.081 user 0m0.357s 00:05:25.081 sys 0m0.142s 00:05:25.081 04:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.081 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.081 ************************************ 00:05:25.081 END TEST accel_missing_filename 00:05:25.081 ************************************ 00:05:25.081 04:12:02 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:25.081 04:12:02 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:25.081 04:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.081 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.082 ************************************ 00:05:25.082 START TEST accel_compress_verify 00:05:25.082 ************************************ 00:05:25.082 04:12:02 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:25.082 04:12:02 -- common/autotest_common.sh@650 -- # local es=0 00:05:25.082 04:12:02 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:25.082 04:12:02 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:25.082 04:12:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.082 04:12:02 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:25.082 04:12:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.082 04:12:02 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:25.082 04:12:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:25.082 04:12:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.082 04:12:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.082 04:12:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.082 04:12:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.082 04:12:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.082 04:12:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.082 04:12:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.082 04:12:02 -- accel/accel.sh@42 -- # jq -r . 00:05:25.340 [2024-11-28 04:12:02.397333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.340 [2024-11-28 04:12:02.397401] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3781539 ] 00:05:25.340 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.340 [2024-11-28 04:12:02.458791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.340 [2024-11-28 04:12:02.576014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.340 [2024-11-28 04:12:02.638247] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:25.598 [2024-11-28 04:12:02.724649] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:25.598 00:05:25.598 Compression does not support the verify option, aborting. 00:05:25.598 04:12:02 -- common/autotest_common.sh@653 -- # es=161 00:05:25.598 04:12:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:25.598 04:12:02 -- common/autotest_common.sh@662 -- # es=33 00:05:25.598 04:12:02 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:25.598 04:12:02 -- common/autotest_common.sh@670 -- # es=1 00:05:25.598 04:12:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:25.598 00:05:25.598 real 0m0.466s 00:05:25.598 user 0m0.353s 00:05:25.598 sys 0m0.146s 00:05:25.598 04:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.598 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.598 ************************************ 00:05:25.598 END TEST accel_compress_verify 00:05:25.598 ************************************ 00:05:25.598 04:12:02 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:25.598 04:12:02 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:25.598 04:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.598 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.598 ************************************ 00:05:25.598 START TEST accel_wrong_workload 00:05:25.598 ************************************ 00:05:25.599 04:12:02 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:25.599 04:12:02 -- common/autotest_common.sh@650 -- # local es=0 00:05:25.599 04:12:02 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:25.599 04:12:02 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:25.599 04:12:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.599 04:12:02 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:25.599 04:12:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.599 04:12:02 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:25.599 04:12:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:25.599 04:12:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.599 04:12:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.599 04:12:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.599 04:12:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.599 04:12:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.599 04:12:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.599 04:12:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.599 04:12:02 -- accel/accel.sh@42 -- # jq -r . 00:05:25.599 Unsupported workload type: foobar 00:05:25.599 [2024-11-28 04:12:02.887977] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:25.599 accel_perf options: 00:05:25.599 [-h help message] 00:05:25.599 [-q queue depth per core] 00:05:25.599 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:25.599 [-T number of threads per core 00:05:25.599 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:25.599 [-t time in seconds] 00:05:25.599 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:25.599 [ dif_verify, , dif_generate, dif_generate_copy 00:05:25.599 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:25.599 [-l for compress/decompress workloads, name of uncompressed input file 00:05:25.599 [-S for crc32c workload, use this seed value (default 0) 00:05:25.599 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:25.599 [-f for fill workload, use this BYTE value (default 255) 00:05:25.599 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:25.599 [-y verify result if this switch is on] 00:05:25.599 [-a tasks to allocate per core (default: same value as -q)] 00:05:25.599 Can be used to spread operations across a wider range of memory. 00:05:25.599 04:12:02 -- common/autotest_common.sh@653 -- # es=1 00:05:25.599 04:12:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:25.599 04:12:02 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:25.599 04:12:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:25.599 00:05:25.599 real 0m0.022s 00:05:25.599 user 0m0.014s 00:05:25.599 sys 0m0.008s 00:05:25.599 04:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.599 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.599 ************************************ 00:05:25.599 END TEST accel_wrong_workload 00:05:25.599 ************************************ 00:05:25.858 Error: writing output failed: Broken pipe 00:05:25.858 04:12:02 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:25.858 04:12:02 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:25.858 04:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.858 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.858 ************************************ 00:05:25.858 START TEST accel_negative_buffers 00:05:25.858 ************************************ 00:05:25.858 04:12:02 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:25.858 04:12:02 -- common/autotest_common.sh@650 -- # local es=0 00:05:25.858 04:12:02 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:25.858 04:12:02 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:25.858 04:12:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.858 04:12:02 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:25.858 04:12:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.858 04:12:02 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:25.858 04:12:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:25.858 04:12:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.858 04:12:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.858 04:12:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.858 04:12:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.858 04:12:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.858 04:12:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.858 04:12:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.858 04:12:02 -- accel/accel.sh@42 -- # jq -r . 00:05:25.858 -x option must be non-negative. 00:05:25.858 [2024-11-28 04:12:02.930604] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:25.858 accel_perf options: 00:05:25.858 [-h help message] 00:05:25.858 [-q queue depth per core] 00:05:25.858 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:25.858 [-T number of threads per core 00:05:25.858 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:25.858 [-t time in seconds] 00:05:25.858 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:25.858 [ dif_verify, , dif_generate, dif_generate_copy 00:05:25.858 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:25.858 [-l for compress/decompress workloads, name of uncompressed input file 00:05:25.858 [-S for crc32c workload, use this seed value (default 0) 00:05:25.858 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:25.858 [-f for fill workload, use this BYTE value (default 255) 00:05:25.858 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:25.858 [-y verify result if this switch is on] 00:05:25.858 [-a tasks to allocate per core (default: same value as -q)] 00:05:25.858 Can be used to spread operations across a wider range of memory. 00:05:25.858 04:12:02 -- common/autotest_common.sh@653 -- # es=1 00:05:25.858 04:12:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:25.858 04:12:02 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:25.858 04:12:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:25.858 00:05:25.858 real 0m0.022s 00:05:25.858 user 0m0.009s 00:05:25.858 sys 0m0.012s 00:05:25.858 04:12:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.858 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.858 ************************************ 00:05:25.858 END TEST accel_negative_buffers 00:05:25.858 ************************************ 00:05:25.858 Error: writing output failed: Broken pipe 00:05:25.858 04:12:02 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:25.858 04:12:02 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:25.858 04:12:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.858 04:12:02 -- common/autotest_common.sh@10 -- # set +x 00:05:25.858 ************************************ 00:05:25.858 START TEST accel_crc32c 00:05:25.858 ************************************ 00:05:25.858 04:12:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:25.858 04:12:02 -- accel/accel.sh@16 -- # local accel_opc 00:05:25.858 04:12:02 -- accel/accel.sh@17 -- # local accel_module 00:05:25.858 04:12:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:25.858 04:12:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:25.858 04:12:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.858 04:12:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.858 04:12:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.858 04:12:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.858 04:12:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.858 04:12:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.858 04:12:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.858 04:12:02 -- accel/accel.sh@42 -- # jq -r . 00:05:25.858 [2024-11-28 04:12:02.975308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.858 [2024-11-28 04:12:02.975364] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3781614 ] 00:05:25.858 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.858 [2024-11-28 04:12:03.036408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.858 [2024-11-28 04:12:03.154673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.232 04:12:04 -- accel/accel.sh@18 -- # out=' 00:05:27.232 SPDK Configuration: 00:05:27.232 Core mask: 0x1 00:05:27.232 00:05:27.232 Accel Perf Configuration: 00:05:27.232 Workload Type: crc32c 00:05:27.232 CRC-32C seed: 32 00:05:27.232 Transfer size: 4096 bytes 00:05:27.232 Vector count 1 00:05:27.232 Module: software 00:05:27.232 Queue depth: 32 00:05:27.232 Allocate depth: 32 00:05:27.232 # threads/core: 1 00:05:27.232 Run time: 1 seconds 00:05:27.232 Verify: Yes 00:05:27.232 00:05:27.232 Running for 1 seconds... 00:05:27.232 00:05:27.232 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:27.232 ------------------------------------------------------------------------------------ 00:05:27.232 0,0 402944/s 1574 MiB/s 0 0 00:05:27.232 ==================================================================================== 00:05:27.232 Total 402944/s 1574 MiB/s 0 0' 00:05:27.232 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.232 04:12:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:27.232 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.232 04:12:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:27.232 04:12:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.232 04:12:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.232 04:12:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.232 04:12:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.232 04:12:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.232 04:12:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.232 04:12:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.232 04:12:04 -- accel/accel.sh@42 -- # jq -r . 00:05:27.232 [2024-11-28 04:12:04.452044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.232 [2024-11-28 04:12:04.452124] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3781760 ] 00:05:27.232 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.232 [2024-11-28 04:12:04.513157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.490 [2024-11-28 04:12:04.634209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val= 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val= 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val=0x1 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val= 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val= 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val=crc32c 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val=32 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val= 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.490 04:12:04 -- accel/accel.sh@21 -- # val=software 00:05:27.490 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.490 04:12:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.490 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.491 04:12:04 -- accel/accel.sh@21 -- # val=32 00:05:27.491 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.491 04:12:04 -- accel/accel.sh@21 -- # val=32 00:05:27.491 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.491 04:12:04 -- accel/accel.sh@21 -- # val=1 00:05:27.491 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.491 04:12:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.491 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.491 04:12:04 -- accel/accel.sh@21 -- # val=Yes 00:05:27.491 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.491 04:12:04 -- accel/accel.sh@21 -- # val= 00:05:27.491 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:27.491 04:12:04 -- accel/accel.sh@21 -- # val= 00:05:27.491 04:12:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # IFS=: 00:05:27.491 04:12:04 -- accel/accel.sh@20 -- # read -r var val 00:05:28.863 04:12:05 -- accel/accel.sh@21 -- # val= 00:05:28.863 04:12:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # IFS=: 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # read -r var val 00:05:28.863 04:12:05 -- accel/accel.sh@21 -- # val= 00:05:28.863 04:12:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # IFS=: 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # read -r var val 00:05:28.863 04:12:05 -- accel/accel.sh@21 -- # val= 00:05:28.863 04:12:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # IFS=: 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # read -r var val 00:05:28.863 04:12:05 -- accel/accel.sh@21 -- # val= 00:05:28.863 04:12:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # IFS=: 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # read -r var val 00:05:28.863 04:12:05 -- accel/accel.sh@21 -- # val= 00:05:28.863 04:12:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # IFS=: 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # read -r var val 00:05:28.863 04:12:05 -- accel/accel.sh@21 -- # val= 00:05:28.863 04:12:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # IFS=: 00:05:28.863 04:12:05 -- accel/accel.sh@20 -- # read -r var val 00:05:28.863 04:12:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:28.863 04:12:05 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:28.863 04:12:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:28.863 00:05:28.863 real 0m2.942s 00:05:28.863 user 0m2.649s 00:05:28.863 sys 0m0.283s 00:05:28.863 04:12:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.863 04:12:05 -- common/autotest_common.sh@10 -- # set +x 00:05:28.863 ************************************ 00:05:28.863 END TEST accel_crc32c 00:05:28.863 ************************************ 00:05:28.863 04:12:05 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:28.863 04:12:05 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:28.863 04:12:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.863 04:12:05 -- common/autotest_common.sh@10 -- # set +x 00:05:28.863 ************************************ 00:05:28.863 START TEST accel_crc32c_C2 00:05:28.863 ************************************ 00:05:28.863 04:12:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:28.863 04:12:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.863 04:12:05 -- accel/accel.sh@17 -- # local accel_module 00:05:28.863 04:12:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:28.863 04:12:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:28.863 04:12:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.863 04:12:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.863 04:12:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.863 04:12:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.863 04:12:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.863 04:12:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.863 04:12:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.863 04:12:05 -- accel/accel.sh@42 -- # jq -r . 00:05:28.863 [2024-11-28 04:12:05.947582] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.863 [2024-11-28 04:12:05.947659] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3782036 ] 00:05:28.863 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.863 [2024-11-28 04:12:06.009966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.863 [2024-11-28 04:12:06.127212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.237 04:12:07 -- accel/accel.sh@18 -- # out=' 00:05:30.237 SPDK Configuration: 00:05:30.237 Core mask: 0x1 00:05:30.237 00:05:30.237 Accel Perf Configuration: 00:05:30.237 Workload Type: crc32c 00:05:30.237 CRC-32C seed: 0 00:05:30.237 Transfer size: 4096 bytes 00:05:30.237 Vector count 2 00:05:30.237 Module: software 00:05:30.237 Queue depth: 32 00:05:30.237 Allocate depth: 32 00:05:30.237 # threads/core: 1 00:05:30.237 Run time: 1 seconds 00:05:30.237 Verify: Yes 00:05:30.237 00:05:30.237 Running for 1 seconds... 00:05:30.237 00:05:30.237 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:30.237 ------------------------------------------------------------------------------------ 00:05:30.237 0,0 312224/s 2439 MiB/s 0 0 00:05:30.237 ==================================================================================== 00:05:30.237 Total 312224/s 1219 MiB/s 0 0' 00:05:30.237 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.237 04:12:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:30.237 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.237 04:12:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:30.237 04:12:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.238 04:12:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.238 04:12:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.238 04:12:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.238 04:12:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.238 04:12:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.238 04:12:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.238 04:12:07 -- accel/accel.sh@42 -- # jq -r . 00:05:30.238 [2024-11-28 04:12:07.420553] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.238 [2024-11-28 04:12:07.420631] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3782203 ] 00:05:30.238 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.238 [2024-11-28 04:12:07.482608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.496 [2024-11-28 04:12:07.599145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val= 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val= 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=0x1 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val= 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val= 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=crc32c 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=0 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val= 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=software 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=32 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=32 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=1 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val=Yes 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val= 00:05:30.496 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.496 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:30.496 04:12:07 -- accel/accel.sh@21 -- # val= 00:05:30.497 04:12:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.497 04:12:07 -- accel/accel.sh@20 -- # IFS=: 00:05:30.497 04:12:07 -- accel/accel.sh@20 -- # read -r var val 00:05:31.870 04:12:08 -- accel/accel.sh@21 -- # val= 00:05:31.870 04:12:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # IFS=: 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # read -r var val 00:05:31.870 04:12:08 -- accel/accel.sh@21 -- # val= 00:05:31.870 04:12:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # IFS=: 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # read -r var val 00:05:31.870 04:12:08 -- accel/accel.sh@21 -- # val= 00:05:31.870 04:12:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # IFS=: 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # read -r var val 00:05:31.870 04:12:08 -- accel/accel.sh@21 -- # val= 00:05:31.870 04:12:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # IFS=: 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # read -r var val 00:05:31.870 04:12:08 -- accel/accel.sh@21 -- # val= 00:05:31.870 04:12:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # IFS=: 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # read -r var val 00:05:31.870 04:12:08 -- accel/accel.sh@21 -- # val= 00:05:31.870 04:12:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # IFS=: 00:05:31.870 04:12:08 -- accel/accel.sh@20 -- # read -r var val 00:05:31.870 04:12:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:31.870 04:12:08 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:31.870 04:12:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:31.870 00:05:31.870 real 0m2.937s 00:05:31.870 user 0m2.639s 00:05:31.870 sys 0m0.288s 00:05:31.870 04:12:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.870 04:12:08 -- common/autotest_common.sh@10 -- # set +x 00:05:31.870 ************************************ 00:05:31.870 END TEST accel_crc32c_C2 00:05:31.870 ************************************ 00:05:31.870 04:12:08 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:31.870 04:12:08 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:31.870 04:12:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.871 04:12:08 -- common/autotest_common.sh@10 -- # set +x 00:05:31.871 ************************************ 00:05:31.871 START TEST accel_copy 00:05:31.871 ************************************ 00:05:31.871 04:12:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:31.871 04:12:08 -- accel/accel.sh@16 -- # local accel_opc 00:05:31.871 04:12:08 -- accel/accel.sh@17 -- # local accel_module 00:05:31.871 04:12:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:31.871 04:12:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:31.871 04:12:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.871 04:12:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.871 04:12:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.871 04:12:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.871 04:12:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.871 04:12:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.871 04:12:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.871 04:12:08 -- accel/accel.sh@42 -- # jq -r . 00:05:31.871 [2024-11-28 04:12:08.910998] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.871 [2024-11-28 04:12:08.911076] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3782786 ] 00:05:31.871 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.871 [2024-11-28 04:12:08.972212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.871 [2024-11-28 04:12:09.092858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.245 04:12:10 -- accel/accel.sh@18 -- # out=' 00:05:33.245 SPDK Configuration: 00:05:33.245 Core mask: 0x1 00:05:33.245 00:05:33.245 Accel Perf Configuration: 00:05:33.245 Workload Type: copy 00:05:33.245 Transfer size: 4096 bytes 00:05:33.245 Vector count 1 00:05:33.245 Module: software 00:05:33.245 Queue depth: 32 00:05:33.245 Allocate depth: 32 00:05:33.245 # threads/core: 1 00:05:33.245 Run time: 1 seconds 00:05:33.245 Verify: Yes 00:05:33.245 00:05:33.245 Running for 1 seconds... 00:05:33.245 00:05:33.245 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:33.245 ------------------------------------------------------------------------------------ 00:05:33.245 0,0 277536/s 1084 MiB/s 0 0 00:05:33.245 ==================================================================================== 00:05:33.245 Total 277536/s 1084 MiB/s 0 0' 00:05:33.245 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.245 04:12:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:33.245 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.245 04:12:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:33.245 04:12:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.245 04:12:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.245 04:12:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.245 04:12:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.245 04:12:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.245 04:12:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.245 04:12:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.245 04:12:10 -- accel/accel.sh@42 -- # jq -r . 00:05:33.245 [2024-11-28 04:12:10.384156] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.245 [2024-11-28 04:12:10.384235] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3783112 ] 00:05:33.245 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.245 [2024-11-28 04:12:10.445535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.504 [2024-11-28 04:12:10.562198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val= 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val= 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val=0x1 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val= 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val= 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val=copy 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val= 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val=software 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val=32 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val=32 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val=1 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val=Yes 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val= 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:33.504 04:12:10 -- accel/accel.sh@21 -- # val= 00:05:33.504 04:12:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # IFS=: 00:05:33.504 04:12:10 -- accel/accel.sh@20 -- # read -r var val 00:05:34.877 04:12:11 -- accel/accel.sh@21 -- # val= 00:05:34.877 04:12:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # IFS=: 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # read -r var val 00:05:34.877 04:12:11 -- accel/accel.sh@21 -- # val= 00:05:34.877 04:12:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # IFS=: 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # read -r var val 00:05:34.877 04:12:11 -- accel/accel.sh@21 -- # val= 00:05:34.877 04:12:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # IFS=: 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # read -r var val 00:05:34.877 04:12:11 -- accel/accel.sh@21 -- # val= 00:05:34.877 04:12:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # IFS=: 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # read -r var val 00:05:34.877 04:12:11 -- accel/accel.sh@21 -- # val= 00:05:34.877 04:12:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # IFS=: 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # read -r var val 00:05:34.877 04:12:11 -- accel/accel.sh@21 -- # val= 00:05:34.877 04:12:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # IFS=: 00:05:34.877 04:12:11 -- accel/accel.sh@20 -- # read -r var val 00:05:34.877 04:12:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:34.877 04:12:11 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:34.877 04:12:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:34.877 00:05:34.877 real 0m2.942s 00:05:34.877 user 0m2.644s 00:05:34.877 sys 0m0.288s 00:05:34.877 04:12:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.878 04:12:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.878 ************************************ 00:05:34.878 END TEST accel_copy 00:05:34.878 ************************************ 00:05:34.878 04:12:11 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:34.878 04:12:11 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:34.878 04:12:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.878 04:12:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.878 ************************************ 00:05:34.878 START TEST accel_fill 00:05:34.878 ************************************ 00:05:34.878 04:12:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:34.878 04:12:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:34.878 04:12:11 -- accel/accel.sh@17 -- # local accel_module 00:05:34.878 04:12:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:34.878 04:12:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:34.878 04:12:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.878 04:12:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.878 04:12:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.878 04:12:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.878 04:12:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.878 04:12:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.878 04:12:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.878 04:12:11 -- accel/accel.sh@42 -- # jq -r . 00:05:34.878 [2024-11-28 04:12:11.879457] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.878 [2024-11-28 04:12:11.879542] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3783270 ] 00:05:34.878 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.878 [2024-11-28 04:12:11.940272] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.878 [2024-11-28 04:12:12.053875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.251 04:12:13 -- accel/accel.sh@18 -- # out=' 00:05:36.251 SPDK Configuration: 00:05:36.251 Core mask: 0x1 00:05:36.251 00:05:36.251 Accel Perf Configuration: 00:05:36.251 Workload Type: fill 00:05:36.251 Fill pattern: 0x80 00:05:36.251 Transfer size: 4096 bytes 00:05:36.251 Vector count 1 00:05:36.251 Module: software 00:05:36.251 Queue depth: 64 00:05:36.251 Allocate depth: 64 00:05:36.251 # threads/core: 1 00:05:36.251 Run time: 1 seconds 00:05:36.251 Verify: Yes 00:05:36.251 00:05:36.251 Running for 1 seconds... 00:05:36.251 00:05:36.251 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.251 ------------------------------------------------------------------------------------ 00:05:36.251 0,0 406080/s 1586 MiB/s 0 0 00:05:36.251 ==================================================================================== 00:05:36.251 Total 406080/s 1586 MiB/s 0 0' 00:05:36.251 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.251 04:12:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:36.252 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.252 04:12:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:36.252 04:12:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.252 04:12:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.252 04:12:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.252 04:12:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.252 04:12:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.252 04:12:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.252 04:12:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.252 04:12:13 -- accel/accel.sh@42 -- # jq -r . 00:05:36.252 [2024-11-28 04:12:13.354225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.252 [2024-11-28 04:12:13.354307] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3783424 ] 00:05:36.252 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.252 [2024-11-28 04:12:13.414965] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.252 [2024-11-28 04:12:13.534791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val= 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val= 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=0x1 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val= 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val= 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=fill 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=0x80 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val= 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=software 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=64 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=64 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=1 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val=Yes 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val= 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:36.510 04:12:13 -- accel/accel.sh@21 -- # val= 00:05:36.510 04:12:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # IFS=: 00:05:36.510 04:12:13 -- accel/accel.sh@20 -- # read -r var val 00:05:37.884 04:12:14 -- accel/accel.sh@21 -- # val= 00:05:37.884 04:12:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # IFS=: 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # read -r var val 00:05:37.884 04:12:14 -- accel/accel.sh@21 -- # val= 00:05:37.884 04:12:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # IFS=: 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # read -r var val 00:05:37.884 04:12:14 -- accel/accel.sh@21 -- # val= 00:05:37.884 04:12:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # IFS=: 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # read -r var val 00:05:37.884 04:12:14 -- accel/accel.sh@21 -- # val= 00:05:37.884 04:12:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # IFS=: 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # read -r var val 00:05:37.884 04:12:14 -- accel/accel.sh@21 -- # val= 00:05:37.884 04:12:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # IFS=: 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # read -r var val 00:05:37.884 04:12:14 -- accel/accel.sh@21 -- # val= 00:05:37.884 04:12:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # IFS=: 00:05:37.884 04:12:14 -- accel/accel.sh@20 -- # read -r var val 00:05:37.884 04:12:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.884 04:12:14 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:37.884 04:12:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.884 00:05:37.884 real 0m2.956s 00:05:37.884 user 0m2.658s 00:05:37.884 sys 0m0.290s 00:05:37.884 04:12:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.884 04:12:14 -- common/autotest_common.sh@10 -- # set +x 00:05:37.884 ************************************ 00:05:37.884 END TEST accel_fill 00:05:37.884 ************************************ 00:05:37.884 04:12:14 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:37.884 04:12:14 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:37.884 04:12:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.884 04:12:14 -- common/autotest_common.sh@10 -- # set +x 00:05:37.884 ************************************ 00:05:37.884 START TEST accel_copy_crc32c 00:05:37.884 ************************************ 00:05:37.884 04:12:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:37.884 04:12:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.884 04:12:14 -- accel/accel.sh@17 -- # local accel_module 00:05:37.884 04:12:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:37.884 04:12:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:37.884 04:12:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.884 04:12:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.884 04:12:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.884 04:12:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.884 04:12:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.884 04:12:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.884 04:12:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.884 04:12:14 -- accel/accel.sh@42 -- # jq -r . 00:05:37.884 [2024-11-28 04:12:14.862100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.884 [2024-11-28 04:12:14.862182] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3783685 ] 00:05:37.884 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.884 [2024-11-28 04:12:14.928994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.884 [2024-11-28 04:12:15.050120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.256 04:12:16 -- accel/accel.sh@18 -- # out=' 00:05:39.256 SPDK Configuration: 00:05:39.256 Core mask: 0x1 00:05:39.256 00:05:39.256 Accel Perf Configuration: 00:05:39.256 Workload Type: copy_crc32c 00:05:39.256 CRC-32C seed: 0 00:05:39.256 Vector size: 4096 bytes 00:05:39.256 Transfer size: 4096 bytes 00:05:39.256 Vector count 1 00:05:39.256 Module: software 00:05:39.256 Queue depth: 32 00:05:39.256 Allocate depth: 32 00:05:39.256 # threads/core: 1 00:05:39.256 Run time: 1 seconds 00:05:39.256 Verify: Yes 00:05:39.256 00:05:39.256 Running for 1 seconds... 00:05:39.256 00:05:39.256 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.256 ------------------------------------------------------------------------------------ 00:05:39.256 0,0 218208/s 852 MiB/s 0 0 00:05:39.256 ==================================================================================== 00:05:39.256 Total 218208/s 852 MiB/s 0 0' 00:05:39.256 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.256 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.256 04:12:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:39.256 04:12:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:39.256 04:12:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.256 04:12:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.256 04:12:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.256 04:12:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.256 04:12:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.256 04:12:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.256 04:12:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.256 04:12:16 -- accel/accel.sh@42 -- # jq -r . 00:05:39.256 [2024-11-28 04:12:16.350868] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.256 [2024-11-28 04:12:16.350948] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3783844 ] 00:05:39.256 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.256 [2024-11-28 04:12:16.414160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.256 [2024-11-28 04:12:16.533267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val= 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val= 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=0x1 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val= 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val= 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=0 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val= 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=software 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=32 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=32 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=1 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val=Yes 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val= 00:05:39.516 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.516 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:39.516 04:12:16 -- accel/accel.sh@21 -- # val= 00:05:39.517 04:12:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.517 04:12:16 -- accel/accel.sh@20 -- # IFS=: 00:05:39.517 04:12:16 -- accel/accel.sh@20 -- # read -r var val 00:05:40.891 04:12:17 -- accel/accel.sh@21 -- # val= 00:05:40.891 04:12:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # IFS=: 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # read -r var val 00:05:40.891 04:12:17 -- accel/accel.sh@21 -- # val= 00:05:40.891 04:12:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # IFS=: 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # read -r var val 00:05:40.891 04:12:17 -- accel/accel.sh@21 -- # val= 00:05:40.891 04:12:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # IFS=: 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # read -r var val 00:05:40.891 04:12:17 -- accel/accel.sh@21 -- # val= 00:05:40.891 04:12:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # IFS=: 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # read -r var val 00:05:40.891 04:12:17 -- accel/accel.sh@21 -- # val= 00:05:40.891 04:12:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # IFS=: 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # read -r var val 00:05:40.891 04:12:17 -- accel/accel.sh@21 -- # val= 00:05:40.891 04:12:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # IFS=: 00:05:40.891 04:12:17 -- accel/accel.sh@20 -- # read -r var val 00:05:40.891 04:12:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.891 04:12:17 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:40.891 04:12:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.891 00:05:40.891 real 0m2.975s 00:05:40.891 user 0m2.657s 00:05:40.891 sys 0m0.309s 00:05:40.891 04:12:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.891 04:12:17 -- common/autotest_common.sh@10 -- # set +x 00:05:40.891 ************************************ 00:05:40.891 END TEST accel_copy_crc32c 00:05:40.891 ************************************ 00:05:40.891 04:12:17 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:40.891 04:12:17 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:40.891 04:12:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.891 04:12:17 -- common/autotest_common.sh@10 -- # set +x 00:05:40.891 ************************************ 00:05:40.891 START TEST accel_copy_crc32c_C2 00:05:40.891 ************************************ 00:05:40.891 04:12:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:40.891 04:12:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.891 04:12:17 -- accel/accel.sh@17 -- # local accel_module 00:05:40.891 04:12:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:40.891 04:12:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:40.891 04:12:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.891 04:12:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.891 04:12:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.891 04:12:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.891 04:12:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.891 04:12:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.891 04:12:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.891 04:12:17 -- accel/accel.sh@42 -- # jq -r . 00:05:40.891 [2024-11-28 04:12:17.864310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.891 [2024-11-28 04:12:17.864392] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3784005 ] 00:05:40.891 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.891 [2024-11-28 04:12:17.930560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.891 [2024-11-28 04:12:18.051794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.265 04:12:19 -- accel/accel.sh@18 -- # out=' 00:05:42.265 SPDK Configuration: 00:05:42.265 Core mask: 0x1 00:05:42.265 00:05:42.265 Accel Perf Configuration: 00:05:42.265 Workload Type: copy_crc32c 00:05:42.265 CRC-32C seed: 0 00:05:42.265 Vector size: 4096 bytes 00:05:42.265 Transfer size: 8192 bytes 00:05:42.265 Vector count 2 00:05:42.265 Module: software 00:05:42.265 Queue depth: 32 00:05:42.265 Allocate depth: 32 00:05:42.265 # threads/core: 1 00:05:42.265 Run time: 1 seconds 00:05:42.265 Verify: Yes 00:05:42.265 00:05:42.265 Running for 1 seconds... 00:05:42.265 00:05:42.265 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.265 ------------------------------------------------------------------------------------ 00:05:42.265 0,0 154880/s 1210 MiB/s 0 0 00:05:42.265 ==================================================================================== 00:05:42.265 Total 154880/s 605 MiB/s 0 0' 00:05:42.265 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.265 04:12:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:42.265 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.265 04:12:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:42.265 04:12:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.265 04:12:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.265 04:12:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.265 04:12:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.265 04:12:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.265 04:12:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.265 04:12:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.265 04:12:19 -- accel/accel.sh@42 -- # jq -r . 00:05:42.265 [2024-11-28 04:12:19.354310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.265 [2024-11-28 04:12:19.354390] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3784188 ] 00:05:42.265 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.265 [2024-11-28 04:12:19.416641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.265 [2024-11-28 04:12:19.536826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val= 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val= 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=0x1 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val= 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val= 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=0 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val= 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=software 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=32 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=32 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=1 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val=Yes 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val= 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:42.524 04:12:19 -- accel/accel.sh@21 -- # val= 00:05:42.524 04:12:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # IFS=: 00:05:42.524 04:12:19 -- accel/accel.sh@20 -- # read -r var val 00:05:43.900 04:12:20 -- accel/accel.sh@21 -- # val= 00:05:43.900 04:12:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # IFS=: 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # read -r var val 00:05:43.900 04:12:20 -- accel/accel.sh@21 -- # val= 00:05:43.900 04:12:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # IFS=: 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # read -r var val 00:05:43.900 04:12:20 -- accel/accel.sh@21 -- # val= 00:05:43.900 04:12:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # IFS=: 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # read -r var val 00:05:43.900 04:12:20 -- accel/accel.sh@21 -- # val= 00:05:43.900 04:12:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # IFS=: 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # read -r var val 00:05:43.900 04:12:20 -- accel/accel.sh@21 -- # val= 00:05:43.900 04:12:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # IFS=: 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # read -r var val 00:05:43.900 04:12:20 -- accel/accel.sh@21 -- # val= 00:05:43.900 04:12:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # IFS=: 00:05:43.900 04:12:20 -- accel/accel.sh@20 -- # read -r var val 00:05:43.900 04:12:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.900 04:12:20 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:43.900 04:12:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.900 00:05:43.900 real 0m2.977s 00:05:43.900 user 0m2.666s 00:05:43.900 sys 0m0.302s 00:05:43.900 04:12:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.900 04:12:20 -- common/autotest_common.sh@10 -- # set +x 00:05:43.900 ************************************ 00:05:43.900 END TEST accel_copy_crc32c_C2 00:05:43.900 ************************************ 00:05:43.900 04:12:20 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:43.900 04:12:20 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:43.900 04:12:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.900 04:12:20 -- common/autotest_common.sh@10 -- # set +x 00:05:43.900 ************************************ 00:05:43.900 START TEST accel_dualcast 00:05:43.900 ************************************ 00:05:43.900 04:12:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:43.900 04:12:20 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.900 04:12:20 -- accel/accel.sh@17 -- # local accel_module 00:05:43.900 04:12:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:43.900 04:12:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:43.900 04:12:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.900 04:12:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.900 04:12:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.900 04:12:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.900 04:12:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.900 04:12:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.900 04:12:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.900 04:12:20 -- accel/accel.sh@42 -- # jq -r . 00:05:43.900 [2024-11-28 04:12:20.868126] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.900 [2024-11-28 04:12:20.868206] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3784423 ] 00:05:43.900 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.900 [2024-11-28 04:12:20.935612] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.900 [2024-11-28 04:12:21.056292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.274 04:12:22 -- accel/accel.sh@18 -- # out=' 00:05:45.274 SPDK Configuration: 00:05:45.274 Core mask: 0x1 00:05:45.274 00:05:45.274 Accel Perf Configuration: 00:05:45.274 Workload Type: dualcast 00:05:45.274 Transfer size: 4096 bytes 00:05:45.274 Vector count 1 00:05:45.274 Module: software 00:05:45.274 Queue depth: 32 00:05:45.274 Allocate depth: 32 00:05:45.274 # threads/core: 1 00:05:45.274 Run time: 1 seconds 00:05:45.274 Verify: Yes 00:05:45.274 00:05:45.274 Running for 1 seconds... 00:05:45.274 00:05:45.274 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.274 ------------------------------------------------------------------------------------ 00:05:45.274 0,0 295872/s 1155 MiB/s 0 0 00:05:45.274 ==================================================================================== 00:05:45.274 Total 295872/s 1155 MiB/s 0 0' 00:05:45.274 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.274 04:12:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:45.274 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.274 04:12:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:45.274 04:12:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.274 04:12:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.274 04:12:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.274 04:12:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.274 04:12:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.274 04:12:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.274 04:12:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.274 04:12:22 -- accel/accel.sh@42 -- # jq -r . 00:05:45.274 [2024-11-28 04:12:22.346321] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.274 [2024-11-28 04:12:22.346406] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3784572 ] 00:05:45.274 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.274 [2024-11-28 04:12:22.408205] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.274 [2024-11-28 04:12:22.528709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val= 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val= 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val=0x1 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val= 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val= 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val=dualcast 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val= 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val=software 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val=32 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val=32 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val=1 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val=Yes 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val= 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:45.533 04:12:22 -- accel/accel.sh@21 -- # val= 00:05:45.533 04:12:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # IFS=: 00:05:45.533 04:12:22 -- accel/accel.sh@20 -- # read -r var val 00:05:46.907 04:12:23 -- accel/accel.sh@21 -- # val= 00:05:46.907 04:12:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # IFS=: 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # read -r var val 00:05:46.907 04:12:23 -- accel/accel.sh@21 -- # val= 00:05:46.907 04:12:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # IFS=: 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # read -r var val 00:05:46.907 04:12:23 -- accel/accel.sh@21 -- # val= 00:05:46.907 04:12:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # IFS=: 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # read -r var val 00:05:46.907 04:12:23 -- accel/accel.sh@21 -- # val= 00:05:46.907 04:12:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # IFS=: 00:05:46.907 04:12:23 -- accel/accel.sh@20 -- # read -r var val 00:05:46.908 04:12:23 -- accel/accel.sh@21 -- # val= 00:05:46.908 04:12:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.908 04:12:23 -- accel/accel.sh@20 -- # IFS=: 00:05:46.908 04:12:23 -- accel/accel.sh@20 -- # read -r var val 00:05:46.908 04:12:23 -- accel/accel.sh@21 -- # val= 00:05:46.908 04:12:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.908 04:12:23 -- accel/accel.sh@20 -- # IFS=: 00:05:46.908 04:12:23 -- accel/accel.sh@20 -- # read -r var val 00:05:46.908 04:12:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.908 04:12:23 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:46.908 04:12:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.908 00:05:46.908 real 0m2.965s 00:05:46.908 user 0m2.662s 00:05:46.908 sys 0m0.294s 00:05:46.908 04:12:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.908 04:12:23 -- common/autotest_common.sh@10 -- # set +x 00:05:46.908 ************************************ 00:05:46.908 END TEST accel_dualcast 00:05:46.908 ************************************ 00:05:46.908 04:12:23 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:46.908 04:12:23 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:46.908 04:12:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.908 04:12:23 -- common/autotest_common.sh@10 -- # set +x 00:05:46.908 ************************************ 00:05:46.908 START TEST accel_compare 00:05:46.908 ************************************ 00:05:46.908 04:12:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:46.908 04:12:23 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.908 04:12:23 -- accel/accel.sh@17 -- # local accel_module 00:05:46.908 04:12:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:46.908 04:12:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:46.908 04:12:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.908 04:12:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.908 04:12:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.908 04:12:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.908 04:12:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.908 04:12:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.908 04:12:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.908 04:12:23 -- accel/accel.sh@42 -- # jq -r . 00:05:46.908 [2024-11-28 04:12:23.860315] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.908 [2024-11-28 04:12:23.860395] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3784745 ] 00:05:46.908 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.908 [2024-11-28 04:12:23.927966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.908 [2024-11-28 04:12:24.050042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.279 04:12:25 -- accel/accel.sh@18 -- # out=' 00:05:48.279 SPDK Configuration: 00:05:48.279 Core mask: 0x1 00:05:48.279 00:05:48.279 Accel Perf Configuration: 00:05:48.279 Workload Type: compare 00:05:48.279 Transfer size: 4096 bytes 00:05:48.279 Vector count 1 00:05:48.279 Module: software 00:05:48.279 Queue depth: 32 00:05:48.279 Allocate depth: 32 00:05:48.279 # threads/core: 1 00:05:48.279 Run time: 1 seconds 00:05:48.279 Verify: Yes 00:05:48.279 00:05:48.279 Running for 1 seconds... 00:05:48.279 00:05:48.279 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.279 ------------------------------------------------------------------------------------ 00:05:48.279 0,0 396544/s 1549 MiB/s 0 0 00:05:48.279 ==================================================================================== 00:05:48.279 Total 396544/s 1549 MiB/s 0 0' 00:05:48.279 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.279 04:12:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:48.279 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.279 04:12:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:48.279 04:12:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.279 04:12:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.279 04:12:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.279 04:12:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.279 04:12:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.279 04:12:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.279 04:12:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.279 04:12:25 -- accel/accel.sh@42 -- # jq -r . 00:05:48.279 [2024-11-28 04:12:25.353478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.279 [2024-11-28 04:12:25.353571] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3784991 ] 00:05:48.279 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.279 [2024-11-28 04:12:25.414590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.279 [2024-11-28 04:12:25.534716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val= 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val= 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val=0x1 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val= 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val= 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val=compare 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val= 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val=software 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val=32 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val=32 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val=1 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val=Yes 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val= 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:48.536 04:12:25 -- accel/accel.sh@21 -- # val= 00:05:48.536 04:12:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # IFS=: 00:05:48.536 04:12:25 -- accel/accel.sh@20 -- # read -r var val 00:05:49.909 04:12:26 -- accel/accel.sh@21 -- # val= 00:05:49.909 04:12:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # IFS=: 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # read -r var val 00:05:49.909 04:12:26 -- accel/accel.sh@21 -- # val= 00:05:49.909 04:12:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # IFS=: 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # read -r var val 00:05:49.909 04:12:26 -- accel/accel.sh@21 -- # val= 00:05:49.909 04:12:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # IFS=: 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # read -r var val 00:05:49.909 04:12:26 -- accel/accel.sh@21 -- # val= 00:05:49.909 04:12:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # IFS=: 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # read -r var val 00:05:49.909 04:12:26 -- accel/accel.sh@21 -- # val= 00:05:49.909 04:12:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # IFS=: 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # read -r var val 00:05:49.909 04:12:26 -- accel/accel.sh@21 -- # val= 00:05:49.909 04:12:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # IFS=: 00:05:49.909 04:12:26 -- accel/accel.sh@20 -- # read -r var val 00:05:49.909 04:12:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.909 04:12:26 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:49.909 04:12:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.909 00:05:49.909 real 0m2.969s 00:05:49.909 user 0m2.660s 00:05:49.909 sys 0m0.300s 00:05:49.909 04:12:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.909 04:12:26 -- common/autotest_common.sh@10 -- # set +x 00:05:49.909 ************************************ 00:05:49.909 END TEST accel_compare 00:05:49.909 ************************************ 00:05:49.909 04:12:26 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:49.909 04:12:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:49.909 04:12:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.909 04:12:26 -- common/autotest_common.sh@10 -- # set +x 00:05:49.909 ************************************ 00:05:49.909 START TEST accel_xor 00:05:49.909 ************************************ 00:05:49.909 04:12:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:49.909 04:12:26 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.909 04:12:26 -- accel/accel.sh@17 -- # local accel_module 00:05:49.910 04:12:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:49.910 04:12:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:49.910 04:12:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.910 04:12:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.910 04:12:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.910 04:12:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.910 04:12:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.910 04:12:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.910 04:12:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.910 04:12:26 -- accel/accel.sh@42 -- # jq -r . 00:05:49.910 [2024-11-28 04:12:26.857714] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.910 [2024-11-28 04:12:26.857792] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3785159 ] 00:05:49.910 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.910 [2024-11-28 04:12:26.919708] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.910 [2024-11-28 04:12:27.039067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.283 04:12:28 -- accel/accel.sh@18 -- # out=' 00:05:51.283 SPDK Configuration: 00:05:51.283 Core mask: 0x1 00:05:51.283 00:05:51.283 Accel Perf Configuration: 00:05:51.283 Workload Type: xor 00:05:51.283 Source buffers: 2 00:05:51.283 Transfer size: 4096 bytes 00:05:51.283 Vector count 1 00:05:51.283 Module: software 00:05:51.283 Queue depth: 32 00:05:51.283 Allocate depth: 32 00:05:51.283 # threads/core: 1 00:05:51.283 Run time: 1 seconds 00:05:51.283 Verify: Yes 00:05:51.283 00:05:51.283 Running for 1 seconds... 00:05:51.283 00:05:51.283 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.283 ------------------------------------------------------------------------------------ 00:05:51.283 0,0 191648/s 748 MiB/s 0 0 00:05:51.283 ==================================================================================== 00:05:51.284 Total 191648/s 748 MiB/s 0 0' 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:51.284 04:12:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.284 04:12:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.284 04:12:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.284 04:12:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.284 04:12:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.284 04:12:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.284 04:12:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.284 04:12:28 -- accel/accel.sh@42 -- # jq -r . 00:05:51.284 [2024-11-28 04:12:28.343993] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.284 [2024-11-28 04:12:28.344075] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3785300 ] 00:05:51.284 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.284 [2024-11-28 04:12:28.407594] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.284 [2024-11-28 04:12:28.527130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val= 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val= 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val=0x1 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val= 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val= 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val=xor 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val=2 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.284 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.284 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.284 04:12:28 -- accel/accel.sh@21 -- # val= 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val=software 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val=32 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val=32 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val=1 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val=Yes 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val= 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:51.542 04:12:28 -- accel/accel.sh@21 -- # val= 00:05:51.542 04:12:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # IFS=: 00:05:51.542 04:12:28 -- accel/accel.sh@20 -- # read -r var val 00:05:52.527 04:12:29 -- accel/accel.sh@21 -- # val= 00:05:52.527 04:12:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # IFS=: 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # read -r var val 00:05:52.527 04:12:29 -- accel/accel.sh@21 -- # val= 00:05:52.527 04:12:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # IFS=: 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # read -r var val 00:05:52.527 04:12:29 -- accel/accel.sh@21 -- # val= 00:05:52.527 04:12:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # IFS=: 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # read -r var val 00:05:52.527 04:12:29 -- accel/accel.sh@21 -- # val= 00:05:52.527 04:12:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # IFS=: 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # read -r var val 00:05:52.527 04:12:29 -- accel/accel.sh@21 -- # val= 00:05:52.527 04:12:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # IFS=: 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # read -r var val 00:05:52.527 04:12:29 -- accel/accel.sh@21 -- # val= 00:05:52.527 04:12:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # IFS=: 00:05:52.527 04:12:29 -- accel/accel.sh@20 -- # read -r var val 00:05:52.527 04:12:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.527 04:12:29 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:52.527 04:12:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.527 00:05:52.527 real 0m2.969s 00:05:52.527 user 0m2.671s 00:05:52.527 sys 0m0.288s 00:05:52.527 04:12:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.527 04:12:29 -- common/autotest_common.sh@10 -- # set +x 00:05:52.527 ************************************ 00:05:52.527 END TEST accel_xor 00:05:52.527 ************************************ 00:05:52.790 04:12:29 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:52.790 04:12:29 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:52.790 04:12:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.790 04:12:29 -- common/autotest_common.sh@10 -- # set +x 00:05:52.790 ************************************ 00:05:52.790 START TEST accel_xor 00:05:52.790 ************************************ 00:05:52.790 04:12:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:52.790 04:12:29 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.790 04:12:29 -- accel/accel.sh@17 -- # local accel_module 00:05:52.790 04:12:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:52.790 04:12:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:52.790 04:12:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.791 04:12:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.791 04:12:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.791 04:12:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.791 04:12:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.791 04:12:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.791 04:12:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.791 04:12:29 -- accel/accel.sh@42 -- # jq -r . 00:05:52.791 [2024-11-28 04:12:29.854967] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.791 [2024-11-28 04:12:29.855058] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3785580 ] 00:05:52.791 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.791 [2024-11-28 04:12:29.918893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.791 [2024-11-28 04:12:30.048157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.164 04:12:31 -- accel/accel.sh@18 -- # out=' 00:05:54.164 SPDK Configuration: 00:05:54.164 Core mask: 0x1 00:05:54.164 00:05:54.164 Accel Perf Configuration: 00:05:54.164 Workload Type: xor 00:05:54.164 Source buffers: 3 00:05:54.164 Transfer size: 4096 bytes 00:05:54.164 Vector count 1 00:05:54.164 Module: software 00:05:54.164 Queue depth: 32 00:05:54.164 Allocate depth: 32 00:05:54.164 # threads/core: 1 00:05:54.164 Run time: 1 seconds 00:05:54.164 Verify: Yes 00:05:54.164 00:05:54.164 Running for 1 seconds... 00:05:54.164 00:05:54.164 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.164 ------------------------------------------------------------------------------------ 00:05:54.164 0,0 183008/s 714 MiB/s 0 0 00:05:54.164 ==================================================================================== 00:05:54.164 Total 183008/s 714 MiB/s 0 0' 00:05:54.164 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.164 04:12:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:54.164 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.164 04:12:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:54.164 04:12:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.164 04:12:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.164 04:12:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.164 04:12:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.164 04:12:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.164 04:12:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.164 04:12:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.164 04:12:31 -- accel/accel.sh@42 -- # jq -r . 00:05:54.164 [2024-11-28 04:12:31.346940] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.164 [2024-11-28 04:12:31.347022] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3785726 ] 00:05:54.164 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.164 [2024-11-28 04:12:31.409559] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.423 [2024-11-28 04:12:31.527221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.423 04:12:31 -- accel/accel.sh@21 -- # val= 00:05:54.423 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.423 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.423 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val= 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=0x1 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val= 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val= 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=xor 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=3 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val= 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=software 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=32 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=32 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=1 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val=Yes 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val= 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:54.424 04:12:31 -- accel/accel.sh@21 -- # val= 00:05:54.424 04:12:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # IFS=: 00:05:54.424 04:12:31 -- accel/accel.sh@20 -- # read -r var val 00:05:55.800 04:12:32 -- accel/accel.sh@21 -- # val= 00:05:55.800 04:12:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # IFS=: 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # read -r var val 00:05:55.800 04:12:32 -- accel/accel.sh@21 -- # val= 00:05:55.800 04:12:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # IFS=: 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # read -r var val 00:05:55.800 04:12:32 -- accel/accel.sh@21 -- # val= 00:05:55.800 04:12:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # IFS=: 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # read -r var val 00:05:55.800 04:12:32 -- accel/accel.sh@21 -- # val= 00:05:55.800 04:12:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # IFS=: 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # read -r var val 00:05:55.800 04:12:32 -- accel/accel.sh@21 -- # val= 00:05:55.800 04:12:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # IFS=: 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # read -r var val 00:05:55.800 04:12:32 -- accel/accel.sh@21 -- # val= 00:05:55.800 04:12:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # IFS=: 00:05:55.800 04:12:32 -- accel/accel.sh@20 -- # read -r var val 00:05:55.800 04:12:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.800 04:12:32 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:55.800 04:12:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.800 00:05:55.800 real 0m2.978s 00:05:55.800 user 0m2.674s 00:05:55.800 sys 0m0.294s 00:05:55.800 04:12:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.800 04:12:32 -- common/autotest_common.sh@10 -- # set +x 00:05:55.800 ************************************ 00:05:55.800 END TEST accel_xor 00:05:55.800 ************************************ 00:05:55.800 04:12:32 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:55.800 04:12:32 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:55.800 04:12:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.800 04:12:32 -- common/autotest_common.sh@10 -- # set +x 00:05:55.800 ************************************ 00:05:55.800 START TEST accel_dif_verify 00:05:55.800 ************************************ 00:05:55.800 04:12:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:55.800 04:12:32 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.800 04:12:32 -- accel/accel.sh@17 -- # local accel_module 00:05:55.800 04:12:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:55.800 04:12:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:55.800 04:12:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.800 04:12:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.800 04:12:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.800 04:12:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.800 04:12:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.800 04:12:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.800 04:12:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.800 04:12:32 -- accel/accel.sh@42 -- # jq -r . 00:05:55.800 [2024-11-28 04:12:32.859081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.800 [2024-11-28 04:12:32.859165] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3785890 ] 00:05:55.800 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.800 [2024-11-28 04:12:32.921604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.800 [2024-11-28 04:12:33.041755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.176 04:12:34 -- accel/accel.sh@18 -- # out=' 00:05:57.176 SPDK Configuration: 00:05:57.176 Core mask: 0x1 00:05:57.176 00:05:57.176 Accel Perf Configuration: 00:05:57.176 Workload Type: dif_verify 00:05:57.176 Vector size: 4096 bytes 00:05:57.176 Transfer size: 4096 bytes 00:05:57.176 Block size: 512 bytes 00:05:57.176 Metadata size: 8 bytes 00:05:57.176 Vector count 1 00:05:57.176 Module: software 00:05:57.176 Queue depth: 32 00:05:57.176 Allocate depth: 32 00:05:57.176 # threads/core: 1 00:05:57.176 Run time: 1 seconds 00:05:57.176 Verify: No 00:05:57.176 00:05:57.176 Running for 1 seconds... 00:05:57.176 00:05:57.176 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.176 ------------------------------------------------------------------------------------ 00:05:57.176 0,0 81856/s 324 MiB/s 0 0 00:05:57.176 ==================================================================================== 00:05:57.176 Total 81856/s 319 MiB/s 0 0' 00:05:57.176 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.176 04:12:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:57.176 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.176 04:12:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:57.176 04:12:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.176 04:12:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.176 04:12:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.176 04:12:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.176 04:12:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.176 04:12:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.176 04:12:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.176 04:12:34 -- accel/accel.sh@42 -- # jq -r . 00:05:57.176 [2024-11-28 04:12:34.338053] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.176 [2024-11-28 04:12:34.338138] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3786149 ] 00:05:57.176 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.176 [2024-11-28 04:12:34.399362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.434 [2024-11-28 04:12:34.520358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.434 04:12:34 -- accel/accel.sh@21 -- # val= 00:05:57.434 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.434 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.434 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.434 04:12:34 -- accel/accel.sh@21 -- # val= 00:05:57.434 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.434 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.434 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val=0x1 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val= 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val= 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val=dif_verify 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val= 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val=software 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@23 -- # accel_module=software 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val=32 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val=32 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val=1 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val=No 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val= 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:57.435 04:12:34 -- accel/accel.sh@21 -- # val= 00:05:57.435 04:12:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # IFS=: 00:05:57.435 04:12:34 -- accel/accel.sh@20 -- # read -r var val 00:05:58.806 04:12:35 -- accel/accel.sh@21 -- # val= 00:05:58.806 04:12:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # IFS=: 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # read -r var val 00:05:58.806 04:12:35 -- accel/accel.sh@21 -- # val= 00:05:58.806 04:12:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # IFS=: 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # read -r var val 00:05:58.806 04:12:35 -- accel/accel.sh@21 -- # val= 00:05:58.806 04:12:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # IFS=: 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # read -r var val 00:05:58.806 04:12:35 -- accel/accel.sh@21 -- # val= 00:05:58.806 04:12:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # IFS=: 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # read -r var val 00:05:58.806 04:12:35 -- accel/accel.sh@21 -- # val= 00:05:58.806 04:12:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # IFS=: 00:05:58.806 04:12:35 -- accel/accel.sh@20 -- # read -r var val 00:05:58.806 04:12:35 -- accel/accel.sh@21 -- # val= 00:05:58.806 04:12:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.807 04:12:35 -- accel/accel.sh@20 -- # IFS=: 00:05:58.807 04:12:35 -- accel/accel.sh@20 -- # read -r var val 00:05:58.807 04:12:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.807 04:12:35 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:58.807 04:12:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.807 00:05:58.807 real 0m2.964s 00:05:58.807 user 0m2.666s 00:05:58.807 sys 0m0.291s 00:05:58.807 04:12:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.807 04:12:35 -- common/autotest_common.sh@10 -- # set +x 00:05:58.807 ************************************ 00:05:58.807 END TEST accel_dif_verify 00:05:58.807 ************************************ 00:05:58.807 04:12:35 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:58.807 04:12:35 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:58.807 04:12:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.807 04:12:35 -- common/autotest_common.sh@10 -- # set +x 00:05:58.807 ************************************ 00:05:58.807 START TEST accel_dif_generate 00:05:58.807 ************************************ 00:05:58.807 04:12:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:58.807 04:12:35 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.807 04:12:35 -- accel/accel.sh@17 -- # local accel_module 00:05:58.807 04:12:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:58.807 04:12:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:58.807 04:12:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.807 04:12:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.807 04:12:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.807 04:12:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.807 04:12:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.807 04:12:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.807 04:12:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.807 04:12:35 -- accel/accel.sh@42 -- # jq -r . 00:05:58.807 [2024-11-28 04:12:35.849544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.807 [2024-11-28 04:12:35.849632] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3786312 ] 00:05:58.807 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.807 [2024-11-28 04:12:35.910635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.807 [2024-11-28 04:12:36.031290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.182 04:12:37 -- accel/accel.sh@18 -- # out=' 00:06:00.182 SPDK Configuration: 00:06:00.182 Core mask: 0x1 00:06:00.182 00:06:00.182 Accel Perf Configuration: 00:06:00.182 Workload Type: dif_generate 00:06:00.182 Vector size: 4096 bytes 00:06:00.182 Transfer size: 4096 bytes 00:06:00.182 Block size: 512 bytes 00:06:00.182 Metadata size: 8 bytes 00:06:00.182 Vector count 1 00:06:00.182 Module: software 00:06:00.182 Queue depth: 32 00:06:00.182 Allocate depth: 32 00:06:00.182 # threads/core: 1 00:06:00.182 Run time: 1 seconds 00:06:00.182 Verify: No 00:06:00.182 00:06:00.182 Running for 1 seconds... 00:06:00.182 00:06:00.182 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:00.182 ------------------------------------------------------------------------------------ 00:06:00.182 0,0 96352/s 382 MiB/s 0 0 00:06:00.182 ==================================================================================== 00:06:00.182 Total 96352/s 376 MiB/s 0 0' 00:06:00.182 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.182 04:12:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:00.182 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.182 04:12:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:00.182 04:12:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.182 04:12:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.182 04:12:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.182 04:12:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.182 04:12:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.182 04:12:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.182 04:12:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.182 04:12:37 -- accel/accel.sh@42 -- # jq -r . 00:06:00.182 [2024-11-28 04:12:37.321839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.182 [2024-11-28 04:12:37.321921] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3786457 ] 00:06:00.182 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.182 [2024-11-28 04:12:37.383121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.440 [2024-11-28 04:12:37.504466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val= 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val= 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val=0x1 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val= 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val= 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val=dif_generate 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val= 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val=software 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val=32 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val=32 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val=1 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val=No 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val= 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:00.440 04:12:37 -- accel/accel.sh@21 -- # val= 00:06:00.440 04:12:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # IFS=: 00:06:00.440 04:12:37 -- accel/accel.sh@20 -- # read -r var val 00:06:01.815 04:12:38 -- accel/accel.sh@21 -- # val= 00:06:01.815 04:12:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # IFS=: 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # read -r var val 00:06:01.815 04:12:38 -- accel/accel.sh@21 -- # val= 00:06:01.815 04:12:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # IFS=: 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # read -r var val 00:06:01.815 04:12:38 -- accel/accel.sh@21 -- # val= 00:06:01.815 04:12:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # IFS=: 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # read -r var val 00:06:01.815 04:12:38 -- accel/accel.sh@21 -- # val= 00:06:01.815 04:12:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # IFS=: 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # read -r var val 00:06:01.815 04:12:38 -- accel/accel.sh@21 -- # val= 00:06:01.815 04:12:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # IFS=: 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # read -r var val 00:06:01.815 04:12:38 -- accel/accel.sh@21 -- # val= 00:06:01.815 04:12:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # IFS=: 00:06:01.815 04:12:38 -- accel/accel.sh@20 -- # read -r var val 00:06:01.815 04:12:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.815 04:12:38 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:01.815 04:12:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.815 00:06:01.815 real 0m2.951s 00:06:01.815 user 0m2.654s 00:06:01.815 sys 0m0.290s 00:06:01.815 04:12:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.815 04:12:38 -- common/autotest_common.sh@10 -- # set +x 00:06:01.815 ************************************ 00:06:01.815 END TEST accel_dif_generate 00:06:01.815 ************************************ 00:06:01.815 04:12:38 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:01.815 04:12:38 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:01.815 04:12:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.815 04:12:38 -- common/autotest_common.sh@10 -- # set +x 00:06:01.815 ************************************ 00:06:01.815 START TEST accel_dif_generate_copy 00:06:01.815 ************************************ 00:06:01.815 04:12:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:01.815 04:12:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.815 04:12:38 -- accel/accel.sh@17 -- # local accel_module 00:06:01.815 04:12:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:01.815 04:12:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:01.815 04:12:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.815 04:12:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.815 04:12:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.815 04:12:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.815 04:12:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.815 04:12:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.815 04:12:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.815 04:12:38 -- accel/accel.sh@42 -- # jq -r . 00:06:01.815 [2024-11-28 04:12:38.827348] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.815 [2024-11-28 04:12:38.827429] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3786736 ] 00:06:01.815 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.815 [2024-11-28 04:12:38.883512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.815 [2024-11-28 04:12:39.003231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.189 04:12:40 -- accel/accel.sh@18 -- # out=' 00:06:03.189 SPDK Configuration: 00:06:03.189 Core mask: 0x1 00:06:03.189 00:06:03.189 Accel Perf Configuration: 00:06:03.189 Workload Type: dif_generate_copy 00:06:03.189 Vector size: 4096 bytes 00:06:03.189 Transfer size: 4096 bytes 00:06:03.189 Vector count 1 00:06:03.189 Module: software 00:06:03.189 Queue depth: 32 00:06:03.189 Allocate depth: 32 00:06:03.189 # threads/core: 1 00:06:03.189 Run time: 1 seconds 00:06:03.189 Verify: No 00:06:03.189 00:06:03.189 Running for 1 seconds... 00:06:03.189 00:06:03.189 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:03.189 ------------------------------------------------------------------------------------ 00:06:03.189 0,0 75520/s 299 MiB/s 0 0 00:06:03.189 ==================================================================================== 00:06:03.189 Total 75520/s 295 MiB/s 0 0' 00:06:03.189 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.189 04:12:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:03.189 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.189 04:12:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:03.189 04:12:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.189 04:12:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.189 04:12:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.189 04:12:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.189 04:12:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.189 04:12:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.189 04:12:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.189 04:12:40 -- accel/accel.sh@42 -- # jq -r . 00:06:03.189 [2024-11-28 04:12:40.305300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.189 [2024-11-28 04:12:40.305383] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3786878 ] 00:06:03.189 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.189 [2024-11-28 04:12:40.368617] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.189 [2024-11-28 04:12:40.487623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val= 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val= 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val=0x1 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val= 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val= 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val= 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val=software 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val=32 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val=32 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val=1 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val=No 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val= 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:03.446 04:12:40 -- accel/accel.sh@21 -- # val= 00:06:03.446 04:12:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # IFS=: 00:06:03.446 04:12:40 -- accel/accel.sh@20 -- # read -r var val 00:06:04.815 04:12:41 -- accel/accel.sh@21 -- # val= 00:06:04.815 04:12:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # IFS=: 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # read -r var val 00:06:04.815 04:12:41 -- accel/accel.sh@21 -- # val= 00:06:04.815 04:12:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # IFS=: 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # read -r var val 00:06:04.815 04:12:41 -- accel/accel.sh@21 -- # val= 00:06:04.815 04:12:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # IFS=: 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # read -r var val 00:06:04.815 04:12:41 -- accel/accel.sh@21 -- # val= 00:06:04.815 04:12:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # IFS=: 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # read -r var val 00:06:04.815 04:12:41 -- accel/accel.sh@21 -- # val= 00:06:04.815 04:12:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # IFS=: 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # read -r var val 00:06:04.815 04:12:41 -- accel/accel.sh@21 -- # val= 00:06:04.815 04:12:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # IFS=: 00:06:04.815 04:12:41 -- accel/accel.sh@20 -- # read -r var val 00:06:04.815 04:12:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.816 04:12:41 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:04.816 04:12:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.816 00:06:04.816 real 0m2.963s 00:06:04.816 user 0m2.659s 00:06:04.816 sys 0m0.294s 00:06:04.816 04:12:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.816 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:06:04.816 ************************************ 00:06:04.816 END TEST accel_dif_generate_copy 00:06:04.816 ************************************ 00:06:04.816 04:12:41 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:04.816 04:12:41 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:04.816 04:12:41 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:04.816 04:12:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.816 04:12:41 -- common/autotest_common.sh@10 -- # set +x 00:06:04.816 ************************************ 00:06:04.816 START TEST accel_comp 00:06:04.816 ************************************ 00:06:04.816 04:12:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:04.816 04:12:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.816 04:12:41 -- accel/accel.sh@17 -- # local accel_module 00:06:04.816 04:12:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:04.816 04:12:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:04.816 04:12:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.816 04:12:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.816 04:12:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.816 04:12:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.816 04:12:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.816 04:12:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.816 04:12:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.816 04:12:41 -- accel/accel.sh@42 -- # jq -r . 00:06:04.816 [2024-11-28 04:12:41.817101] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.816 [2024-11-28 04:12:41.817180] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3787044 ] 00:06:04.816 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.816 [2024-11-28 04:12:41.878670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.816 [2024-11-28 04:12:41.999001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.184 04:12:43 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:06.184 00:06:06.184 SPDK Configuration: 00:06:06.184 Core mask: 0x1 00:06:06.184 00:06:06.184 Accel Perf Configuration: 00:06:06.184 Workload Type: compress 00:06:06.184 Transfer size: 4096 bytes 00:06:06.184 Vector count 1 00:06:06.184 Module: software 00:06:06.184 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.184 Queue depth: 32 00:06:06.184 Allocate depth: 32 00:06:06.184 # threads/core: 1 00:06:06.184 Run time: 1 seconds 00:06:06.184 Verify: No 00:06:06.184 00:06:06.184 Running for 1 seconds... 00:06:06.184 00:06:06.184 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:06.184 ------------------------------------------------------------------------------------ 00:06:06.184 0,0 31488/s 131 MiB/s 0 0 00:06:06.184 ==================================================================================== 00:06:06.184 Total 31488/s 123 MiB/s 0 0' 00:06:06.184 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.184 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.184 04:12:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.184 04:12:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.184 04:12:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.184 04:12:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.184 04:12:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.184 04:12:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.184 04:12:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.184 04:12:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.184 04:12:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.184 04:12:43 -- accel/accel.sh@42 -- # jq -r . 00:06:06.184 [2024-11-28 04:12:43.303586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.184 [2024-11-28 04:12:43.303667] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3787254 ] 00:06:06.184 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.184 [2024-11-28 04:12:43.365220] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.184 [2024-11-28 04:12:43.485215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=0x1 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=compress 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=software 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=32 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=32 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=1 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val=No 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:06.442 04:12:43 -- accel/accel.sh@21 -- # val= 00:06:06.442 04:12:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # IFS=: 00:06:06.442 04:12:43 -- accel/accel.sh@20 -- # read -r var val 00:06:07.816 04:12:44 -- accel/accel.sh@21 -- # val= 00:06:07.816 04:12:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # IFS=: 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # read -r var val 00:06:07.816 04:12:44 -- accel/accel.sh@21 -- # val= 00:06:07.816 04:12:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # IFS=: 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # read -r var val 00:06:07.816 04:12:44 -- accel/accel.sh@21 -- # val= 00:06:07.816 04:12:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # IFS=: 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # read -r var val 00:06:07.816 04:12:44 -- accel/accel.sh@21 -- # val= 00:06:07.816 04:12:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # IFS=: 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # read -r var val 00:06:07.816 04:12:44 -- accel/accel.sh@21 -- # val= 00:06:07.816 04:12:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # IFS=: 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # read -r var val 00:06:07.816 04:12:44 -- accel/accel.sh@21 -- # val= 00:06:07.816 04:12:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # IFS=: 00:06:07.816 04:12:44 -- accel/accel.sh@20 -- # read -r var val 00:06:07.816 04:12:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.816 04:12:44 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:07.816 04:12:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.816 00:06:07.816 real 0m2.977s 00:06:07.816 user 0m2.676s 00:06:07.816 sys 0m0.293s 00:06:07.816 04:12:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.816 04:12:44 -- common/autotest_common.sh@10 -- # set +x 00:06:07.816 ************************************ 00:06:07.816 END TEST accel_comp 00:06:07.816 ************************************ 00:06:07.816 04:12:44 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:07.816 04:12:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:07.816 04:12:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.816 04:12:44 -- common/autotest_common.sh@10 -- # set +x 00:06:07.816 ************************************ 00:06:07.816 START TEST accel_decomp 00:06:07.816 ************************************ 00:06:07.816 04:12:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:07.816 04:12:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.816 04:12:44 -- accel/accel.sh@17 -- # local accel_module 00:06:07.816 04:12:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:07.816 04:12:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:07.816 04:12:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.816 04:12:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.816 04:12:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.816 04:12:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.816 04:12:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.816 04:12:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.816 04:12:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.816 04:12:44 -- accel/accel.sh@42 -- # jq -r . 00:06:07.816 [2024-11-28 04:12:44.819090] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.816 [2024-11-28 04:12:44.819171] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3787463 ] 00:06:07.816 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.816 [2024-11-28 04:12:44.876730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.816 [2024-11-28 04:12:44.995896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.189 04:12:46 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:09.189 00:06:09.189 SPDK Configuration: 00:06:09.189 Core mask: 0x1 00:06:09.189 00:06:09.189 Accel Perf Configuration: 00:06:09.189 Workload Type: decompress 00:06:09.189 Transfer size: 4096 bytes 00:06:09.189 Vector count 1 00:06:09.189 Module: software 00:06:09.189 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.189 Queue depth: 32 00:06:09.189 Allocate depth: 32 00:06:09.189 # threads/core: 1 00:06:09.189 Run time: 1 seconds 00:06:09.189 Verify: Yes 00:06:09.189 00:06:09.189 Running for 1 seconds... 00:06:09.189 00:06:09.189 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:09.189 ------------------------------------------------------------------------------------ 00:06:09.189 0,0 55424/s 102 MiB/s 0 0 00:06:09.189 ==================================================================================== 00:06:09.189 Total 55424/s 216 MiB/s 0 0' 00:06:09.189 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.189 04:12:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:09.189 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.189 04:12:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:09.189 04:12:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.189 04:12:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.189 04:12:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.189 04:12:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.189 04:12:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.189 04:12:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.189 04:12:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.189 04:12:46 -- accel/accel.sh@42 -- # jq -r . 00:06:09.189 [2024-11-28 04:12:46.302127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.189 [2024-11-28 04:12:46.302210] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3787608 ] 00:06:09.189 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.189 [2024-11-28 04:12:46.364282] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.189 [2024-11-28 04:12:46.481300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=0x1 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=decompress 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=software 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=32 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=32 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=1 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val=Yes 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:09.448 04:12:46 -- accel/accel.sh@21 -- # val= 00:06:09.448 04:12:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # IFS=: 00:06:09.448 04:12:46 -- accel/accel.sh@20 -- # read -r var val 00:06:10.822 04:12:47 -- accel/accel.sh@21 -- # val= 00:06:10.822 04:12:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # IFS=: 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # read -r var val 00:06:10.822 04:12:47 -- accel/accel.sh@21 -- # val= 00:06:10.822 04:12:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # IFS=: 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # read -r var val 00:06:10.822 04:12:47 -- accel/accel.sh@21 -- # val= 00:06:10.822 04:12:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # IFS=: 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # read -r var val 00:06:10.822 04:12:47 -- accel/accel.sh@21 -- # val= 00:06:10.822 04:12:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # IFS=: 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # read -r var val 00:06:10.822 04:12:47 -- accel/accel.sh@21 -- # val= 00:06:10.822 04:12:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # IFS=: 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # read -r var val 00:06:10.822 04:12:47 -- accel/accel.sh@21 -- # val= 00:06:10.822 04:12:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # IFS=: 00:06:10.822 04:12:47 -- accel/accel.sh@20 -- # read -r var val 00:06:10.822 04:12:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.822 04:12:47 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:10.822 04:12:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.822 00:06:10.822 real 0m2.953s 00:06:10.822 user 0m2.672s 00:06:10.822 sys 0m0.274s 00:06:10.822 04:12:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.822 04:12:47 -- common/autotest_common.sh@10 -- # set +x 00:06:10.822 ************************************ 00:06:10.822 END TEST accel_decomp 00:06:10.822 ************************************ 00:06:10.822 04:12:47 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:10.822 04:12:47 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:10.822 04:12:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.822 04:12:47 -- common/autotest_common.sh@10 -- # set +x 00:06:10.822 ************************************ 00:06:10.822 START TEST accel_decmop_full 00:06:10.822 ************************************ 00:06:10.822 04:12:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:10.822 04:12:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.822 04:12:47 -- accel/accel.sh@17 -- # local accel_module 00:06:10.822 04:12:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:10.822 04:12:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:10.822 04:12:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.822 04:12:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.822 04:12:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.822 04:12:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.822 04:12:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.822 04:12:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.822 04:12:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.822 04:12:47 -- accel/accel.sh@42 -- # jq -r . 00:06:10.822 [2024-11-28 04:12:47.799714] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.822 [2024-11-28 04:12:47.799799] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3787786 ] 00:06:10.822 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.822 [2024-11-28 04:12:47.864037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.822 [2024-11-28 04:12:47.984260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.197 04:12:49 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:12.197 00:06:12.197 SPDK Configuration: 00:06:12.197 Core mask: 0x1 00:06:12.197 00:06:12.197 Accel Perf Configuration: 00:06:12.197 Workload Type: decompress 00:06:12.197 Transfer size: 111250 bytes 00:06:12.197 Vector count 1 00:06:12.197 Module: software 00:06:12.197 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.197 Queue depth: 32 00:06:12.197 Allocate depth: 32 00:06:12.197 # threads/core: 1 00:06:12.197 Run time: 1 seconds 00:06:12.197 Verify: Yes 00:06:12.197 00:06:12.197 Running for 1 seconds... 00:06:12.197 00:06:12.197 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.197 ------------------------------------------------------------------------------------ 00:06:12.197 0,0 3808/s 157 MiB/s 0 0 00:06:12.197 ==================================================================================== 00:06:12.197 Total 3808/s 404 MiB/s 0 0' 00:06:12.197 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.197 04:12:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:12.197 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.197 04:12:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:12.197 04:12:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.197 04:12:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.197 04:12:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.197 04:12:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.197 04:12:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.197 04:12:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.197 04:12:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.197 04:12:49 -- accel/accel.sh@42 -- # jq -r . 00:06:12.197 [2024-11-28 04:12:49.308296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.197 [2024-11-28 04:12:49.308379] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3788032 ] 00:06:12.197 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.197 [2024-11-28 04:12:49.370047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.197 [2024-11-28 04:12:49.488929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.455 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.455 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.455 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.455 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.455 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.455 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.455 04:12:49 -- accel/accel.sh@21 -- # val=0x1 00:06:12.455 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.455 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.455 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.455 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val=decompress 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val=software 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val=32 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val=32 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val=1 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val=Yes 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:12.456 04:12:49 -- accel/accel.sh@21 -- # val= 00:06:12.456 04:12:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # IFS=: 00:06:12.456 04:12:49 -- accel/accel.sh@20 -- # read -r var val 00:06:13.830 04:12:50 -- accel/accel.sh@21 -- # val= 00:06:13.830 04:12:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # IFS=: 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # read -r var val 00:06:13.830 04:12:50 -- accel/accel.sh@21 -- # val= 00:06:13.830 04:12:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # IFS=: 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # read -r var val 00:06:13.830 04:12:50 -- accel/accel.sh@21 -- # val= 00:06:13.830 04:12:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # IFS=: 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # read -r var val 00:06:13.830 04:12:50 -- accel/accel.sh@21 -- # val= 00:06:13.830 04:12:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # IFS=: 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # read -r var val 00:06:13.830 04:12:50 -- accel/accel.sh@21 -- # val= 00:06:13.830 04:12:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # IFS=: 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # read -r var val 00:06:13.830 04:12:50 -- accel/accel.sh@21 -- # val= 00:06:13.830 04:12:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # IFS=: 00:06:13.830 04:12:50 -- accel/accel.sh@20 -- # read -r var val 00:06:13.830 04:12:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.830 04:12:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:13.830 04:12:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.830 00:06:13.830 real 0m2.997s 00:06:13.830 user 0m2.706s 00:06:13.830 sys 0m0.282s 00:06:13.830 04:12:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.830 04:12:50 -- common/autotest_common.sh@10 -- # set +x 00:06:13.830 ************************************ 00:06:13.830 END TEST accel_decmop_full 00:06:13.830 ************************************ 00:06:13.830 04:12:50 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.830 04:12:50 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:13.830 04:12:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.830 04:12:50 -- common/autotest_common.sh@10 -- # set +x 00:06:13.830 ************************************ 00:06:13.830 START TEST accel_decomp_mcore 00:06:13.830 ************************************ 00:06:13.830 04:12:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.830 04:12:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.830 04:12:50 -- accel/accel.sh@17 -- # local accel_module 00:06:13.830 04:12:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.830 04:12:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.830 04:12:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.830 04:12:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.830 04:12:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.830 04:12:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.830 04:12:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.830 04:12:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.830 04:12:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.830 04:12:50 -- accel/accel.sh@42 -- # jq -r . 00:06:13.830 [2024-11-28 04:12:50.823008] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.830 [2024-11-28 04:12:50.823090] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3788196 ] 00:06:13.830 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.830 [2024-11-28 04:12:50.891094] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:13.830 [2024-11-28 04:12:51.015225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:13.830 [2024-11-28 04:12:51.015284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:13.830 [2024-11-28 04:12:51.015336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:13.830 [2024-11-28 04:12:51.015340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.206 04:12:52 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:15.206 00:06:15.206 SPDK Configuration: 00:06:15.206 Core mask: 0xf 00:06:15.206 00:06:15.206 Accel Perf Configuration: 00:06:15.206 Workload Type: decompress 00:06:15.206 Transfer size: 4096 bytes 00:06:15.206 Vector count 1 00:06:15.206 Module: software 00:06:15.206 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.206 Queue depth: 32 00:06:15.206 Allocate depth: 32 00:06:15.206 # threads/core: 1 00:06:15.206 Run time: 1 seconds 00:06:15.206 Verify: Yes 00:06:15.206 00:06:15.206 Running for 1 seconds... 00:06:15.206 00:06:15.206 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.206 ------------------------------------------------------------------------------------ 00:06:15.206 0,0 50240/s 92 MiB/s 0 0 00:06:15.206 3,0 50400/s 92 MiB/s 0 0 00:06:15.206 2,0 50400/s 92 MiB/s 0 0 00:06:15.206 1,0 50432/s 92 MiB/s 0 0 00:06:15.206 ==================================================================================== 00:06:15.206 Total 201472/s 787 MiB/s 0 0' 00:06:15.206 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.206 04:12:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:15.206 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.206 04:12:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:15.206 04:12:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.206 04:12:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.206 04:12:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.206 04:12:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.206 04:12:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.206 04:12:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.206 04:12:52 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.206 04:12:52 -- accel/accel.sh@42 -- # jq -r . 00:06:15.206 [2024-11-28 04:12:52.327699] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.206 [2024-11-28 04:12:52.327775] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3788348 ] 00:06:15.206 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.206 [2024-11-28 04:12:52.388016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:15.206 [2024-11-28 04:12:52.508614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.206 [2024-11-28 04:12:52.508660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.206 [2024-11-28 04:12:52.508709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:15.206 [2024-11-28 04:12:52.508713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=0xf 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=decompress 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=software 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=32 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=32 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=1 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val=Yes 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:15.465 04:12:52 -- accel/accel.sh@21 -- # val= 00:06:15.465 04:12:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # IFS=: 00:06:15.465 04:12:52 -- accel/accel.sh@20 -- # read -r var val 00:06:16.840 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.840 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.840 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.840 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.840 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.840 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.840 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.840 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.840 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.840 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.840 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.840 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.840 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.841 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.841 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.841 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.841 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.841 04:12:53 -- accel/accel.sh@21 -- # val= 00:06:16.841 04:12:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # IFS=: 00:06:16.841 04:12:53 -- accel/accel.sh@20 -- # read -r var val 00:06:16.841 04:12:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.841 04:12:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:16.841 04:12:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.841 00:06:16.841 real 0m2.997s 00:06:16.841 user 0m9.604s 00:06:16.841 sys 0m0.324s 00:06:16.841 04:12:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.841 04:12:53 -- common/autotest_common.sh@10 -- # set +x 00:06:16.841 ************************************ 00:06:16.841 END TEST accel_decomp_mcore 00:06:16.841 ************************************ 00:06:16.841 04:12:53 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.841 04:12:53 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:16.841 04:12:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.841 04:12:53 -- common/autotest_common.sh@10 -- # set +x 00:06:16.841 ************************************ 00:06:16.841 START TEST accel_decomp_full_mcore 00:06:16.841 ************************************ 00:06:16.841 04:12:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.841 04:12:53 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.841 04:12:53 -- accel/accel.sh@17 -- # local accel_module 00:06:16.841 04:12:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.841 04:12:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.841 04:12:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.841 04:12:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.841 04:12:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.841 04:12:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.841 04:12:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.841 04:12:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.841 04:12:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.841 04:12:53 -- accel/accel.sh@42 -- # jq -r . 00:06:16.841 [2024-11-28 04:12:53.849069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.841 [2024-11-28 04:12:53.849153] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3788619 ] 00:06:16.841 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.841 [2024-11-28 04:12:53.908652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:16.841 [2024-11-28 04:12:54.031898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.841 [2024-11-28 04:12:54.031952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:16.841 [2024-11-28 04:12:54.032006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:16.841 [2024-11-28 04:12:54.032009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.217 04:12:55 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:18.217 00:06:18.217 SPDK Configuration: 00:06:18.217 Core mask: 0xf 00:06:18.217 00:06:18.217 Accel Perf Configuration: 00:06:18.217 Workload Type: decompress 00:06:18.217 Transfer size: 111250 bytes 00:06:18.218 Vector count 1 00:06:18.218 Module: software 00:06:18.218 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.218 Queue depth: 32 00:06:18.218 Allocate depth: 32 00:06:18.218 # threads/core: 1 00:06:18.218 Run time: 1 seconds 00:06:18.218 Verify: Yes 00:06:18.218 00:06:18.218 Running for 1 seconds... 00:06:18.218 00:06:18.218 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:18.218 ------------------------------------------------------------------------------------ 00:06:18.218 0,0 3776/s 155 MiB/s 0 0 00:06:18.218 3,0 3776/s 155 MiB/s 0 0 00:06:18.218 2,0 3776/s 155 MiB/s 0 0 00:06:18.218 1,0 3776/s 155 MiB/s 0 0 00:06:18.218 ==================================================================================== 00:06:18.218 Total 15104/s 1602 MiB/s 0 0' 00:06:18.218 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.218 04:12:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.218 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.218 04:12:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.218 04:12:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.218 04:12:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.218 04:12:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.218 04:12:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.218 04:12:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.218 04:12:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.218 04:12:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.218 04:12:55 -- accel/accel.sh@42 -- # jq -r . 00:06:18.218 [2024-11-28 04:12:55.348217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.218 [2024-11-28 04:12:55.348300] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3788773 ] 00:06:18.218 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.218 [2024-11-28 04:12:55.410992] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:18.476 [2024-11-28 04:12:55.535280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.476 [2024-11-28 04:12:55.535337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.476 [2024-11-28 04:12:55.535388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:18.476 [2024-11-28 04:12:55.535391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=0xf 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=decompress 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=software 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@23 -- # accel_module=software 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=32 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=32 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=1 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val=Yes 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.476 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:18.476 04:12:55 -- accel/accel.sh@21 -- # val= 00:06:18.476 04:12:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.477 04:12:55 -- accel/accel.sh@20 -- # IFS=: 00:06:18.477 04:12:55 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@21 -- # val= 00:06:19.878 04:12:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # IFS=: 00:06:19.878 04:12:56 -- accel/accel.sh@20 -- # read -r var val 00:06:19.878 04:12:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.878 04:12:56 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:19.878 04:12:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.878 00:06:19.878 real 0m3.012s 00:06:19.878 user 0m9.710s 00:06:19.878 sys 0m0.299s 00:06:19.878 04:12:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.878 04:12:56 -- common/autotest_common.sh@10 -- # set +x 00:06:19.878 ************************************ 00:06:19.878 END TEST accel_decomp_full_mcore 00:06:19.878 ************************************ 00:06:19.878 04:12:56 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.878 04:12:56 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:19.878 04:12:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.878 04:12:56 -- common/autotest_common.sh@10 -- # set +x 00:06:19.878 ************************************ 00:06:19.878 START TEST accel_decomp_mthread 00:06:19.878 ************************************ 00:06:19.878 04:12:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.878 04:12:56 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.878 04:12:56 -- accel/accel.sh@17 -- # local accel_module 00:06:19.879 04:12:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.879 04:12:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.879 04:12:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.879 04:12:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.879 04:12:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.879 04:12:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.879 04:12:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.879 04:12:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.879 04:12:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.879 04:12:56 -- accel/accel.sh@42 -- # jq -r . 00:06:19.879 [2024-11-28 04:12:56.889508] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.879 [2024-11-28 04:12:56.889611] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3788969 ] 00:06:19.879 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.879 [2024-11-28 04:12:56.953292] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.879 [2024-11-28 04:12:57.071136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.252 04:12:58 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:21.252 00:06:21.252 SPDK Configuration: 00:06:21.252 Core mask: 0x1 00:06:21.252 00:06:21.252 Accel Perf Configuration: 00:06:21.252 Workload Type: decompress 00:06:21.252 Transfer size: 4096 bytes 00:06:21.252 Vector count 1 00:06:21.252 Module: software 00:06:21.252 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.252 Queue depth: 32 00:06:21.252 Allocate depth: 32 00:06:21.252 # threads/core: 2 00:06:21.252 Run time: 1 seconds 00:06:21.252 Verify: Yes 00:06:21.252 00:06:21.252 Running for 1 seconds... 00:06:21.252 00:06:21.252 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:21.252 ------------------------------------------------------------------------------------ 00:06:21.252 0,1 27936/s 51 MiB/s 0 0 00:06:21.252 0,0 27808/s 51 MiB/s 0 0 00:06:21.252 ==================================================================================== 00:06:21.252 Total 55744/s 217 MiB/s 0 0' 00:06:21.252 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.252 04:12:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:21.252 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.252 04:12:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:21.252 04:12:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.252 04:12:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.252 04:12:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.252 04:12:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.252 04:12:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.252 04:12:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.252 04:12:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.252 04:12:58 -- accel/accel.sh@42 -- # jq -r . 00:06:21.252 [2024-11-28 04:12:58.363826] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.252 [2024-11-28 04:12:58.363909] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3789199 ] 00:06:21.252 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.252 [2024-11-28 04:12:58.426704] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.252 [2024-11-28 04:12:58.546817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val=0x1 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val=decompress 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val=software 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.569 04:12:58 -- accel/accel.sh@23 -- # accel_module=software 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.569 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.569 04:12:58 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.569 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.570 04:12:58 -- accel/accel.sh@21 -- # val=32 00:06:21.570 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.570 04:12:58 -- accel/accel.sh@21 -- # val=32 00:06:21.570 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.570 04:12:58 -- accel/accel.sh@21 -- # val=2 00:06:21.570 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.570 04:12:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.570 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.570 04:12:58 -- accel/accel.sh@21 -- # val=Yes 00:06:21.570 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.570 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.570 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:21.570 04:12:58 -- accel/accel.sh@21 -- # val= 00:06:21.570 04:12:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # IFS=: 00:06:21.570 04:12:58 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@21 -- # val= 00:06:22.534 04:12:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # IFS=: 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@21 -- # val= 00:06:22.534 04:12:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # IFS=: 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@21 -- # val= 00:06:22.534 04:12:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # IFS=: 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@21 -- # val= 00:06:22.534 04:12:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # IFS=: 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@21 -- # val= 00:06:22.534 04:12:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # IFS=: 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@21 -- # val= 00:06:22.534 04:12:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # IFS=: 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@21 -- # val= 00:06:22.534 04:12:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # IFS=: 00:06:22.534 04:12:59 -- accel/accel.sh@20 -- # read -r var val 00:06:22.534 04:12:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:22.534 04:12:59 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:22.534 04:12:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.534 00:06:22.534 real 0m2.971s 00:06:22.534 user 0m2.677s 00:06:22.534 sys 0m0.286s 00:06:22.534 04:12:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.534 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:06:22.534 ************************************ 00:06:22.534 END TEST accel_decomp_mthread 00:06:22.534 ************************************ 00:06:22.793 04:12:59 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:22.793 04:12:59 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:22.793 04:12:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.793 04:12:59 -- common/autotest_common.sh@10 -- # set +x 00:06:22.793 ************************************ 00:06:22.793 START TEST accel_deomp_full_mthread 00:06:22.793 ************************************ 00:06:22.793 04:12:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:22.793 04:12:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:22.793 04:12:59 -- accel/accel.sh@17 -- # local accel_module 00:06:22.793 04:12:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:22.793 04:12:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:22.793 04:12:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.793 04:12:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.793 04:12:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.793 04:12:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.793 04:12:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.793 04:12:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.793 04:12:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.793 04:12:59 -- accel/accel.sh@42 -- # jq -r . 00:06:22.793 [2024-11-28 04:12:59.888571] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.793 [2024-11-28 04:12:59.888648] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3789359 ] 00:06:22.793 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.793 [2024-11-28 04:12:59.950731] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.793 [2024-11-28 04:13:00.077017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.164 04:13:01 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:24.164 00:06:24.164 SPDK Configuration: 00:06:24.164 Core mask: 0x1 00:06:24.164 00:06:24.164 Accel Perf Configuration: 00:06:24.164 Workload Type: decompress 00:06:24.164 Transfer size: 111250 bytes 00:06:24.164 Vector count 1 00:06:24.164 Module: software 00:06:24.164 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.164 Queue depth: 32 00:06:24.164 Allocate depth: 32 00:06:24.164 # threads/core: 2 00:06:24.164 Run time: 1 seconds 00:06:24.164 Verify: Yes 00:06:24.164 00:06:24.164 Running for 1 seconds... 00:06:24.164 00:06:24.164 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:24.164 ------------------------------------------------------------------------------------ 00:06:24.164 0,1 1952/s 80 MiB/s 0 0 00:06:24.164 0,0 1920/s 79 MiB/s 0 0 00:06:24.164 ==================================================================================== 00:06:24.164 Total 3872/s 410 MiB/s 0 0' 00:06:24.164 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.164 04:13:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:24.164 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.164 04:13:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:24.164 04:13:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.164 04:13:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.164 04:13:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.164 04:13:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.164 04:13:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.164 04:13:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.164 04:13:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.164 04:13:01 -- accel/accel.sh@42 -- # jq -r . 00:06:24.164 [2024-11-28 04:13:01.416974] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.164 [2024-11-28 04:13:01.417054] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3789516 ] 00:06:24.164 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.422 [2024-11-28 04:13:01.479334] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.422 [2024-11-28 04:13:01.601223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=0x1 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=decompress 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=software 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@23 -- # accel_module=software 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=32 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=32 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=2 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val=Yes 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:24.422 04:13:01 -- accel/accel.sh@21 -- # val= 00:06:24.422 04:13:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # IFS=: 00:06:24.422 04:13:01 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@21 -- # val= 00:06:25.796 04:13:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # IFS=: 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@21 -- # val= 00:06:25.796 04:13:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # IFS=: 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@21 -- # val= 00:06:25.796 04:13:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # IFS=: 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@21 -- # val= 00:06:25.796 04:13:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # IFS=: 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@21 -- # val= 00:06:25.796 04:13:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # IFS=: 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@21 -- # val= 00:06:25.796 04:13:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # IFS=: 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@21 -- # val= 00:06:25.796 04:13:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # IFS=: 00:06:25.796 04:13:02 -- accel/accel.sh@20 -- # read -r var val 00:06:25.796 04:13:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:25.796 04:13:02 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:25.796 04:13:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:25.796 00:06:25.796 real 0m3.052s 00:06:25.796 user 0m2.752s 00:06:25.796 sys 0m0.291s 00:06:25.796 04:13:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.796 04:13:02 -- common/autotest_common.sh@10 -- # set +x 00:06:25.796 ************************************ 00:06:25.796 END TEST accel_deomp_full_mthread 00:06:25.796 ************************************ 00:06:25.796 04:13:02 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:25.796 04:13:02 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:25.796 04:13:02 -- accel/accel.sh@129 -- # build_accel_config 00:06:25.796 04:13:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:25.796 04:13:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.796 04:13:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.796 04:13:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.796 04:13:02 -- common/autotest_common.sh@10 -- # set +x 00:06:25.796 04:13:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.796 04:13:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.796 04:13:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.796 04:13:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.796 04:13:02 -- accel/accel.sh@42 -- # jq -r . 00:06:25.796 ************************************ 00:06:25.796 START TEST accel_dif_functional_tests 00:06:25.796 ************************************ 00:06:25.796 04:13:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:25.796 [2024-11-28 04:13:02.986258] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.796 [2024-11-28 04:13:02.986330] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3789783 ] 00:06:25.796 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.796 [2024-11-28 04:13:03.047450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:26.053 [2024-11-28 04:13:03.170775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.054 [2024-11-28 04:13:03.170829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.054 [2024-11-28 04:13:03.170833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.054 00:06:26.054 00:06:26.054 CUnit - A unit testing framework for C - Version 2.1-3 00:06:26.054 http://cunit.sourceforge.net/ 00:06:26.054 00:06:26.054 00:06:26.054 Suite: accel_dif 00:06:26.054 Test: verify: DIF generated, GUARD check ...passed 00:06:26.054 Test: verify: DIF generated, APPTAG check ...passed 00:06:26.054 Test: verify: DIF generated, REFTAG check ...passed 00:06:26.054 Test: verify: DIF not generated, GUARD check ...[2024-11-28 04:13:03.271780] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:26.054 [2024-11-28 04:13:03.271849] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:26.054 passed 00:06:26.054 Test: verify: DIF not generated, APPTAG check ...[2024-11-28 04:13:03.271892] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:26.054 [2024-11-28 04:13:03.271922] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:26.054 passed 00:06:26.054 Test: verify: DIF not generated, REFTAG check ...[2024-11-28 04:13:03.271958] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:26.054 [2024-11-28 04:13:03.271986] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:26.054 passed 00:06:26.054 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:26.054 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-28 04:13:03.272065] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:26.054 passed 00:06:26.054 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:26.054 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:26.054 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:26.054 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-28 04:13:03.272232] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:26.054 passed 00:06:26.054 Test: generate copy: DIF generated, GUARD check ...passed 00:06:26.054 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:26.054 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:26.054 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:26.054 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:26.054 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:26.054 Test: generate copy: iovecs-len validate ...[2024-11-28 04:13:03.272491] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:26.054 passed 00:06:26.054 Test: generate copy: buffer alignment validate ...passed 00:06:26.054 00:06:26.054 Run Summary: Type Total Ran Passed Failed Inactive 00:06:26.054 suites 1 1 n/a 0 0 00:06:26.054 tests 20 20 20 0 0 00:06:26.054 asserts 204 204 204 0 n/a 00:06:26.054 00:06:26.054 Elapsed time = 0.003 seconds 00:06:26.313 00:06:26.313 real 0m0.590s 00:06:26.313 user 0m0.907s 00:06:26.313 sys 0m0.169s 00:06:26.313 04:13:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.313 04:13:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.313 ************************************ 00:06:26.313 END TEST accel_dif_functional_tests 00:06:26.313 ************************************ 00:06:26.313 00:06:26.313 real 1m3.445s 00:06:26.313 user 1m11.245s 00:06:26.313 sys 0m7.334s 00:06:26.313 04:13:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.313 04:13:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.313 ************************************ 00:06:26.313 END TEST accel 00:06:26.313 ************************************ 00:06:26.313 04:13:03 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:26.313 04:13:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.313 04:13:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.313 04:13:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.313 ************************************ 00:06:26.313 START TEST accel_rpc 00:06:26.313 ************************************ 00:06:26.313 04:13:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:26.571 * Looking for test storage... 00:06:26.571 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:26.571 04:13:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:26.571 04:13:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:26.571 04:13:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:26.571 04:13:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:26.571 04:13:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:26.571 04:13:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:26.571 04:13:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:26.571 04:13:03 -- scripts/common.sh@335 -- # IFS=.-: 00:06:26.571 04:13:03 -- scripts/common.sh@335 -- # read -ra ver1 00:06:26.571 04:13:03 -- scripts/common.sh@336 -- # IFS=.-: 00:06:26.571 04:13:03 -- scripts/common.sh@336 -- # read -ra ver2 00:06:26.571 04:13:03 -- scripts/common.sh@337 -- # local 'op=<' 00:06:26.571 04:13:03 -- scripts/common.sh@339 -- # ver1_l=2 00:06:26.571 04:13:03 -- scripts/common.sh@340 -- # ver2_l=1 00:06:26.571 04:13:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:26.571 04:13:03 -- scripts/common.sh@343 -- # case "$op" in 00:06:26.571 04:13:03 -- scripts/common.sh@344 -- # : 1 00:06:26.571 04:13:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:26.571 04:13:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:26.571 04:13:03 -- scripts/common.sh@364 -- # decimal 1 00:06:26.571 04:13:03 -- scripts/common.sh@352 -- # local d=1 00:06:26.571 04:13:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:26.571 04:13:03 -- scripts/common.sh@354 -- # echo 1 00:06:26.571 04:13:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:26.571 04:13:03 -- scripts/common.sh@365 -- # decimal 2 00:06:26.571 04:13:03 -- scripts/common.sh@352 -- # local d=2 00:06:26.571 04:13:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:26.571 04:13:03 -- scripts/common.sh@354 -- # echo 2 00:06:26.571 04:13:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:26.571 04:13:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:26.571 04:13:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:26.571 04:13:03 -- scripts/common.sh@367 -- # return 0 00:06:26.571 04:13:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:26.571 04:13:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:26.571 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.571 --rc genhtml_branch_coverage=1 00:06:26.571 --rc genhtml_function_coverage=1 00:06:26.571 --rc genhtml_legend=1 00:06:26.571 --rc geninfo_all_blocks=1 00:06:26.571 --rc geninfo_unexecuted_blocks=1 00:06:26.571 00:06:26.571 ' 00:06:26.571 04:13:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:26.571 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.571 --rc genhtml_branch_coverage=1 00:06:26.571 --rc genhtml_function_coverage=1 00:06:26.571 --rc genhtml_legend=1 00:06:26.571 --rc geninfo_all_blocks=1 00:06:26.571 --rc geninfo_unexecuted_blocks=1 00:06:26.571 00:06:26.571 ' 00:06:26.571 04:13:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:26.571 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.571 --rc genhtml_branch_coverage=1 00:06:26.571 --rc genhtml_function_coverage=1 00:06:26.571 --rc genhtml_legend=1 00:06:26.571 --rc geninfo_all_blocks=1 00:06:26.571 --rc geninfo_unexecuted_blocks=1 00:06:26.571 00:06:26.571 ' 00:06:26.571 04:13:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:26.571 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.571 --rc genhtml_branch_coverage=1 00:06:26.571 --rc genhtml_function_coverage=1 00:06:26.571 --rc genhtml_legend=1 00:06:26.571 --rc geninfo_all_blocks=1 00:06:26.571 --rc geninfo_unexecuted_blocks=1 00:06:26.571 00:06:26.571 ' 00:06:26.571 04:13:03 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:26.571 04:13:03 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3789932 00:06:26.571 04:13:03 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:26.571 04:13:03 -- accel/accel_rpc.sh@15 -- # waitforlisten 3789932 00:06:26.571 04:13:03 -- common/autotest_common.sh@829 -- # '[' -z 3789932 ']' 00:06:26.571 04:13:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.571 04:13:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.571 04:13:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.571 04:13:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.571 04:13:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.572 [2024-11-28 04:13:03.781138] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.572 [2024-11-28 04:13:03.781216] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3789932 ] 00:06:26.572 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.572 [2024-11-28 04:13:03.838936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.841 [2024-11-28 04:13:03.945107] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:26.841 [2024-11-28 04:13:03.945269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.841 04:13:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.841 04:13:03 -- common/autotest_common.sh@862 -- # return 0 00:06:26.841 04:13:03 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:26.841 04:13:03 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:26.841 04:13:03 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:26.841 04:13:03 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:26.841 04:13:03 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:26.841 04:13:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.841 04:13:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.841 04:13:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.841 ************************************ 00:06:26.841 START TEST accel_assign_opcode 00:06:26.841 ************************************ 00:06:26.841 04:13:03 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:26.841 04:13:03 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:26.841 04:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:26.841 04:13:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.841 [2024-11-28 04:13:04.001856] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:26.841 04:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:26.841 04:13:04 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:26.841 04:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:26.842 04:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:26.842 [2024-11-28 04:13:04.009877] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:26.842 04:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:26.842 04:13:04 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:26.842 04:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:26.842 04:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:27.101 04:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.101 04:13:04 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:27.101 04:13:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.101 04:13:04 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:27.101 04:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:27.101 04:13:04 -- accel/accel_rpc.sh@42 -- # grep software 00:06:27.101 04:13:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.101 software 00:06:27.101 00:06:27.101 real 0m0.286s 00:06:27.101 user 0m0.034s 00:06:27.101 sys 0m0.008s 00:06:27.101 04:13:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.101 04:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:27.101 ************************************ 00:06:27.101 END TEST accel_assign_opcode 00:06:27.101 ************************************ 00:06:27.101 04:13:04 -- accel/accel_rpc.sh@55 -- # killprocess 3789932 00:06:27.101 04:13:04 -- common/autotest_common.sh@936 -- # '[' -z 3789932 ']' 00:06:27.101 04:13:04 -- common/autotest_common.sh@940 -- # kill -0 3789932 00:06:27.101 04:13:04 -- common/autotest_common.sh@941 -- # uname 00:06:27.101 04:13:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.101 04:13:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3789932 00:06:27.101 04:13:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.101 04:13:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.101 04:13:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3789932' 00:06:27.101 killing process with pid 3789932 00:06:27.101 04:13:04 -- common/autotest_common.sh@955 -- # kill 3789932 00:06:27.101 04:13:04 -- common/autotest_common.sh@960 -- # wait 3789932 00:06:27.668 00:06:27.668 real 0m1.228s 00:06:27.668 user 0m1.137s 00:06:27.668 sys 0m0.447s 00:06:27.668 04:13:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.668 04:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:27.668 ************************************ 00:06:27.668 END TEST accel_rpc 00:06:27.668 ************************************ 00:06:27.668 04:13:04 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:27.668 04:13:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.668 04:13:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.668 04:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:27.668 ************************************ 00:06:27.668 START TEST app_cmdline 00:06:27.668 ************************************ 00:06:27.668 04:13:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:27.668 * Looking for test storage... 00:06:27.668 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:27.668 04:13:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.668 04:13:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.668 04:13:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.668 04:13:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.668 04:13:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.668 04:13:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.668 04:13:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.668 04:13:04 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.668 04:13:04 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.668 04:13:04 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.668 04:13:04 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.668 04:13:04 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.668 04:13:04 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.668 04:13:04 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.668 04:13:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.668 04:13:04 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.668 04:13:04 -- scripts/common.sh@344 -- # : 1 00:06:27.668 04:13:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.668 04:13:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.668 04:13:04 -- scripts/common.sh@364 -- # decimal 1 00:06:27.668 04:13:04 -- scripts/common.sh@352 -- # local d=1 00:06:27.668 04:13:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.668 04:13:04 -- scripts/common.sh@354 -- # echo 1 00:06:27.668 04:13:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.926 04:13:04 -- scripts/common.sh@365 -- # decimal 2 00:06:27.926 04:13:04 -- scripts/common.sh@352 -- # local d=2 00:06:27.926 04:13:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.926 04:13:04 -- scripts/common.sh@354 -- # echo 2 00:06:27.926 04:13:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.926 04:13:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.926 04:13:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.926 04:13:04 -- scripts/common.sh@367 -- # return 0 00:06:27.926 04:13:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.926 04:13:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.926 --rc genhtml_branch_coverage=1 00:06:27.926 --rc genhtml_function_coverage=1 00:06:27.926 --rc genhtml_legend=1 00:06:27.926 --rc geninfo_all_blocks=1 00:06:27.926 --rc geninfo_unexecuted_blocks=1 00:06:27.926 00:06:27.926 ' 00:06:27.926 04:13:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.926 --rc genhtml_branch_coverage=1 00:06:27.926 --rc genhtml_function_coverage=1 00:06:27.926 --rc genhtml_legend=1 00:06:27.926 --rc geninfo_all_blocks=1 00:06:27.926 --rc geninfo_unexecuted_blocks=1 00:06:27.926 00:06:27.926 ' 00:06:27.926 04:13:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.926 --rc genhtml_branch_coverage=1 00:06:27.926 --rc genhtml_function_coverage=1 00:06:27.926 --rc genhtml_legend=1 00:06:27.926 --rc geninfo_all_blocks=1 00:06:27.926 --rc geninfo_unexecuted_blocks=1 00:06:27.926 00:06:27.926 ' 00:06:27.926 04:13:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.926 --rc genhtml_branch_coverage=1 00:06:27.926 --rc genhtml_function_coverage=1 00:06:27.926 --rc genhtml_legend=1 00:06:27.926 --rc geninfo_all_blocks=1 00:06:27.926 --rc geninfo_unexecuted_blocks=1 00:06:27.926 00:06:27.926 ' 00:06:27.926 04:13:04 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:27.926 04:13:04 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3790193 00:06:27.926 04:13:04 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:27.926 04:13:04 -- app/cmdline.sh@18 -- # waitforlisten 3790193 00:06:27.926 04:13:04 -- common/autotest_common.sh@829 -- # '[' -z 3790193 ']' 00:06:27.926 04:13:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.926 04:13:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.926 04:13:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.926 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.926 04:13:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.926 04:13:04 -- common/autotest_common.sh@10 -- # set +x 00:06:27.926 [2024-11-28 04:13:05.027382] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.926 [2024-11-28 04:13:05.027458] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3790193 ] 00:06:27.926 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.926 [2024-11-28 04:13:05.083597] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.926 [2024-11-28 04:13:05.193012] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.926 [2024-11-28 04:13:05.193190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.859 04:13:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.859 04:13:06 -- common/autotest_common.sh@862 -- # return 0 00:06:28.859 04:13:06 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:29.116 { 00:06:29.116 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:29.116 "fields": { 00:06:29.116 "major": 24, 00:06:29.116 "minor": 1, 00:06:29.116 "patch": 1, 00:06:29.116 "suffix": "-pre", 00:06:29.116 "commit": "c13c99a5e" 00:06:29.116 } 00:06:29.116 } 00:06:29.116 04:13:06 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:29.116 04:13:06 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:29.116 04:13:06 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:29.116 04:13:06 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:29.117 04:13:06 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:29.117 04:13:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.117 04:13:06 -- common/autotest_common.sh@10 -- # set +x 00:06:29.117 04:13:06 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:29.117 04:13:06 -- app/cmdline.sh@26 -- # sort 00:06:29.117 04:13:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.117 04:13:06 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:29.117 04:13:06 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:29.117 04:13:06 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:29.117 04:13:06 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.117 04:13:06 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:29.117 04:13:06 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:29.117 04:13:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.117 04:13:06 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:29.117 04:13:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.117 04:13:06 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:29.117 04:13:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.117 04:13:06 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:29.117 04:13:06 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:29.117 04:13:06 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:29.374 request: 00:06:29.374 { 00:06:29.374 "method": "env_dpdk_get_mem_stats", 00:06:29.374 "req_id": 1 00:06:29.374 } 00:06:29.374 Got JSON-RPC error response 00:06:29.374 response: 00:06:29.374 { 00:06:29.375 "code": -32601, 00:06:29.375 "message": "Method not found" 00:06:29.375 } 00:06:29.375 04:13:06 -- common/autotest_common.sh@653 -- # es=1 00:06:29.375 04:13:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.375 04:13:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:29.375 04:13:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.375 04:13:06 -- app/cmdline.sh@1 -- # killprocess 3790193 00:06:29.375 04:13:06 -- common/autotest_common.sh@936 -- # '[' -z 3790193 ']' 00:06:29.375 04:13:06 -- common/autotest_common.sh@940 -- # kill -0 3790193 00:06:29.375 04:13:06 -- common/autotest_common.sh@941 -- # uname 00:06:29.375 04:13:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.375 04:13:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3790193 00:06:29.633 04:13:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:29.633 04:13:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:29.633 04:13:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3790193' 00:06:29.633 killing process with pid 3790193 00:06:29.633 04:13:06 -- common/autotest_common.sh@955 -- # kill 3790193 00:06:29.633 04:13:06 -- common/autotest_common.sh@960 -- # wait 3790193 00:06:29.891 00:06:29.891 real 0m2.341s 00:06:29.891 user 0m3.023s 00:06:29.891 sys 0m0.517s 00:06:29.891 04:13:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.891 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:29.891 ************************************ 00:06:29.891 END TEST app_cmdline 00:06:29.891 ************************************ 00:06:30.149 04:13:07 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:30.149 04:13:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:30.149 04:13:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.149 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:30.149 ************************************ 00:06:30.149 START TEST version 00:06:30.149 ************************************ 00:06:30.149 04:13:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:30.149 * Looking for test storage... 00:06:30.149 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:30.149 04:13:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:30.149 04:13:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:30.149 04:13:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:30.149 04:13:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:30.149 04:13:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:30.150 04:13:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:30.150 04:13:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:30.150 04:13:07 -- scripts/common.sh@335 -- # IFS=.-: 00:06:30.150 04:13:07 -- scripts/common.sh@335 -- # read -ra ver1 00:06:30.150 04:13:07 -- scripts/common.sh@336 -- # IFS=.-: 00:06:30.150 04:13:07 -- scripts/common.sh@336 -- # read -ra ver2 00:06:30.150 04:13:07 -- scripts/common.sh@337 -- # local 'op=<' 00:06:30.150 04:13:07 -- scripts/common.sh@339 -- # ver1_l=2 00:06:30.150 04:13:07 -- scripts/common.sh@340 -- # ver2_l=1 00:06:30.150 04:13:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:30.150 04:13:07 -- scripts/common.sh@343 -- # case "$op" in 00:06:30.150 04:13:07 -- scripts/common.sh@344 -- # : 1 00:06:30.150 04:13:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:30.150 04:13:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:30.150 04:13:07 -- scripts/common.sh@364 -- # decimal 1 00:06:30.150 04:13:07 -- scripts/common.sh@352 -- # local d=1 00:06:30.150 04:13:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:30.150 04:13:07 -- scripts/common.sh@354 -- # echo 1 00:06:30.150 04:13:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:30.150 04:13:07 -- scripts/common.sh@365 -- # decimal 2 00:06:30.150 04:13:07 -- scripts/common.sh@352 -- # local d=2 00:06:30.150 04:13:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:30.150 04:13:07 -- scripts/common.sh@354 -- # echo 2 00:06:30.150 04:13:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:30.150 04:13:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:30.150 04:13:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:30.150 04:13:07 -- scripts/common.sh@367 -- # return 0 00:06:30.150 04:13:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:30.150 04:13:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:30.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.150 --rc genhtml_branch_coverage=1 00:06:30.150 --rc genhtml_function_coverage=1 00:06:30.150 --rc genhtml_legend=1 00:06:30.150 --rc geninfo_all_blocks=1 00:06:30.150 --rc geninfo_unexecuted_blocks=1 00:06:30.150 00:06:30.150 ' 00:06:30.150 04:13:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:30.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.150 --rc genhtml_branch_coverage=1 00:06:30.150 --rc genhtml_function_coverage=1 00:06:30.150 --rc genhtml_legend=1 00:06:30.150 --rc geninfo_all_blocks=1 00:06:30.150 --rc geninfo_unexecuted_blocks=1 00:06:30.150 00:06:30.150 ' 00:06:30.150 04:13:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:30.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.150 --rc genhtml_branch_coverage=1 00:06:30.150 --rc genhtml_function_coverage=1 00:06:30.150 --rc genhtml_legend=1 00:06:30.150 --rc geninfo_all_blocks=1 00:06:30.150 --rc geninfo_unexecuted_blocks=1 00:06:30.150 00:06:30.150 ' 00:06:30.150 04:13:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:30.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.150 --rc genhtml_branch_coverage=1 00:06:30.150 --rc genhtml_function_coverage=1 00:06:30.150 --rc genhtml_legend=1 00:06:30.150 --rc geninfo_all_blocks=1 00:06:30.150 --rc geninfo_unexecuted_blocks=1 00:06:30.150 00:06:30.150 ' 00:06:30.150 04:13:07 -- app/version.sh@17 -- # get_header_version major 00:06:30.150 04:13:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:30.150 04:13:07 -- app/version.sh@14 -- # cut -f2 00:06:30.150 04:13:07 -- app/version.sh@14 -- # tr -d '"' 00:06:30.150 04:13:07 -- app/version.sh@17 -- # major=24 00:06:30.150 04:13:07 -- app/version.sh@18 -- # get_header_version minor 00:06:30.150 04:13:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:30.150 04:13:07 -- app/version.sh@14 -- # cut -f2 00:06:30.150 04:13:07 -- app/version.sh@14 -- # tr -d '"' 00:06:30.150 04:13:07 -- app/version.sh@18 -- # minor=1 00:06:30.150 04:13:07 -- app/version.sh@19 -- # get_header_version patch 00:06:30.150 04:13:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:30.150 04:13:07 -- app/version.sh@14 -- # cut -f2 00:06:30.150 04:13:07 -- app/version.sh@14 -- # tr -d '"' 00:06:30.150 04:13:07 -- app/version.sh@19 -- # patch=1 00:06:30.150 04:13:07 -- app/version.sh@20 -- # get_header_version suffix 00:06:30.150 04:13:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:30.150 04:13:07 -- app/version.sh@14 -- # cut -f2 00:06:30.150 04:13:07 -- app/version.sh@14 -- # tr -d '"' 00:06:30.150 04:13:07 -- app/version.sh@20 -- # suffix=-pre 00:06:30.150 04:13:07 -- app/version.sh@22 -- # version=24.1 00:06:30.150 04:13:07 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:30.150 04:13:07 -- app/version.sh@25 -- # version=24.1.1 00:06:30.150 04:13:07 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:30.150 04:13:07 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:30.150 04:13:07 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:30.150 04:13:07 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:30.150 04:13:07 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:30.150 00:06:30.150 real 0m0.208s 00:06:30.150 user 0m0.134s 00:06:30.150 sys 0m0.099s 00:06:30.150 04:13:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.150 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:30.150 ************************************ 00:06:30.150 END TEST version 00:06:30.150 ************************************ 00:06:30.150 04:13:07 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:30.150 04:13:07 -- spdk/autotest.sh@191 -- # uname -s 00:06:30.150 04:13:07 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:30.150 04:13:07 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:30.150 04:13:07 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:30.150 04:13:07 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:30.150 04:13:07 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:30.150 04:13:07 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:30.150 04:13:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:30.150 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:30.409 04:13:07 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:30.409 04:13:07 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:30.409 04:13:07 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:30.409 04:13:07 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:30.409 04:13:07 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:30.409 04:13:07 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:30.409 04:13:07 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:30.409 04:13:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:30.409 04:13:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.409 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:30.409 ************************************ 00:06:30.409 START TEST nvmf_tcp 00:06:30.409 ************************************ 00:06:30.409 04:13:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:30.409 * Looking for test storage... 00:06:30.409 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:30.409 04:13:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:30.409 04:13:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:30.409 04:13:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:30.409 04:13:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:30.409 04:13:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:30.409 04:13:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:30.409 04:13:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:30.409 04:13:07 -- scripts/common.sh@335 -- # IFS=.-: 00:06:30.409 04:13:07 -- scripts/common.sh@335 -- # read -ra ver1 00:06:30.409 04:13:07 -- scripts/common.sh@336 -- # IFS=.-: 00:06:30.409 04:13:07 -- scripts/common.sh@336 -- # read -ra ver2 00:06:30.409 04:13:07 -- scripts/common.sh@337 -- # local 'op=<' 00:06:30.409 04:13:07 -- scripts/common.sh@339 -- # ver1_l=2 00:06:30.409 04:13:07 -- scripts/common.sh@340 -- # ver2_l=1 00:06:30.409 04:13:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:30.409 04:13:07 -- scripts/common.sh@343 -- # case "$op" in 00:06:30.409 04:13:07 -- scripts/common.sh@344 -- # : 1 00:06:30.409 04:13:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:30.409 04:13:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:30.409 04:13:07 -- scripts/common.sh@364 -- # decimal 1 00:06:30.409 04:13:07 -- scripts/common.sh@352 -- # local d=1 00:06:30.409 04:13:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:30.409 04:13:07 -- scripts/common.sh@354 -- # echo 1 00:06:30.409 04:13:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:30.409 04:13:07 -- scripts/common.sh@365 -- # decimal 2 00:06:30.409 04:13:07 -- scripts/common.sh@352 -- # local d=2 00:06:30.409 04:13:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:30.409 04:13:07 -- scripts/common.sh@354 -- # echo 2 00:06:30.409 04:13:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:30.409 04:13:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:30.409 04:13:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:30.409 04:13:07 -- scripts/common.sh@367 -- # return 0 00:06:30.409 04:13:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:30.409 04:13:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:30.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.410 --rc genhtml_branch_coverage=1 00:06:30.410 --rc genhtml_function_coverage=1 00:06:30.410 --rc genhtml_legend=1 00:06:30.410 --rc geninfo_all_blocks=1 00:06:30.410 --rc geninfo_unexecuted_blocks=1 00:06:30.410 00:06:30.410 ' 00:06:30.410 04:13:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:30.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.410 --rc genhtml_branch_coverage=1 00:06:30.410 --rc genhtml_function_coverage=1 00:06:30.410 --rc genhtml_legend=1 00:06:30.410 --rc geninfo_all_blocks=1 00:06:30.410 --rc geninfo_unexecuted_blocks=1 00:06:30.410 00:06:30.410 ' 00:06:30.410 04:13:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:30.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.410 --rc genhtml_branch_coverage=1 00:06:30.410 --rc genhtml_function_coverage=1 00:06:30.410 --rc genhtml_legend=1 00:06:30.410 --rc geninfo_all_blocks=1 00:06:30.410 --rc geninfo_unexecuted_blocks=1 00:06:30.410 00:06:30.410 ' 00:06:30.410 04:13:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:30.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.410 --rc genhtml_branch_coverage=1 00:06:30.410 --rc genhtml_function_coverage=1 00:06:30.410 --rc genhtml_legend=1 00:06:30.410 --rc geninfo_all_blocks=1 00:06:30.410 --rc geninfo_unexecuted_blocks=1 00:06:30.410 00:06:30.410 ' 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:30.410 04:13:07 -- nvmf/common.sh@7 -- # uname -s 00:06:30.410 04:13:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:30.410 04:13:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:30.410 04:13:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:30.410 04:13:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:30.410 04:13:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:30.410 04:13:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:30.410 04:13:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:30.410 04:13:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:30.410 04:13:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:30.410 04:13:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:30.410 04:13:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:30.410 04:13:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:30.410 04:13:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:30.410 04:13:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:30.410 04:13:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:30.410 04:13:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:30.410 04:13:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:30.410 04:13:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:30.410 04:13:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:30.410 04:13:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.410 04:13:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.410 04:13:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.410 04:13:07 -- paths/export.sh@5 -- # export PATH 00:06:30.410 04:13:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.410 04:13:07 -- nvmf/common.sh@46 -- # : 0 00:06:30.410 04:13:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:30.410 04:13:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:30.410 04:13:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:30.410 04:13:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:30.410 04:13:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:30.410 04:13:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:30.410 04:13:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:30.410 04:13:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:30.410 04:13:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:30.410 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:30.410 04:13:07 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:30.410 04:13:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:30.410 04:13:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.410 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:30.410 ************************************ 00:06:30.410 START TEST nvmf_example 00:06:30.410 ************************************ 00:06:30.410 04:13:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:30.410 * Looking for test storage... 00:06:30.410 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:30.410 04:13:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:30.410 04:13:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:30.410 04:13:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:30.669 04:13:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:30.669 04:13:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:30.669 04:13:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:30.669 04:13:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:30.669 04:13:07 -- scripts/common.sh@335 -- # IFS=.-: 00:06:30.669 04:13:07 -- scripts/common.sh@335 -- # read -ra ver1 00:06:30.669 04:13:07 -- scripts/common.sh@336 -- # IFS=.-: 00:06:30.669 04:13:07 -- scripts/common.sh@336 -- # read -ra ver2 00:06:30.669 04:13:07 -- scripts/common.sh@337 -- # local 'op=<' 00:06:30.669 04:13:07 -- scripts/common.sh@339 -- # ver1_l=2 00:06:30.669 04:13:07 -- scripts/common.sh@340 -- # ver2_l=1 00:06:30.669 04:13:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:30.669 04:13:07 -- scripts/common.sh@343 -- # case "$op" in 00:06:30.669 04:13:07 -- scripts/common.sh@344 -- # : 1 00:06:30.669 04:13:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:30.669 04:13:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:30.669 04:13:07 -- scripts/common.sh@364 -- # decimal 1 00:06:30.669 04:13:07 -- scripts/common.sh@352 -- # local d=1 00:06:30.669 04:13:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:30.669 04:13:07 -- scripts/common.sh@354 -- # echo 1 00:06:30.669 04:13:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:30.669 04:13:07 -- scripts/common.sh@365 -- # decimal 2 00:06:30.669 04:13:07 -- scripts/common.sh@352 -- # local d=2 00:06:30.669 04:13:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:30.669 04:13:07 -- scripts/common.sh@354 -- # echo 2 00:06:30.669 04:13:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:30.669 04:13:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:30.669 04:13:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:30.669 04:13:07 -- scripts/common.sh@367 -- # return 0 00:06:30.669 04:13:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:30.669 04:13:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:30.669 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.669 --rc genhtml_branch_coverage=1 00:06:30.669 --rc genhtml_function_coverage=1 00:06:30.669 --rc genhtml_legend=1 00:06:30.669 --rc geninfo_all_blocks=1 00:06:30.669 --rc geninfo_unexecuted_blocks=1 00:06:30.669 00:06:30.669 ' 00:06:30.669 04:13:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:30.669 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.669 --rc genhtml_branch_coverage=1 00:06:30.669 --rc genhtml_function_coverage=1 00:06:30.669 --rc genhtml_legend=1 00:06:30.669 --rc geninfo_all_blocks=1 00:06:30.669 --rc geninfo_unexecuted_blocks=1 00:06:30.669 00:06:30.669 ' 00:06:30.669 04:13:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:30.669 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.669 --rc genhtml_branch_coverage=1 00:06:30.669 --rc genhtml_function_coverage=1 00:06:30.669 --rc genhtml_legend=1 00:06:30.670 --rc geninfo_all_blocks=1 00:06:30.670 --rc geninfo_unexecuted_blocks=1 00:06:30.670 00:06:30.670 ' 00:06:30.670 04:13:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:30.670 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:30.670 --rc genhtml_branch_coverage=1 00:06:30.670 --rc genhtml_function_coverage=1 00:06:30.670 --rc genhtml_legend=1 00:06:30.670 --rc geninfo_all_blocks=1 00:06:30.670 --rc geninfo_unexecuted_blocks=1 00:06:30.670 00:06:30.670 ' 00:06:30.670 04:13:07 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:30.670 04:13:07 -- nvmf/common.sh@7 -- # uname -s 00:06:30.670 04:13:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:30.670 04:13:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:30.670 04:13:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:30.670 04:13:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:30.670 04:13:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:30.670 04:13:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:30.670 04:13:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:30.670 04:13:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:30.670 04:13:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:30.670 04:13:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:30.670 04:13:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:30.670 04:13:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:30.670 04:13:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:30.670 04:13:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:30.670 04:13:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:30.670 04:13:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:30.670 04:13:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:30.670 04:13:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:30.670 04:13:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:30.670 04:13:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.670 04:13:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.670 04:13:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.670 04:13:07 -- paths/export.sh@5 -- # export PATH 00:06:30.670 04:13:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:30.670 04:13:07 -- nvmf/common.sh@46 -- # : 0 00:06:30.670 04:13:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:30.670 04:13:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:30.670 04:13:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:30.670 04:13:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:30.670 04:13:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:30.670 04:13:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:30.670 04:13:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:30.670 04:13:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:30.670 04:13:07 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:30.670 04:13:07 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:30.670 04:13:07 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:30.670 04:13:07 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:30.670 04:13:07 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:30.670 04:13:07 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:30.670 04:13:07 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:30.670 04:13:07 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:30.670 04:13:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:30.670 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:30.670 04:13:07 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:30.670 04:13:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:30.670 04:13:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:30.670 04:13:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:30.670 04:13:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:30.670 04:13:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:30.670 04:13:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:30.670 04:13:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:30.670 04:13:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:30.670 04:13:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:30.670 04:13:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:30.670 04:13:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:30.670 04:13:07 -- common/autotest_common.sh@10 -- # set +x 00:06:32.570 04:13:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:32.570 04:13:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:32.570 04:13:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:32.570 04:13:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:32.570 04:13:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:32.570 04:13:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:32.570 04:13:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:32.570 04:13:09 -- nvmf/common.sh@294 -- # net_devs=() 00:06:32.570 04:13:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:32.570 04:13:09 -- nvmf/common.sh@295 -- # e810=() 00:06:32.570 04:13:09 -- nvmf/common.sh@295 -- # local -ga e810 00:06:32.570 04:13:09 -- nvmf/common.sh@296 -- # x722=() 00:06:32.570 04:13:09 -- nvmf/common.sh@296 -- # local -ga x722 00:06:32.570 04:13:09 -- nvmf/common.sh@297 -- # mlx=() 00:06:32.570 04:13:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:32.570 04:13:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:32.570 04:13:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:32.570 04:13:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:32.570 04:13:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:32.570 04:13:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:32.570 04:13:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:32.570 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:32.570 04:13:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:32.570 04:13:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:32.570 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:32.570 04:13:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:32.570 04:13:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:32.828 04:13:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:32.828 04:13:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:32.828 04:13:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:32.828 04:13:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:32.828 04:13:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:32.828 04:13:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:32.828 04:13:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:32.828 04:13:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:32.828 04:13:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:32.828 04:13:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:32.828 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:32.828 04:13:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:32.828 04:13:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:32.828 04:13:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:32.828 04:13:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:32.828 04:13:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:32.828 04:13:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:32.828 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:32.828 04:13:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:32.828 04:13:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:32.828 04:13:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:32.828 04:13:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:32.828 04:13:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:32.828 04:13:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:32.828 04:13:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:32.828 04:13:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:32.828 04:13:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:32.828 04:13:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:32.828 04:13:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:32.828 04:13:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:32.828 04:13:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:32.828 04:13:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:32.828 04:13:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:32.828 04:13:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:32.828 04:13:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:32.828 04:13:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:32.828 04:13:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:32.828 04:13:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:32.828 04:13:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:32.828 04:13:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:32.828 04:13:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:32.828 04:13:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:32.828 04:13:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:32.828 04:13:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:32.828 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:32.828 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:06:32.828 00:06:32.828 --- 10.0.0.2 ping statistics --- 00:06:32.828 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:32.828 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:06:32.828 04:13:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:32.828 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:32.828 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:06:32.828 00:06:32.828 --- 10.0.0.1 ping statistics --- 00:06:32.828 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:32.828 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:06:32.828 04:13:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:32.828 04:13:10 -- nvmf/common.sh@410 -- # return 0 00:06:32.828 04:13:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:32.828 04:13:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:32.828 04:13:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:32.828 04:13:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:32.829 04:13:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:32.829 04:13:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:32.829 04:13:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:32.829 04:13:10 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:32.829 04:13:10 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:32.829 04:13:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:32.829 04:13:10 -- common/autotest_common.sh@10 -- # set +x 00:06:32.829 04:13:10 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:32.829 04:13:10 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:32.829 04:13:10 -- target/nvmf_example.sh@34 -- # nvmfpid=3792261 00:06:32.829 04:13:10 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:32.829 04:13:10 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:32.829 04:13:10 -- target/nvmf_example.sh@36 -- # waitforlisten 3792261 00:06:32.829 04:13:10 -- common/autotest_common.sh@829 -- # '[' -z 3792261 ']' 00:06:32.829 04:13:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.829 04:13:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:32.829 04:13:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.829 04:13:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:32.829 04:13:10 -- common/autotest_common.sh@10 -- # set +x 00:06:32.829 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.202 04:13:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:34.202 04:13:11 -- common/autotest_common.sh@862 -- # return 0 00:06:34.202 04:13:11 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:34.202 04:13:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:34.202 04:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:34.202 04:13:11 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:34.202 04:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.202 04:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:34.202 04:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.202 04:13:11 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:34.202 04:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.202 04:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:34.202 04:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.202 04:13:11 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:34.202 04:13:11 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:34.202 04:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.202 04:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:34.202 04:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.202 04:13:11 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:34.202 04:13:11 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:34.202 04:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.202 04:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:34.202 04:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.202 04:13:11 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:34.202 04:13:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.202 04:13:11 -- common/autotest_common.sh@10 -- # set +x 00:06:34.202 04:13:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.202 04:13:11 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:34.202 04:13:11 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:34.202 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.167 Initializing NVMe Controllers 00:06:44.167 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:44.167 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:44.167 Initialization complete. Launching workers. 00:06:44.167 ======================================================== 00:06:44.167 Latency(us) 00:06:44.167 Device Information : IOPS MiB/s Average min max 00:06:44.167 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15684.51 61.27 4080.07 612.43 15162.02 00:06:44.167 ======================================================== 00:06:44.167 Total : 15684.51 61.27 4080.07 612.43 15162.02 00:06:44.167 00:06:44.167 04:13:21 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:44.167 04:13:21 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:44.167 04:13:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:44.167 04:13:21 -- nvmf/common.sh@116 -- # sync 00:06:44.167 04:13:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:44.167 04:13:21 -- nvmf/common.sh@119 -- # set +e 00:06:44.167 04:13:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:44.167 04:13:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:44.167 rmmod nvme_tcp 00:06:44.167 rmmod nvme_fabrics 00:06:44.167 rmmod nvme_keyring 00:06:44.167 04:13:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:44.167 04:13:21 -- nvmf/common.sh@123 -- # set -e 00:06:44.167 04:13:21 -- nvmf/common.sh@124 -- # return 0 00:06:44.167 04:13:21 -- nvmf/common.sh@477 -- # '[' -n 3792261 ']' 00:06:44.167 04:13:21 -- nvmf/common.sh@478 -- # killprocess 3792261 00:06:44.167 04:13:21 -- common/autotest_common.sh@936 -- # '[' -z 3792261 ']' 00:06:44.167 04:13:21 -- common/autotest_common.sh@940 -- # kill -0 3792261 00:06:44.167 04:13:21 -- common/autotest_common.sh@941 -- # uname 00:06:44.167 04:13:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.167 04:13:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3792261 00:06:44.167 04:13:21 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:44.167 04:13:21 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:44.167 04:13:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3792261' 00:06:44.167 killing process with pid 3792261 00:06:44.167 04:13:21 -- common/autotest_common.sh@955 -- # kill 3792261 00:06:44.167 04:13:21 -- common/autotest_common.sh@960 -- # wait 3792261 00:06:44.424 nvmf threads initialize successfully 00:06:44.424 bdev subsystem init successfully 00:06:44.424 created a nvmf target service 00:06:44.424 create targets's poll groups done 00:06:44.424 all subsystems of target started 00:06:44.424 nvmf target is running 00:06:44.424 all subsystems of target stopped 00:06:44.424 destroy targets's poll groups done 00:06:44.424 destroyed the nvmf target service 00:06:44.424 bdev subsystem finish successfully 00:06:44.424 nvmf threads destroy successfully 00:06:44.424 04:13:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:44.424 04:13:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:44.424 04:13:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:44.424 04:13:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:44.424 04:13:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:44.424 04:13:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:44.424 04:13:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:44.424 04:13:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:46.962 04:13:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:46.962 04:13:23 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:46.962 04:13:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:46.962 04:13:23 -- common/autotest_common.sh@10 -- # set +x 00:06:46.962 00:06:46.962 real 0m16.133s 00:06:46.962 user 0m45.464s 00:06:46.962 sys 0m3.332s 00:06:46.962 04:13:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.962 04:13:23 -- common/autotest_common.sh@10 -- # set +x 00:06:46.962 ************************************ 00:06:46.962 END TEST nvmf_example 00:06:46.962 ************************************ 00:06:46.962 04:13:23 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:46.962 04:13:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:46.962 04:13:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.962 04:13:23 -- common/autotest_common.sh@10 -- # set +x 00:06:46.962 ************************************ 00:06:46.962 START TEST nvmf_filesystem 00:06:46.962 ************************************ 00:06:46.962 04:13:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:46.962 * Looking for test storage... 00:06:46.962 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:46.962 04:13:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:46.962 04:13:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:46.962 04:13:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:46.962 04:13:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:46.962 04:13:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:46.962 04:13:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:46.962 04:13:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:46.962 04:13:23 -- scripts/common.sh@335 -- # IFS=.-: 00:06:46.962 04:13:23 -- scripts/common.sh@335 -- # read -ra ver1 00:06:46.962 04:13:23 -- scripts/common.sh@336 -- # IFS=.-: 00:06:46.962 04:13:23 -- scripts/common.sh@336 -- # read -ra ver2 00:06:46.962 04:13:23 -- scripts/common.sh@337 -- # local 'op=<' 00:06:46.962 04:13:23 -- scripts/common.sh@339 -- # ver1_l=2 00:06:46.962 04:13:23 -- scripts/common.sh@340 -- # ver2_l=1 00:06:46.962 04:13:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:46.962 04:13:23 -- scripts/common.sh@343 -- # case "$op" in 00:06:46.962 04:13:23 -- scripts/common.sh@344 -- # : 1 00:06:46.962 04:13:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:46.962 04:13:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:46.962 04:13:23 -- scripts/common.sh@364 -- # decimal 1 00:06:46.962 04:13:23 -- scripts/common.sh@352 -- # local d=1 00:06:46.962 04:13:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:46.962 04:13:23 -- scripts/common.sh@354 -- # echo 1 00:06:46.962 04:13:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:46.962 04:13:23 -- scripts/common.sh@365 -- # decimal 2 00:06:46.962 04:13:23 -- scripts/common.sh@352 -- # local d=2 00:06:46.962 04:13:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:46.962 04:13:23 -- scripts/common.sh@354 -- # echo 2 00:06:46.962 04:13:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:46.962 04:13:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:46.962 04:13:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:46.962 04:13:23 -- scripts/common.sh@367 -- # return 0 00:06:46.962 04:13:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:46.962 04:13:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:46.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.963 --rc genhtml_branch_coverage=1 00:06:46.963 --rc genhtml_function_coverage=1 00:06:46.963 --rc genhtml_legend=1 00:06:46.963 --rc geninfo_all_blocks=1 00:06:46.963 --rc geninfo_unexecuted_blocks=1 00:06:46.963 00:06:46.963 ' 00:06:46.963 04:13:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:46.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.963 --rc genhtml_branch_coverage=1 00:06:46.963 --rc genhtml_function_coverage=1 00:06:46.963 --rc genhtml_legend=1 00:06:46.963 --rc geninfo_all_blocks=1 00:06:46.963 --rc geninfo_unexecuted_blocks=1 00:06:46.963 00:06:46.963 ' 00:06:46.963 04:13:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:46.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.963 --rc genhtml_branch_coverage=1 00:06:46.963 --rc genhtml_function_coverage=1 00:06:46.963 --rc genhtml_legend=1 00:06:46.963 --rc geninfo_all_blocks=1 00:06:46.963 --rc geninfo_unexecuted_blocks=1 00:06:46.963 00:06:46.963 ' 00:06:46.963 04:13:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:46.963 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.963 --rc genhtml_branch_coverage=1 00:06:46.963 --rc genhtml_function_coverage=1 00:06:46.963 --rc genhtml_legend=1 00:06:46.963 --rc geninfo_all_blocks=1 00:06:46.963 --rc geninfo_unexecuted_blocks=1 00:06:46.963 00:06:46.963 ' 00:06:46.963 04:13:23 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:46.963 04:13:23 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:46.963 04:13:23 -- common/autotest_common.sh@34 -- # set -e 00:06:46.963 04:13:23 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:46.963 04:13:23 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:46.963 04:13:23 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:46.963 04:13:23 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:46.963 04:13:23 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:46.963 04:13:23 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:46.963 04:13:23 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:46.963 04:13:23 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:46.963 04:13:23 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:46.963 04:13:23 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:46.963 04:13:23 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:46.963 04:13:23 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:46.963 04:13:23 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:46.963 04:13:23 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:46.963 04:13:23 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:46.963 04:13:23 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:46.963 04:13:23 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:46.963 04:13:23 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:46.963 04:13:23 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:46.963 04:13:23 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:46.963 04:13:23 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:46.963 04:13:23 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:46.963 04:13:23 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:46.963 04:13:23 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:46.963 04:13:23 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:46.963 04:13:23 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:46.963 04:13:23 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:46.963 04:13:23 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:46.963 04:13:23 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:46.963 04:13:23 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:46.963 04:13:23 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:46.963 04:13:23 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:46.963 04:13:23 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:46.963 04:13:23 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:46.963 04:13:23 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:46.963 04:13:23 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:46.963 04:13:23 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:46.963 04:13:23 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:46.963 04:13:23 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:46.963 04:13:23 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:46.963 04:13:23 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:46.963 04:13:23 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:46.963 04:13:23 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:46.963 04:13:23 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:46.963 04:13:23 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:46.963 04:13:23 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:46.963 04:13:23 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:46.963 04:13:23 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:46.963 04:13:23 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:46.963 04:13:23 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:46.963 04:13:23 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:46.963 04:13:23 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:46.963 04:13:23 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:46.963 04:13:23 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:46.963 04:13:23 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:46.963 04:13:23 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:46.963 04:13:23 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:46.963 04:13:23 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:46.963 04:13:23 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:46.963 04:13:23 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:46.963 04:13:23 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:46.963 04:13:23 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:46.963 04:13:23 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:46.963 04:13:23 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:46.963 04:13:23 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:46.963 04:13:23 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:46.963 04:13:23 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:46.963 04:13:23 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:46.963 04:13:23 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:46.963 04:13:23 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:46.963 04:13:23 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:46.963 04:13:23 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:46.963 04:13:23 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:46.963 04:13:23 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:46.963 04:13:23 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:46.963 04:13:23 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:46.963 04:13:23 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:46.963 04:13:23 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:46.963 04:13:23 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:46.963 04:13:23 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:46.963 04:13:23 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:46.963 04:13:23 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:46.963 04:13:23 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:46.963 04:13:23 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:46.963 04:13:23 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:46.963 04:13:23 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:46.963 04:13:23 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:46.963 04:13:23 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:46.963 04:13:23 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:46.963 04:13:23 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:46.963 04:13:23 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:46.963 04:13:23 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:46.963 04:13:23 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:46.963 04:13:23 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:46.963 04:13:23 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:46.963 04:13:23 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:46.963 04:13:23 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:46.963 04:13:23 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:46.963 04:13:23 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:46.963 #define SPDK_CONFIG_H 00:06:46.963 #define SPDK_CONFIG_APPS 1 00:06:46.963 #define SPDK_CONFIG_ARCH native 00:06:46.963 #undef SPDK_CONFIG_ASAN 00:06:46.963 #undef SPDK_CONFIG_AVAHI 00:06:46.963 #undef SPDK_CONFIG_CET 00:06:46.963 #define SPDK_CONFIG_COVERAGE 1 00:06:46.963 #define SPDK_CONFIG_CROSS_PREFIX 00:06:46.963 #undef SPDK_CONFIG_CRYPTO 00:06:46.963 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:46.963 #undef SPDK_CONFIG_CUSTOMOCF 00:06:46.963 #undef SPDK_CONFIG_DAOS 00:06:46.963 #define SPDK_CONFIG_DAOS_DIR 00:06:46.963 #define SPDK_CONFIG_DEBUG 1 00:06:46.963 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:46.963 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:46.963 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:46.963 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:46.963 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:46.963 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:46.963 #define SPDK_CONFIG_EXAMPLES 1 00:06:46.963 #undef SPDK_CONFIG_FC 00:06:46.963 #define SPDK_CONFIG_FC_PATH 00:06:46.963 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:46.963 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:46.963 #undef SPDK_CONFIG_FUSE 00:06:46.963 #undef SPDK_CONFIG_FUZZER 00:06:46.963 #define SPDK_CONFIG_FUZZER_LIB 00:06:46.963 #undef SPDK_CONFIG_GOLANG 00:06:46.963 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:46.963 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:46.963 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:46.964 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:46.964 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:46.964 #define SPDK_CONFIG_IDXD 1 00:06:46.964 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:46.964 #undef SPDK_CONFIG_IPSEC_MB 00:06:46.964 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:46.964 #define SPDK_CONFIG_ISAL 1 00:06:46.964 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:46.964 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:46.964 #define SPDK_CONFIG_LIBDIR 00:06:46.964 #undef SPDK_CONFIG_LTO 00:06:46.964 #define SPDK_CONFIG_MAX_LCORES 00:06:46.964 #define SPDK_CONFIG_NVME_CUSE 1 00:06:46.964 #undef SPDK_CONFIG_OCF 00:06:46.964 #define SPDK_CONFIG_OCF_PATH 00:06:46.964 #define SPDK_CONFIG_OPENSSL_PATH 00:06:46.964 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:46.964 #undef SPDK_CONFIG_PGO_USE 00:06:46.964 #define SPDK_CONFIG_PREFIX /usr/local 00:06:46.964 #undef SPDK_CONFIG_RAID5F 00:06:46.964 #undef SPDK_CONFIG_RBD 00:06:46.964 #define SPDK_CONFIG_RDMA 1 00:06:46.964 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:46.964 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:46.964 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:46.964 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:46.964 #define SPDK_CONFIG_SHARED 1 00:06:46.964 #undef SPDK_CONFIG_SMA 00:06:46.964 #define SPDK_CONFIG_TESTS 1 00:06:46.964 #undef SPDK_CONFIG_TSAN 00:06:46.964 #define SPDK_CONFIG_UBLK 1 00:06:46.964 #define SPDK_CONFIG_UBSAN 1 00:06:46.964 #undef SPDK_CONFIG_UNIT_TESTS 00:06:46.964 #undef SPDK_CONFIG_URING 00:06:46.964 #define SPDK_CONFIG_URING_PATH 00:06:46.964 #undef SPDK_CONFIG_URING_ZNS 00:06:46.964 #undef SPDK_CONFIG_USDT 00:06:46.964 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:46.964 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:46.964 #undef SPDK_CONFIG_VFIO_USER 00:06:46.964 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:46.964 #define SPDK_CONFIG_VHOST 1 00:06:46.964 #define SPDK_CONFIG_VIRTIO 1 00:06:46.964 #undef SPDK_CONFIG_VTUNE 00:06:46.964 #define SPDK_CONFIG_VTUNE_DIR 00:06:46.964 #define SPDK_CONFIG_WERROR 1 00:06:46.964 #define SPDK_CONFIG_WPDK_DIR 00:06:46.964 #undef SPDK_CONFIG_XNVME 00:06:46.964 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:46.964 04:13:23 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:46.964 04:13:23 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:46.964 04:13:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:46.964 04:13:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:46.964 04:13:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:46.964 04:13:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.964 04:13:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.964 04:13:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.964 04:13:23 -- paths/export.sh@5 -- # export PATH 00:06:46.964 04:13:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.964 04:13:23 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:46.964 04:13:23 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:46.964 04:13:23 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:46.964 04:13:23 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:46.964 04:13:23 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:46.964 04:13:23 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:46.964 04:13:23 -- pm/common@16 -- # TEST_TAG=N/A 00:06:46.964 04:13:23 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:46.964 04:13:23 -- common/autotest_common.sh@52 -- # : 1 00:06:46.964 04:13:23 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:46.964 04:13:23 -- common/autotest_common.sh@56 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:46.964 04:13:23 -- common/autotest_common.sh@58 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:46.964 04:13:23 -- common/autotest_common.sh@60 -- # : 1 00:06:46.964 04:13:23 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:46.964 04:13:23 -- common/autotest_common.sh@62 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:46.964 04:13:23 -- common/autotest_common.sh@64 -- # : 00:06:46.964 04:13:23 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:46.964 04:13:23 -- common/autotest_common.sh@66 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:46.964 04:13:23 -- common/autotest_common.sh@68 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:46.964 04:13:23 -- common/autotest_common.sh@70 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:46.964 04:13:23 -- common/autotest_common.sh@72 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:46.964 04:13:23 -- common/autotest_common.sh@74 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:46.964 04:13:23 -- common/autotest_common.sh@76 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:46.964 04:13:23 -- common/autotest_common.sh@78 -- # : 0 00:06:46.964 04:13:23 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:46.964 04:13:24 -- common/autotest_common.sh@80 -- # : 1 00:06:46.964 04:13:24 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:46.964 04:13:24 -- common/autotest_common.sh@82 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:46.964 04:13:24 -- common/autotest_common.sh@84 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:46.964 04:13:24 -- common/autotest_common.sh@86 -- # : 1 00:06:46.964 04:13:24 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:46.964 04:13:24 -- common/autotest_common.sh@88 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:46.964 04:13:24 -- common/autotest_common.sh@90 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:46.964 04:13:24 -- common/autotest_common.sh@92 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:46.964 04:13:24 -- common/autotest_common.sh@94 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:46.964 04:13:24 -- common/autotest_common.sh@96 -- # : tcp 00:06:46.964 04:13:24 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:46.964 04:13:24 -- common/autotest_common.sh@98 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:46.964 04:13:24 -- common/autotest_common.sh@100 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:46.964 04:13:24 -- common/autotest_common.sh@102 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:46.964 04:13:24 -- common/autotest_common.sh@104 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:46.964 04:13:24 -- common/autotest_common.sh@106 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:46.964 04:13:24 -- common/autotest_common.sh@108 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:46.964 04:13:24 -- common/autotest_common.sh@110 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:46.964 04:13:24 -- common/autotest_common.sh@112 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:46.964 04:13:24 -- common/autotest_common.sh@114 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:46.964 04:13:24 -- common/autotest_common.sh@116 -- # : 1 00:06:46.964 04:13:24 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:46.964 04:13:24 -- common/autotest_common.sh@118 -- # : 00:06:46.964 04:13:24 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:46.964 04:13:24 -- common/autotest_common.sh@120 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:46.964 04:13:24 -- common/autotest_common.sh@122 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:46.964 04:13:24 -- common/autotest_common.sh@124 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:46.964 04:13:24 -- common/autotest_common.sh@126 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:46.964 04:13:24 -- common/autotest_common.sh@128 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:46.964 04:13:24 -- common/autotest_common.sh@130 -- # : 0 00:06:46.964 04:13:24 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:46.964 04:13:24 -- common/autotest_common.sh@132 -- # : 00:06:46.964 04:13:24 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:46.964 04:13:24 -- common/autotest_common.sh@134 -- # : true 00:06:46.965 04:13:24 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:46.965 04:13:24 -- common/autotest_common.sh@136 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:46.965 04:13:24 -- common/autotest_common.sh@138 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:46.965 04:13:24 -- common/autotest_common.sh@140 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:46.965 04:13:24 -- common/autotest_common.sh@142 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:46.965 04:13:24 -- common/autotest_common.sh@144 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:46.965 04:13:24 -- common/autotest_common.sh@146 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:46.965 04:13:24 -- common/autotest_common.sh@148 -- # : e810 00:06:46.965 04:13:24 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:46.965 04:13:24 -- common/autotest_common.sh@150 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:46.965 04:13:24 -- common/autotest_common.sh@152 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:46.965 04:13:24 -- common/autotest_common.sh@154 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:46.965 04:13:24 -- common/autotest_common.sh@156 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:46.965 04:13:24 -- common/autotest_common.sh@158 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:46.965 04:13:24 -- common/autotest_common.sh@160 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:46.965 04:13:24 -- common/autotest_common.sh@163 -- # : 00:06:46.965 04:13:24 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:46.965 04:13:24 -- common/autotest_common.sh@165 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:46.965 04:13:24 -- common/autotest_common.sh@167 -- # : 0 00:06:46.965 04:13:24 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:46.965 04:13:24 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:46.965 04:13:24 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:46.965 04:13:24 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:46.965 04:13:24 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:46.965 04:13:24 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:46.965 04:13:24 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:46.965 04:13:24 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:46.965 04:13:24 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:46.965 04:13:24 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:46.965 04:13:24 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:46.965 04:13:24 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:46.965 04:13:24 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:46.965 04:13:24 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:46.965 04:13:24 -- common/autotest_common.sh@196 -- # cat 00:06:46.965 04:13:24 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:46.965 04:13:24 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:46.965 04:13:24 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:46.965 04:13:24 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:46.965 04:13:24 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:46.965 04:13:24 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:46.965 04:13:24 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:46.965 04:13:24 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:46.965 04:13:24 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:46.965 04:13:24 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:46.965 04:13:24 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:46.965 04:13:24 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:46.965 04:13:24 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:46.965 04:13:24 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:46.965 04:13:24 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:46.965 04:13:24 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:46.965 04:13:24 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:46.965 04:13:24 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:46.965 04:13:24 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:46.965 04:13:24 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:46.965 04:13:24 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:46.965 04:13:24 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:46.965 04:13:24 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:46.965 04:13:24 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:46.965 04:13:24 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:46.965 04:13:24 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:46.965 04:13:24 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:46.965 04:13:24 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:46.965 04:13:24 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:46.965 04:13:24 -- common/autotest_common.sh@259 -- # valgrind= 00:06:46.965 04:13:24 -- common/autotest_common.sh@265 -- # uname -s 00:06:46.965 04:13:24 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:46.965 04:13:24 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:46.965 04:13:24 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:46.965 04:13:24 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:46.965 04:13:24 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:46.965 04:13:24 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:46.965 04:13:24 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:46.965 04:13:24 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:46.965 04:13:24 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:46.965 04:13:24 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:46.965 04:13:24 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:46.965 04:13:24 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:46.965 04:13:24 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:46.965 04:13:24 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:46.965 04:13:24 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:46.965 04:13:24 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:46.965 04:13:24 -- common/autotest_common.sh@319 -- # [[ -z 3794009 ]] 00:06:46.965 04:13:24 -- common/autotest_common.sh@319 -- # kill -0 3794009 00:06:46.965 04:13:24 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:46.965 04:13:24 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:46.965 04:13:24 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:46.965 04:13:24 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:46.965 04:13:24 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:46.966 04:13:24 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:46.966 04:13:24 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:46.966 04:13:24 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:46.966 04:13:24 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.dc5YVi 00:06:46.966 04:13:24 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:46.966 04:13:24 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.dc5YVi/tests/target /tmp/spdk.dc5YVi 00:06:46.966 04:13:24 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@328 -- # df -T 00:06:46.966 04:13:24 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:46.966 04:13:24 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:46.966 04:13:24 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # avails["$mount"]=55244279808 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:06:46.966 04:13:24 -- common/autotest_common.sh@364 -- # uses["$mount"]=6744223744 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991659008 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:46.966 04:13:24 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:46.966 04:13:24 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993260544 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:06:46.966 04:13:24 -- common/autotest_common.sh@364 -- # uses["$mount"]=991232 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:46.966 04:13:24 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:46.966 04:13:24 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:46.966 04:13:24 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:46.966 04:13:24 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:46.966 * Looking for test storage... 00:06:46.966 04:13:24 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:46.966 04:13:24 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:46.966 04:13:24 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:46.966 04:13:24 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:46.966 04:13:24 -- common/autotest_common.sh@373 -- # mount=/ 00:06:46.966 04:13:24 -- common/autotest_common.sh@375 -- # target_space=55244279808 00:06:46.966 04:13:24 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:46.966 04:13:24 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:46.966 04:13:24 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@382 -- # new_size=8958816256 00:06:46.966 04:13:24 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:46.966 04:13:24 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:46.966 04:13:24 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:46.966 04:13:24 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:46.966 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:46.966 04:13:24 -- common/autotest_common.sh@390 -- # return 0 00:06:46.966 04:13:24 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:46.966 04:13:24 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:46.966 04:13:24 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:46.966 04:13:24 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:46.966 04:13:24 -- common/autotest_common.sh@1682 -- # true 00:06:46.966 04:13:24 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:46.966 04:13:24 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@27 -- # exec 00:06:46.966 04:13:24 -- common/autotest_common.sh@29 -- # exec 00:06:46.966 04:13:24 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:46.966 04:13:24 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:46.966 04:13:24 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:46.966 04:13:24 -- common/autotest_common.sh@18 -- # set -x 00:06:46.966 04:13:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:46.966 04:13:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:46.966 04:13:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:46.966 04:13:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:46.966 04:13:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:46.966 04:13:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:46.966 04:13:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:46.966 04:13:24 -- scripts/common.sh@335 -- # IFS=.-: 00:06:46.966 04:13:24 -- scripts/common.sh@335 -- # read -ra ver1 00:06:46.966 04:13:24 -- scripts/common.sh@336 -- # IFS=.-: 00:06:46.966 04:13:24 -- scripts/common.sh@336 -- # read -ra ver2 00:06:46.966 04:13:24 -- scripts/common.sh@337 -- # local 'op=<' 00:06:46.966 04:13:24 -- scripts/common.sh@339 -- # ver1_l=2 00:06:46.966 04:13:24 -- scripts/common.sh@340 -- # ver2_l=1 00:06:46.966 04:13:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:46.966 04:13:24 -- scripts/common.sh@343 -- # case "$op" in 00:06:46.966 04:13:24 -- scripts/common.sh@344 -- # : 1 00:06:46.966 04:13:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:46.966 04:13:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:46.966 04:13:24 -- scripts/common.sh@364 -- # decimal 1 00:06:46.966 04:13:24 -- scripts/common.sh@352 -- # local d=1 00:06:46.966 04:13:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:46.966 04:13:24 -- scripts/common.sh@354 -- # echo 1 00:06:46.966 04:13:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:46.966 04:13:24 -- scripts/common.sh@365 -- # decimal 2 00:06:46.966 04:13:24 -- scripts/common.sh@352 -- # local d=2 00:06:46.966 04:13:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:46.966 04:13:24 -- scripts/common.sh@354 -- # echo 2 00:06:46.966 04:13:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:46.966 04:13:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:46.966 04:13:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:46.966 04:13:24 -- scripts/common.sh@367 -- # return 0 00:06:46.966 04:13:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:46.966 04:13:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:46.966 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.966 --rc genhtml_branch_coverage=1 00:06:46.966 --rc genhtml_function_coverage=1 00:06:46.966 --rc genhtml_legend=1 00:06:46.966 --rc geninfo_all_blocks=1 00:06:46.966 --rc geninfo_unexecuted_blocks=1 00:06:46.966 00:06:46.966 ' 00:06:46.966 04:13:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:46.966 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.966 --rc genhtml_branch_coverage=1 00:06:46.966 --rc genhtml_function_coverage=1 00:06:46.966 --rc genhtml_legend=1 00:06:46.966 --rc geninfo_all_blocks=1 00:06:46.966 --rc geninfo_unexecuted_blocks=1 00:06:46.966 00:06:46.966 ' 00:06:46.966 04:13:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:46.966 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.966 --rc genhtml_branch_coverage=1 00:06:46.966 --rc genhtml_function_coverage=1 00:06:46.966 --rc genhtml_legend=1 00:06:46.966 --rc geninfo_all_blocks=1 00:06:46.966 --rc geninfo_unexecuted_blocks=1 00:06:46.966 00:06:46.966 ' 00:06:46.966 04:13:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:46.966 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.966 --rc genhtml_branch_coverage=1 00:06:46.966 --rc genhtml_function_coverage=1 00:06:46.966 --rc genhtml_legend=1 00:06:46.966 --rc geninfo_all_blocks=1 00:06:46.966 --rc geninfo_unexecuted_blocks=1 00:06:46.966 00:06:46.967 ' 00:06:46.967 04:13:24 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:46.967 04:13:24 -- nvmf/common.sh@7 -- # uname -s 00:06:46.967 04:13:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:46.967 04:13:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:46.967 04:13:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:46.967 04:13:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:46.967 04:13:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:46.967 04:13:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:46.967 04:13:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:46.967 04:13:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:46.967 04:13:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:46.967 04:13:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:46.967 04:13:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:46.967 04:13:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:46.967 04:13:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:46.967 04:13:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:46.967 04:13:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:46.967 04:13:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:46.967 04:13:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:46.967 04:13:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:46.967 04:13:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:46.967 04:13:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.967 04:13:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.967 04:13:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.967 04:13:24 -- paths/export.sh@5 -- # export PATH 00:06:46.967 04:13:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:46.967 04:13:24 -- nvmf/common.sh@46 -- # : 0 00:06:46.967 04:13:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:46.967 04:13:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:46.967 04:13:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:46.967 04:13:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:46.967 04:13:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:46.967 04:13:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:46.967 04:13:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:46.967 04:13:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:46.967 04:13:24 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:46.967 04:13:24 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:46.967 04:13:24 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:46.967 04:13:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:46.967 04:13:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:46.967 04:13:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:46.967 04:13:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:46.967 04:13:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:46.967 04:13:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:46.967 04:13:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:46.967 04:13:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:46.967 04:13:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:46.967 04:13:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:46.967 04:13:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:46.967 04:13:24 -- common/autotest_common.sh@10 -- # set +x 00:06:49.504 04:13:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:49.504 04:13:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:49.504 04:13:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:49.504 04:13:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:49.504 04:13:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:49.504 04:13:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:49.504 04:13:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:49.504 04:13:26 -- nvmf/common.sh@294 -- # net_devs=() 00:06:49.504 04:13:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:49.504 04:13:26 -- nvmf/common.sh@295 -- # e810=() 00:06:49.504 04:13:26 -- nvmf/common.sh@295 -- # local -ga e810 00:06:49.504 04:13:26 -- nvmf/common.sh@296 -- # x722=() 00:06:49.504 04:13:26 -- nvmf/common.sh@296 -- # local -ga x722 00:06:49.504 04:13:26 -- nvmf/common.sh@297 -- # mlx=() 00:06:49.504 04:13:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:49.504 04:13:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:49.504 04:13:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:49.504 04:13:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:49.504 04:13:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:49.504 04:13:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:49.504 04:13:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:49.504 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:49.504 04:13:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:49.504 04:13:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:49.504 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:49.504 04:13:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:49.504 04:13:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:49.504 04:13:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:49.504 04:13:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:49.504 04:13:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:49.504 04:13:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:49.504 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:49.504 04:13:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:49.504 04:13:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:49.504 04:13:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:49.504 04:13:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:49.504 04:13:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:49.504 04:13:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:49.504 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:49.504 04:13:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:49.504 04:13:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:49.504 04:13:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:49.504 04:13:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:49.504 04:13:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:49.504 04:13:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:49.504 04:13:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:49.504 04:13:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:49.504 04:13:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:49.504 04:13:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:49.504 04:13:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:49.504 04:13:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:49.504 04:13:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:49.504 04:13:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:49.504 04:13:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:49.504 04:13:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:49.504 04:13:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:49.504 04:13:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:49.504 04:13:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:49.504 04:13:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:49.504 04:13:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:49.504 04:13:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:49.504 04:13:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:49.504 04:13:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:49.504 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:49.504 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:06:49.504 00:06:49.504 --- 10.0.0.2 ping statistics --- 00:06:49.504 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:49.504 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:06:49.504 04:13:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:49.504 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:49.504 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:06:49.504 00:06:49.504 --- 10.0.0.1 ping statistics --- 00:06:49.504 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:49.504 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:06:49.504 04:13:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:49.504 04:13:26 -- nvmf/common.sh@410 -- # return 0 00:06:49.504 04:13:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:49.504 04:13:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:49.504 04:13:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:49.504 04:13:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:49.504 04:13:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:49.504 04:13:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:49.504 04:13:26 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:49.504 04:13:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:49.504 04:13:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.504 04:13:26 -- common/autotest_common.sh@10 -- # set +x 00:06:49.504 ************************************ 00:06:49.504 START TEST nvmf_filesystem_no_in_capsule 00:06:49.505 ************************************ 00:06:49.505 04:13:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:49.505 04:13:26 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:49.505 04:13:26 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:49.505 04:13:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:49.505 04:13:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:49.505 04:13:26 -- common/autotest_common.sh@10 -- # set +x 00:06:49.505 04:13:26 -- nvmf/common.sh@469 -- # nvmfpid=3795800 00:06:49.505 04:13:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:49.505 04:13:26 -- nvmf/common.sh@470 -- # waitforlisten 3795800 00:06:49.505 04:13:26 -- common/autotest_common.sh@829 -- # '[' -z 3795800 ']' 00:06:49.505 04:13:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:49.505 04:13:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.505 04:13:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:49.505 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:49.505 04:13:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.505 04:13:26 -- common/autotest_common.sh@10 -- # set +x 00:06:49.505 [2024-11-28 04:13:26.657617] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:49.505 [2024-11-28 04:13:26.657702] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:49.505 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.505 [2024-11-28 04:13:26.733658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:49.762 [2024-11-28 04:13:26.861782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:49.763 [2024-11-28 04:13:26.861949] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:49.763 [2024-11-28 04:13:26.861968] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:49.763 [2024-11-28 04:13:26.861982] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:49.763 [2024-11-28 04:13:26.864550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:49.763 [2024-11-28 04:13:26.864588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:49.763 [2024-11-28 04:13:26.864646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:49.763 [2024-11-28 04:13:26.864650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.697 04:13:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:50.697 04:13:27 -- common/autotest_common.sh@862 -- # return 0 00:06:50.697 04:13:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:50.697 04:13:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:50.697 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.697 04:13:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:50.697 04:13:27 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:50.697 04:13:27 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:50.697 04:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.697 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.697 [2024-11-28 04:13:27.690131] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:50.697 04:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.697 04:13:27 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:50.697 04:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.697 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.697 Malloc1 00:06:50.697 04:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.697 04:13:27 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:50.697 04:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.697 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.697 04:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.697 04:13:27 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:50.697 04:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.697 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.697 04:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.697 04:13:27 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:50.697 04:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.697 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.697 [2024-11-28 04:13:27.873161] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:50.697 04:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.697 04:13:27 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:50.697 04:13:27 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:50.697 04:13:27 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:50.697 04:13:27 -- common/autotest_common.sh@1369 -- # local bs 00:06:50.697 04:13:27 -- common/autotest_common.sh@1370 -- # local nb 00:06:50.697 04:13:27 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:50.697 04:13:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:50.697 04:13:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.697 04:13:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:50.697 04:13:27 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:50.697 { 00:06:50.697 "name": "Malloc1", 00:06:50.697 "aliases": [ 00:06:50.697 "a703fdc8-652e-43c7-b084-874842e903fa" 00:06:50.697 ], 00:06:50.697 "product_name": "Malloc disk", 00:06:50.697 "block_size": 512, 00:06:50.697 "num_blocks": 1048576, 00:06:50.697 "uuid": "a703fdc8-652e-43c7-b084-874842e903fa", 00:06:50.697 "assigned_rate_limits": { 00:06:50.697 "rw_ios_per_sec": 0, 00:06:50.697 "rw_mbytes_per_sec": 0, 00:06:50.697 "r_mbytes_per_sec": 0, 00:06:50.697 "w_mbytes_per_sec": 0 00:06:50.697 }, 00:06:50.697 "claimed": true, 00:06:50.697 "claim_type": "exclusive_write", 00:06:50.697 "zoned": false, 00:06:50.697 "supported_io_types": { 00:06:50.697 "read": true, 00:06:50.697 "write": true, 00:06:50.697 "unmap": true, 00:06:50.697 "write_zeroes": true, 00:06:50.697 "flush": true, 00:06:50.697 "reset": true, 00:06:50.697 "compare": false, 00:06:50.697 "compare_and_write": false, 00:06:50.697 "abort": true, 00:06:50.697 "nvme_admin": false, 00:06:50.697 "nvme_io": false 00:06:50.697 }, 00:06:50.697 "memory_domains": [ 00:06:50.697 { 00:06:50.697 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:50.697 "dma_device_type": 2 00:06:50.697 } 00:06:50.697 ], 00:06:50.697 "driver_specific": {} 00:06:50.697 } 00:06:50.697 ]' 00:06:50.697 04:13:27 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:50.697 04:13:27 -- common/autotest_common.sh@1372 -- # bs=512 00:06:50.697 04:13:27 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:50.697 04:13:27 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:50.697 04:13:27 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:50.697 04:13:27 -- common/autotest_common.sh@1377 -- # echo 512 00:06:50.697 04:13:27 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:50.697 04:13:27 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:51.628 04:13:28 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:51.629 04:13:28 -- common/autotest_common.sh@1187 -- # local i=0 00:06:51.629 04:13:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:51.629 04:13:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:51.629 04:13:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:53.524 04:13:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:53.524 04:13:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:53.524 04:13:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:53.524 04:13:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:53.524 04:13:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:53.524 04:13:30 -- common/autotest_common.sh@1197 -- # return 0 00:06:53.524 04:13:30 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:53.524 04:13:30 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:53.524 04:13:30 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:53.524 04:13:30 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:53.524 04:13:30 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:53.524 04:13:30 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:53.524 04:13:30 -- setup/common.sh@80 -- # echo 536870912 00:06:53.524 04:13:30 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:53.524 04:13:30 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:53.524 04:13:30 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:53.524 04:13:30 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:53.781 04:13:31 -- target/filesystem.sh@69 -- # partprobe 00:06:54.347 04:13:31 -- target/filesystem.sh@70 -- # sleep 1 00:06:55.280 04:13:32 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:55.280 04:13:32 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:55.280 04:13:32 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:55.280 04:13:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.280 04:13:32 -- common/autotest_common.sh@10 -- # set +x 00:06:55.280 ************************************ 00:06:55.280 START TEST filesystem_ext4 00:06:55.280 ************************************ 00:06:55.280 04:13:32 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:55.280 04:13:32 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:55.280 04:13:32 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:55.280 04:13:32 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:55.280 04:13:32 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:55.280 04:13:32 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:55.280 04:13:32 -- common/autotest_common.sh@914 -- # local i=0 00:06:55.280 04:13:32 -- common/autotest_common.sh@915 -- # local force 00:06:55.280 04:13:32 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:55.280 04:13:32 -- common/autotest_common.sh@918 -- # force=-F 00:06:55.280 04:13:32 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:55.280 mke2fs 1.47.0 (5-Feb-2023) 00:06:55.280 Discarding device blocks: 0/522240 done 00:06:55.280 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:55.280 Filesystem UUID: b8f65449-f0cd-418f-905a-4eaf0cc97fdc 00:06:55.280 Superblock backups stored on blocks: 00:06:55.280 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:55.280 00:06:55.280 Allocating group tables: 0/64 done 00:06:55.280 Writing inode tables: 0/64 done 00:06:56.265 Creating journal (8192 blocks): done 00:06:58.305 Writing superblocks and filesystem accounting information: 0/64 8/64 done 00:06:58.305 00:06:58.305 04:13:35 -- common/autotest_common.sh@931 -- # return 0 00:06:58.305 04:13:35 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:04.858 04:13:41 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:04.858 04:13:41 -- target/filesystem.sh@25 -- # sync 00:07:04.858 04:13:41 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:04.858 04:13:41 -- target/filesystem.sh@27 -- # sync 00:07:04.858 04:13:41 -- target/filesystem.sh@29 -- # i=0 00:07:04.858 04:13:41 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.858 04:13:41 -- target/filesystem.sh@37 -- # kill -0 3795800 00:07:04.858 04:13:41 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.858 04:13:41 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.858 04:13:41 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.858 04:13:41 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.858 00:07:04.858 real 0m8.922s 00:07:04.858 user 0m0.023s 00:07:04.858 sys 0m0.054s 00:07:04.858 04:13:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.858 04:13:41 -- common/autotest_common.sh@10 -- # set +x 00:07:04.858 ************************************ 00:07:04.858 END TEST filesystem_ext4 00:07:04.858 ************************************ 00:07:04.858 04:13:41 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:04.858 04:13:41 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:04.858 04:13:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.858 04:13:41 -- common/autotest_common.sh@10 -- # set +x 00:07:04.858 ************************************ 00:07:04.858 START TEST filesystem_btrfs 00:07:04.858 ************************************ 00:07:04.859 04:13:41 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:04.859 04:13:41 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:04.859 04:13:41 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:04.859 04:13:41 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:04.859 04:13:41 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:04.859 04:13:41 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:04.859 04:13:41 -- common/autotest_common.sh@914 -- # local i=0 00:07:04.859 04:13:41 -- common/autotest_common.sh@915 -- # local force 00:07:04.859 04:13:41 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:04.859 04:13:41 -- common/autotest_common.sh@920 -- # force=-f 00:07:04.859 04:13:41 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:04.859 btrfs-progs v6.8.1 00:07:04.859 See https://btrfs.readthedocs.io for more information. 00:07:04.859 00:07:04.859 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:04.859 NOTE: several default settings have changed in version 5.15, please make sure 00:07:04.859 this does not affect your deployments: 00:07:04.859 - DUP for metadata (-m dup) 00:07:04.859 - enabled no-holes (-O no-holes) 00:07:04.859 - enabled free-space-tree (-R free-space-tree) 00:07:04.859 00:07:04.859 Label: (null) 00:07:04.859 UUID: 582d71ad-1bb4-489f-86a9-42b92d3a4112 00:07:04.859 Node size: 16384 00:07:04.859 Sector size: 4096 (CPU page size: 4096) 00:07:04.859 Filesystem size: 510.00MiB 00:07:04.859 Block group profiles: 00:07:04.859 Data: single 8.00MiB 00:07:04.859 Metadata: DUP 32.00MiB 00:07:04.859 System: DUP 8.00MiB 00:07:04.859 SSD detected: yes 00:07:04.859 Zoned device: no 00:07:04.859 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:04.859 Checksum: crc32c 00:07:04.859 Number of devices: 1 00:07:04.859 Devices: 00:07:04.859 ID SIZE PATH 00:07:04.859 1 510.00MiB /dev/nvme0n1p1 00:07:04.859 00:07:04.859 04:13:41 -- common/autotest_common.sh@931 -- # return 0 00:07:04.859 04:13:41 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:05.424 04:13:42 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:05.424 04:13:42 -- target/filesystem.sh@25 -- # sync 00:07:05.424 04:13:42 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:05.424 04:13:42 -- target/filesystem.sh@27 -- # sync 00:07:05.424 04:13:42 -- target/filesystem.sh@29 -- # i=0 00:07:05.424 04:13:42 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:05.683 04:13:42 -- target/filesystem.sh@37 -- # kill -0 3795800 00:07:05.683 04:13:42 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:05.683 04:13:42 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:05.683 04:13:42 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:05.683 04:13:42 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:05.683 00:07:05.683 real 0m1.455s 00:07:05.683 user 0m0.025s 00:07:05.683 sys 0m0.099s 00:07:05.683 04:13:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.683 04:13:42 -- common/autotest_common.sh@10 -- # set +x 00:07:05.683 ************************************ 00:07:05.683 END TEST filesystem_btrfs 00:07:05.683 ************************************ 00:07:05.683 04:13:42 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:05.683 04:13:42 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:05.683 04:13:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.683 04:13:42 -- common/autotest_common.sh@10 -- # set +x 00:07:05.683 ************************************ 00:07:05.683 START TEST filesystem_xfs 00:07:05.683 ************************************ 00:07:05.683 04:13:42 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:05.683 04:13:42 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:05.683 04:13:42 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:05.683 04:13:42 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:05.683 04:13:42 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:05.683 04:13:42 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:05.683 04:13:42 -- common/autotest_common.sh@914 -- # local i=0 00:07:05.683 04:13:42 -- common/autotest_common.sh@915 -- # local force 00:07:05.683 04:13:42 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:05.683 04:13:42 -- common/autotest_common.sh@920 -- # force=-f 00:07:05.683 04:13:42 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:05.683 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:05.683 = sectsz=512 attr=2, projid32bit=1 00:07:05.683 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:05.683 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:05.683 data = bsize=4096 blocks=130560, imaxpct=25 00:07:05.683 = sunit=0 swidth=0 blks 00:07:05.683 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:05.683 log =internal log bsize=4096 blocks=16384, version=2 00:07:05.683 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:05.683 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:06.618 Discarding blocks...Done. 00:07:06.618 04:13:43 -- common/autotest_common.sh@931 -- # return 0 00:07:06.618 04:13:43 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:08.534 04:13:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:08.534 04:13:45 -- target/filesystem.sh@25 -- # sync 00:07:08.534 04:13:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:08.534 04:13:45 -- target/filesystem.sh@27 -- # sync 00:07:08.534 04:13:45 -- target/filesystem.sh@29 -- # i=0 00:07:08.534 04:13:45 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:08.534 04:13:45 -- target/filesystem.sh@37 -- # kill -0 3795800 00:07:08.534 04:13:45 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:08.534 04:13:45 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:08.534 04:13:45 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:08.534 04:13:45 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:08.534 00:07:08.534 real 0m2.694s 00:07:08.534 user 0m0.014s 00:07:08.534 sys 0m0.064s 00:07:08.534 04:13:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.534 04:13:45 -- common/autotest_common.sh@10 -- # set +x 00:07:08.534 ************************************ 00:07:08.534 END TEST filesystem_xfs 00:07:08.534 ************************************ 00:07:08.534 04:13:45 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:08.534 04:13:45 -- target/filesystem.sh@93 -- # sync 00:07:08.534 04:13:45 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:08.790 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:08.790 04:13:45 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:08.790 04:13:45 -- common/autotest_common.sh@1208 -- # local i=0 00:07:08.790 04:13:45 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:08.790 04:13:45 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:08.790 04:13:45 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:08.790 04:13:45 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:08.790 04:13:45 -- common/autotest_common.sh@1220 -- # return 0 00:07:08.790 04:13:45 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:08.790 04:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:08.790 04:13:45 -- common/autotest_common.sh@10 -- # set +x 00:07:08.790 04:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:08.790 04:13:45 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:08.790 04:13:45 -- target/filesystem.sh@101 -- # killprocess 3795800 00:07:08.790 04:13:45 -- common/autotest_common.sh@936 -- # '[' -z 3795800 ']' 00:07:08.790 04:13:45 -- common/autotest_common.sh@940 -- # kill -0 3795800 00:07:08.790 04:13:45 -- common/autotest_common.sh@941 -- # uname 00:07:08.790 04:13:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:08.790 04:13:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3795800 00:07:08.790 04:13:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:08.790 04:13:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:08.790 04:13:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3795800' 00:07:08.790 killing process with pid 3795800 00:07:08.790 04:13:45 -- common/autotest_common.sh@955 -- # kill 3795800 00:07:08.790 04:13:45 -- common/autotest_common.sh@960 -- # wait 3795800 00:07:09.353 04:13:46 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:09.353 00:07:09.353 real 0m19.813s 00:07:09.353 user 1m16.748s 00:07:09.353 sys 0m2.237s 00:07:09.353 04:13:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.353 04:13:46 -- common/autotest_common.sh@10 -- # set +x 00:07:09.353 ************************************ 00:07:09.353 END TEST nvmf_filesystem_no_in_capsule 00:07:09.353 ************************************ 00:07:09.353 04:13:46 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:09.353 04:13:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:09.353 04:13:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.353 04:13:46 -- common/autotest_common.sh@10 -- # set +x 00:07:09.353 ************************************ 00:07:09.353 START TEST nvmf_filesystem_in_capsule 00:07:09.353 ************************************ 00:07:09.353 04:13:46 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:09.353 04:13:46 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:09.353 04:13:46 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:09.353 04:13:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:09.353 04:13:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:09.353 04:13:46 -- common/autotest_common.sh@10 -- # set +x 00:07:09.353 04:13:46 -- nvmf/common.sh@469 -- # nvmfpid=3798374 00:07:09.353 04:13:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:09.353 04:13:46 -- nvmf/common.sh@470 -- # waitforlisten 3798374 00:07:09.353 04:13:46 -- common/autotest_common.sh@829 -- # '[' -z 3798374 ']' 00:07:09.353 04:13:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:09.353 04:13:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:09.353 04:13:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:09.353 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:09.353 04:13:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:09.353 04:13:46 -- common/autotest_common.sh@10 -- # set +x 00:07:09.353 [2024-11-28 04:13:46.500502] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.353 [2024-11-28 04:13:46.500607] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:09.353 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.353 [2024-11-28 04:13:46.568246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:09.610 [2024-11-28 04:13:46.686194] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:09.610 [2024-11-28 04:13:46.686351] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:09.610 [2024-11-28 04:13:46.686370] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:09.610 [2024-11-28 04:13:46.686384] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:09.610 [2024-11-28 04:13:46.686468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:09.610 [2024-11-28 04:13:46.686523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:09.610 [2024-11-28 04:13:46.686577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:09.610 [2024-11-28 04:13:46.686580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.540 04:13:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:10.540 04:13:47 -- common/autotest_common.sh@862 -- # return 0 00:07:10.540 04:13:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:10.540 04:13:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:10.540 04:13:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.540 04:13:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:10.540 04:13:47 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:10.540 04:13:47 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:10.540 04:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.540 04:13:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.540 [2024-11-28 04:13:47.532245] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:10.540 04:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.540 04:13:47 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:10.540 04:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.540 04:13:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.540 Malloc1 00:07:10.540 04:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.540 04:13:47 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:10.540 04:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.540 04:13:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.540 04:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.540 04:13:47 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:10.540 04:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.540 04:13:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.540 04:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.540 04:13:47 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:10.540 04:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.540 04:13:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.540 [2024-11-28 04:13:47.719077] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:10.540 04:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.540 04:13:47 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:10.540 04:13:47 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:10.540 04:13:47 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:10.540 04:13:47 -- common/autotest_common.sh@1369 -- # local bs 00:07:10.540 04:13:47 -- common/autotest_common.sh@1370 -- # local nb 00:07:10.540 04:13:47 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:10.540 04:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.540 04:13:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.540 04:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.540 04:13:47 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:10.540 { 00:07:10.540 "name": "Malloc1", 00:07:10.540 "aliases": [ 00:07:10.540 "cb809f35-a8fd-4a98-9b50-61bb70e82920" 00:07:10.540 ], 00:07:10.541 "product_name": "Malloc disk", 00:07:10.541 "block_size": 512, 00:07:10.541 "num_blocks": 1048576, 00:07:10.541 "uuid": "cb809f35-a8fd-4a98-9b50-61bb70e82920", 00:07:10.541 "assigned_rate_limits": { 00:07:10.541 "rw_ios_per_sec": 0, 00:07:10.541 "rw_mbytes_per_sec": 0, 00:07:10.541 "r_mbytes_per_sec": 0, 00:07:10.541 "w_mbytes_per_sec": 0 00:07:10.541 }, 00:07:10.541 "claimed": true, 00:07:10.541 "claim_type": "exclusive_write", 00:07:10.541 "zoned": false, 00:07:10.541 "supported_io_types": { 00:07:10.541 "read": true, 00:07:10.541 "write": true, 00:07:10.541 "unmap": true, 00:07:10.541 "write_zeroes": true, 00:07:10.541 "flush": true, 00:07:10.541 "reset": true, 00:07:10.541 "compare": false, 00:07:10.541 "compare_and_write": false, 00:07:10.541 "abort": true, 00:07:10.541 "nvme_admin": false, 00:07:10.541 "nvme_io": false 00:07:10.541 }, 00:07:10.541 "memory_domains": [ 00:07:10.541 { 00:07:10.541 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:10.541 "dma_device_type": 2 00:07:10.541 } 00:07:10.541 ], 00:07:10.541 "driver_specific": {} 00:07:10.541 } 00:07:10.541 ]' 00:07:10.541 04:13:47 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:10.541 04:13:47 -- common/autotest_common.sh@1372 -- # bs=512 00:07:10.541 04:13:47 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:10.541 04:13:47 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:10.541 04:13:47 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:10.541 04:13:47 -- common/autotest_common.sh@1377 -- # echo 512 00:07:10.541 04:13:47 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:10.541 04:13:47 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:11.471 04:13:48 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:11.471 04:13:48 -- common/autotest_common.sh@1187 -- # local i=0 00:07:11.471 04:13:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:11.471 04:13:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:11.471 04:13:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:13.368 04:13:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:13.368 04:13:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:13.368 04:13:50 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:13.368 04:13:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:13.368 04:13:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:13.368 04:13:50 -- common/autotest_common.sh@1197 -- # return 0 00:07:13.368 04:13:50 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:13.368 04:13:50 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:13.368 04:13:50 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:13.368 04:13:50 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:13.368 04:13:50 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:13.368 04:13:50 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:13.368 04:13:50 -- setup/common.sh@80 -- # echo 536870912 00:07:13.368 04:13:50 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:13.368 04:13:50 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:13.368 04:13:50 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:13.368 04:13:50 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:13.626 04:13:50 -- target/filesystem.sh@69 -- # partprobe 00:07:14.191 04:13:51 -- target/filesystem.sh@70 -- # sleep 1 00:07:15.124 04:13:52 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:15.124 04:13:52 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:15.124 04:13:52 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:15.124 04:13:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.124 04:13:52 -- common/autotest_common.sh@10 -- # set +x 00:07:15.124 ************************************ 00:07:15.124 START TEST filesystem_in_capsule_ext4 00:07:15.124 ************************************ 00:07:15.124 04:13:52 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:15.124 04:13:52 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:15.124 04:13:52 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:15.124 04:13:52 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:15.124 04:13:52 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:15.124 04:13:52 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:15.124 04:13:52 -- common/autotest_common.sh@914 -- # local i=0 00:07:15.124 04:13:52 -- common/autotest_common.sh@915 -- # local force 00:07:15.124 04:13:52 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:15.124 04:13:52 -- common/autotest_common.sh@918 -- # force=-F 00:07:15.124 04:13:52 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:15.124 mke2fs 1.47.0 (5-Feb-2023) 00:07:15.124 Discarding device blocks: 0/522240 done 00:07:15.382 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:15.382 Filesystem UUID: 7fc6484c-4d35-4f91-b449-0b80dd0f83f9 00:07:15.382 Superblock backups stored on blocks: 00:07:15.382 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:15.382 00:07:15.382 Allocating group tables: 0/64 done 00:07:15.382 Writing inode tables: 0/64 done 00:07:16.754 Creating journal (8192 blocks): done 00:07:16.754 Writing superblocks and filesystem accounting information: 0/64 done 00:07:16.754 00:07:16.754 04:13:53 -- common/autotest_common.sh@931 -- # return 0 00:07:16.754 04:13:53 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:23.305 04:13:59 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:23.305 04:13:59 -- target/filesystem.sh@25 -- # sync 00:07:23.305 04:13:59 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:23.305 04:13:59 -- target/filesystem.sh@27 -- # sync 00:07:23.305 04:14:00 -- target/filesystem.sh@29 -- # i=0 00:07:23.305 04:14:00 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:23.305 04:14:00 -- target/filesystem.sh@37 -- # kill -0 3798374 00:07:23.305 04:14:00 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:23.305 04:14:00 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:23.305 04:14:00 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:23.305 04:14:00 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:23.305 00:07:23.305 real 0m7.764s 00:07:23.305 user 0m0.016s 00:07:23.305 sys 0m0.058s 00:07:23.305 04:14:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.305 04:14:00 -- common/autotest_common.sh@10 -- # set +x 00:07:23.306 ************************************ 00:07:23.306 END TEST filesystem_in_capsule_ext4 00:07:23.306 ************************************ 00:07:23.306 04:14:00 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:23.306 04:14:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:23.306 04:14:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.306 04:14:00 -- common/autotest_common.sh@10 -- # set +x 00:07:23.306 ************************************ 00:07:23.306 START TEST filesystem_in_capsule_btrfs 00:07:23.306 ************************************ 00:07:23.306 04:14:00 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:23.306 04:14:00 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:23.306 04:14:00 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:23.306 04:14:00 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:23.306 04:14:00 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:23.306 04:14:00 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:23.306 04:14:00 -- common/autotest_common.sh@914 -- # local i=0 00:07:23.306 04:14:00 -- common/autotest_common.sh@915 -- # local force 00:07:23.306 04:14:00 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:23.306 04:14:00 -- common/autotest_common.sh@920 -- # force=-f 00:07:23.306 04:14:00 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:23.306 btrfs-progs v6.8.1 00:07:23.306 See https://btrfs.readthedocs.io for more information. 00:07:23.306 00:07:23.306 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:23.306 NOTE: several default settings have changed in version 5.15, please make sure 00:07:23.306 this does not affect your deployments: 00:07:23.306 - DUP for metadata (-m dup) 00:07:23.306 - enabled no-holes (-O no-holes) 00:07:23.306 - enabled free-space-tree (-R free-space-tree) 00:07:23.306 00:07:23.306 Label: (null) 00:07:23.306 UUID: 1f797a4b-4647-4159-8082-acf1c1b6a362 00:07:23.306 Node size: 16384 00:07:23.306 Sector size: 4096 (CPU page size: 4096) 00:07:23.306 Filesystem size: 510.00MiB 00:07:23.306 Block group profiles: 00:07:23.306 Data: single 8.00MiB 00:07:23.306 Metadata: DUP 32.00MiB 00:07:23.306 System: DUP 8.00MiB 00:07:23.306 SSD detected: yes 00:07:23.306 Zoned device: no 00:07:23.306 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:23.306 Checksum: crc32c 00:07:23.306 Number of devices: 1 00:07:23.306 Devices: 00:07:23.306 ID SIZE PATH 00:07:23.306 1 510.00MiB /dev/nvme0n1p1 00:07:23.306 00:07:23.306 04:14:00 -- common/autotest_common.sh@931 -- # return 0 00:07:23.306 04:14:00 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:23.872 04:14:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:23.872 04:14:01 -- target/filesystem.sh@25 -- # sync 00:07:23.872 04:14:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:23.872 04:14:01 -- target/filesystem.sh@27 -- # sync 00:07:23.872 04:14:01 -- target/filesystem.sh@29 -- # i=0 00:07:23.872 04:14:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:24.130 04:14:01 -- target/filesystem.sh@37 -- # kill -0 3798374 00:07:24.130 04:14:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:24.130 04:14:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:24.130 04:14:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:24.130 04:14:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:24.130 00:07:24.130 real 0m1.158s 00:07:24.130 user 0m0.020s 00:07:24.130 sys 0m0.097s 00:07:24.130 04:14:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.130 04:14:01 -- common/autotest_common.sh@10 -- # set +x 00:07:24.130 ************************************ 00:07:24.130 END TEST filesystem_in_capsule_btrfs 00:07:24.130 ************************************ 00:07:24.130 04:14:01 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:24.130 04:14:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:24.130 04:14:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.130 04:14:01 -- common/autotest_common.sh@10 -- # set +x 00:07:24.130 ************************************ 00:07:24.130 START TEST filesystem_in_capsule_xfs 00:07:24.130 ************************************ 00:07:24.130 04:14:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:24.130 04:14:01 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:24.130 04:14:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:24.130 04:14:01 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:24.130 04:14:01 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:24.130 04:14:01 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:24.130 04:14:01 -- common/autotest_common.sh@914 -- # local i=0 00:07:24.130 04:14:01 -- common/autotest_common.sh@915 -- # local force 00:07:24.130 04:14:01 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:24.130 04:14:01 -- common/autotest_common.sh@920 -- # force=-f 00:07:24.130 04:14:01 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:24.130 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:24.130 = sectsz=512 attr=2, projid32bit=1 00:07:24.130 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:24.130 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:24.130 data = bsize=4096 blocks=130560, imaxpct=25 00:07:24.130 = sunit=0 swidth=0 blks 00:07:24.130 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:24.130 log =internal log bsize=4096 blocks=16384, version=2 00:07:24.130 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:24.130 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:25.064 Discarding blocks...Done. 00:07:25.064 04:14:02 -- common/autotest_common.sh@931 -- # return 0 00:07:25.064 04:14:02 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:27.592 04:14:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:27.592 04:14:04 -- target/filesystem.sh@25 -- # sync 00:07:27.592 04:14:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:27.592 04:14:04 -- target/filesystem.sh@27 -- # sync 00:07:27.592 04:14:04 -- target/filesystem.sh@29 -- # i=0 00:07:27.592 04:14:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:27.592 04:14:04 -- target/filesystem.sh@37 -- # kill -0 3798374 00:07:27.592 04:14:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:27.592 04:14:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:27.592 04:14:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:27.592 04:14:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:27.592 00:07:27.592 real 0m3.273s 00:07:27.592 user 0m0.014s 00:07:27.592 sys 0m0.067s 00:07:27.592 04:14:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.592 04:14:04 -- common/autotest_common.sh@10 -- # set +x 00:07:27.592 ************************************ 00:07:27.592 END TEST filesystem_in_capsule_xfs 00:07:27.592 ************************************ 00:07:27.592 04:14:04 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:27.592 04:14:04 -- target/filesystem.sh@93 -- # sync 00:07:27.592 04:14:04 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:27.592 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:27.592 04:14:04 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:27.592 04:14:04 -- common/autotest_common.sh@1208 -- # local i=0 00:07:27.850 04:14:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:27.850 04:14:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:27.850 04:14:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:27.850 04:14:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:27.850 04:14:04 -- common/autotest_common.sh@1220 -- # return 0 00:07:27.850 04:14:04 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:27.850 04:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.850 04:14:04 -- common/autotest_common.sh@10 -- # set +x 00:07:27.850 04:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.850 04:14:04 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:27.850 04:14:04 -- target/filesystem.sh@101 -- # killprocess 3798374 00:07:27.850 04:14:04 -- common/autotest_common.sh@936 -- # '[' -z 3798374 ']' 00:07:27.850 04:14:04 -- common/autotest_common.sh@940 -- # kill -0 3798374 00:07:27.850 04:14:04 -- common/autotest_common.sh@941 -- # uname 00:07:27.850 04:14:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:27.850 04:14:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3798374 00:07:27.850 04:14:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:27.850 04:14:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:27.850 04:14:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3798374' 00:07:27.850 killing process with pid 3798374 00:07:27.850 04:14:04 -- common/autotest_common.sh@955 -- # kill 3798374 00:07:27.850 04:14:04 -- common/autotest_common.sh@960 -- # wait 3798374 00:07:28.416 04:14:05 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:28.416 00:07:28.416 real 0m18.999s 00:07:28.416 user 1m13.495s 00:07:28.416 sys 0m2.319s 00:07:28.416 04:14:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.416 04:14:05 -- common/autotest_common.sh@10 -- # set +x 00:07:28.416 ************************************ 00:07:28.416 END TEST nvmf_filesystem_in_capsule 00:07:28.416 ************************************ 00:07:28.416 04:14:05 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:28.416 04:14:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:28.416 04:14:05 -- nvmf/common.sh@116 -- # sync 00:07:28.416 04:14:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:28.416 04:14:05 -- nvmf/common.sh@119 -- # set +e 00:07:28.416 04:14:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:28.416 04:14:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:28.416 rmmod nvme_tcp 00:07:28.416 rmmod nvme_fabrics 00:07:28.416 rmmod nvme_keyring 00:07:28.416 04:14:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:28.416 04:14:05 -- nvmf/common.sh@123 -- # set -e 00:07:28.416 04:14:05 -- nvmf/common.sh@124 -- # return 0 00:07:28.416 04:14:05 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:28.416 04:14:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:28.416 04:14:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:28.416 04:14:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:28.416 04:14:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:28.416 04:14:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:28.416 04:14:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:28.416 04:14:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:28.416 04:14:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:30.321 04:14:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:30.321 00:07:30.321 real 0m43.780s 00:07:30.321 user 2m31.407s 00:07:30.321 sys 0m6.329s 00:07:30.321 04:14:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.321 04:14:07 -- common/autotest_common.sh@10 -- # set +x 00:07:30.321 ************************************ 00:07:30.321 END TEST nvmf_filesystem 00:07:30.321 ************************************ 00:07:30.321 04:14:07 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:30.322 04:14:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:30.322 04:14:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.322 04:14:07 -- common/autotest_common.sh@10 -- # set +x 00:07:30.322 ************************************ 00:07:30.322 START TEST nvmf_discovery 00:07:30.322 ************************************ 00:07:30.322 04:14:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:30.580 * Looking for test storage... 00:07:30.580 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:30.580 04:14:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.580 04:14:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.580 04:14:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.580 04:14:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.580 04:14:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.580 04:14:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.580 04:14:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.580 04:14:07 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.580 04:14:07 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.580 04:14:07 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.580 04:14:07 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.580 04:14:07 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.580 04:14:07 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.580 04:14:07 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.580 04:14:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.580 04:14:07 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.580 04:14:07 -- scripts/common.sh@344 -- # : 1 00:07:30.580 04:14:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.580 04:14:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.580 04:14:07 -- scripts/common.sh@364 -- # decimal 1 00:07:30.580 04:14:07 -- scripts/common.sh@352 -- # local d=1 00:07:30.580 04:14:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.580 04:14:07 -- scripts/common.sh@354 -- # echo 1 00:07:30.580 04:14:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.580 04:14:07 -- scripts/common.sh@365 -- # decimal 2 00:07:30.580 04:14:07 -- scripts/common.sh@352 -- # local d=2 00:07:30.580 04:14:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.580 04:14:07 -- scripts/common.sh@354 -- # echo 2 00:07:30.580 04:14:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.580 04:14:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.580 04:14:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.580 04:14:07 -- scripts/common.sh@367 -- # return 0 00:07:30.580 04:14:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.580 04:14:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.580 --rc genhtml_branch_coverage=1 00:07:30.581 --rc genhtml_function_coverage=1 00:07:30.581 --rc genhtml_legend=1 00:07:30.581 --rc geninfo_all_blocks=1 00:07:30.581 --rc geninfo_unexecuted_blocks=1 00:07:30.581 00:07:30.581 ' 00:07:30.581 04:14:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.581 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.581 --rc genhtml_branch_coverage=1 00:07:30.581 --rc genhtml_function_coverage=1 00:07:30.581 --rc genhtml_legend=1 00:07:30.581 --rc geninfo_all_blocks=1 00:07:30.581 --rc geninfo_unexecuted_blocks=1 00:07:30.581 00:07:30.581 ' 00:07:30.581 04:14:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.581 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.581 --rc genhtml_branch_coverage=1 00:07:30.581 --rc genhtml_function_coverage=1 00:07:30.581 --rc genhtml_legend=1 00:07:30.581 --rc geninfo_all_blocks=1 00:07:30.581 --rc geninfo_unexecuted_blocks=1 00:07:30.581 00:07:30.581 ' 00:07:30.581 04:14:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.581 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.581 --rc genhtml_branch_coverage=1 00:07:30.581 --rc genhtml_function_coverage=1 00:07:30.581 --rc genhtml_legend=1 00:07:30.581 --rc geninfo_all_blocks=1 00:07:30.581 --rc geninfo_unexecuted_blocks=1 00:07:30.581 00:07:30.581 ' 00:07:30.581 04:14:07 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:30.581 04:14:07 -- nvmf/common.sh@7 -- # uname -s 00:07:30.581 04:14:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:30.581 04:14:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:30.581 04:14:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:30.581 04:14:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:30.581 04:14:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:30.581 04:14:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:30.581 04:14:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:30.581 04:14:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:30.581 04:14:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:30.581 04:14:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:30.581 04:14:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.581 04:14:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.581 04:14:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:30.581 04:14:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:30.581 04:14:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:30.581 04:14:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:30.581 04:14:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:30.581 04:14:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:30.581 04:14:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:30.581 04:14:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 04:14:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 04:14:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 04:14:07 -- paths/export.sh@5 -- # export PATH 00:07:30.581 04:14:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.581 04:14:07 -- nvmf/common.sh@46 -- # : 0 00:07:30.581 04:14:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:30.581 04:14:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:30.581 04:14:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:30.581 04:14:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:30.581 04:14:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:30.581 04:14:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:30.581 04:14:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:30.581 04:14:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:30.581 04:14:07 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:30.581 04:14:07 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:30.581 04:14:07 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:30.581 04:14:07 -- target/discovery.sh@15 -- # hash nvme 00:07:30.581 04:14:07 -- target/discovery.sh@20 -- # nvmftestinit 00:07:30.581 04:14:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:30.581 04:14:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:30.581 04:14:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:30.581 04:14:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:30.581 04:14:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:30.581 04:14:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:30.581 04:14:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:30.581 04:14:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:30.581 04:14:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:30.581 04:14:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:30.581 04:14:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:30.581 04:14:07 -- common/autotest_common.sh@10 -- # set +x 00:07:33.172 04:14:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:33.172 04:14:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:33.172 04:14:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:33.172 04:14:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:33.172 04:14:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:33.172 04:14:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:33.172 04:14:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:33.172 04:14:09 -- nvmf/common.sh@294 -- # net_devs=() 00:07:33.172 04:14:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:33.172 04:14:09 -- nvmf/common.sh@295 -- # e810=() 00:07:33.172 04:14:09 -- nvmf/common.sh@295 -- # local -ga e810 00:07:33.172 04:14:09 -- nvmf/common.sh@296 -- # x722=() 00:07:33.172 04:14:09 -- nvmf/common.sh@296 -- # local -ga x722 00:07:33.172 04:14:09 -- nvmf/common.sh@297 -- # mlx=() 00:07:33.172 04:14:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:33.172 04:14:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:33.172 04:14:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:33.172 04:14:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:33.172 04:14:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:33.172 04:14:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:33.172 04:14:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:33.173 04:14:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:33.173 04:14:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:33.173 04:14:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:33.173 04:14:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:33.173 04:14:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:33.173 04:14:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:33.173 04:14:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:33.173 04:14:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:33.173 04:14:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:33.173 04:14:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:33.173 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:33.173 04:14:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:33.173 04:14:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:33.173 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:33.173 04:14:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:33.173 04:14:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:33.173 04:14:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:33.173 04:14:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:33.173 04:14:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:33.173 04:14:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:33.173 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:33.173 04:14:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:33.173 04:14:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:33.173 04:14:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:33.173 04:14:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:33.173 04:14:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:33.173 04:14:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:33.173 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:33.173 04:14:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:33.173 04:14:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:33.173 04:14:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:33.173 04:14:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:33.173 04:14:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:33.173 04:14:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:33.173 04:14:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:33.173 04:14:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:33.173 04:14:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:33.173 04:14:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:33.173 04:14:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:33.173 04:14:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:33.173 04:14:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:33.173 04:14:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:33.173 04:14:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:33.173 04:14:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:33.173 04:14:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:33.173 04:14:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:33.173 04:14:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:33.173 04:14:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:33.173 04:14:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:33.173 04:14:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:33.173 04:14:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:33.173 04:14:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:33.173 04:14:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:33.173 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:33.173 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.153 ms 00:07:33.173 00:07:33.173 --- 10.0.0.2 ping statistics --- 00:07:33.173 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:33.173 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:07:33.173 04:14:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:33.173 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:33.173 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:07:33.173 00:07:33.173 --- 10.0.0.1 ping statistics --- 00:07:33.173 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:33.173 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:07:33.173 04:14:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:33.173 04:14:10 -- nvmf/common.sh@410 -- # return 0 00:07:33.173 04:14:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:33.173 04:14:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:33.173 04:14:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:33.173 04:14:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:33.173 04:14:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:33.173 04:14:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:33.173 04:14:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:33.173 04:14:10 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:33.173 04:14:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:33.173 04:14:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:33.173 04:14:10 -- common/autotest_common.sh@10 -- # set +x 00:07:33.173 04:14:10 -- nvmf/common.sh@469 -- # nvmfpid=3802884 00:07:33.173 04:14:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:33.173 04:14:10 -- nvmf/common.sh@470 -- # waitforlisten 3802884 00:07:33.173 04:14:10 -- common/autotest_common.sh@829 -- # '[' -z 3802884 ']' 00:07:33.173 04:14:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:33.173 04:14:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:33.173 04:14:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:33.173 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:33.173 04:14:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:33.173 04:14:10 -- common/autotest_common.sh@10 -- # set +x 00:07:33.173 [2024-11-28 04:14:10.120213] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:33.173 [2024-11-28 04:14:10.120290] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:33.173 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.173 [2024-11-28 04:14:10.194647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:33.173 [2024-11-28 04:14:10.310666] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:33.173 [2024-11-28 04:14:10.310828] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:33.173 [2024-11-28 04:14:10.310845] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:33.173 [2024-11-28 04:14:10.310858] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:33.173 [2024-11-28 04:14:10.310922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:33.173 [2024-11-28 04:14:10.310947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:33.173 [2024-11-28 04:14:10.311007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:33.173 [2024-11-28 04:14:10.311010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.107 04:14:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:34.107 04:14:11 -- common/autotest_common.sh@862 -- # return 0 00:07:34.107 04:14:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:34.107 04:14:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 04:14:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:34.107 04:14:11 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 [2024-11-28 04:14:11.161177] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.107 04:14:11 -- target/discovery.sh@26 -- # seq 1 4 00:07:34.107 04:14:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:34.107 04:14:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 Null1 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.107 04:14:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.107 04:14:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.107 04:14:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 [2024-11-28 04:14:11.201453] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.107 04:14:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:34.107 04:14:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 Null2 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.107 04:14:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.107 04:14:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:34.107 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.107 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.107 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:34.108 04:14:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 Null3 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:34.108 04:14:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 Null4 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:34.108 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.108 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.108 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.108 04:14:11 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:34.366 00:07:34.366 Discovery Log Number of Records 6, Generation counter 6 00:07:34.366 =====Discovery Log Entry 0====== 00:07:34.366 trtype: tcp 00:07:34.366 adrfam: ipv4 00:07:34.366 subtype: current discovery subsystem 00:07:34.366 treq: not required 00:07:34.366 portid: 0 00:07:34.366 trsvcid: 4420 00:07:34.366 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:34.366 traddr: 10.0.0.2 00:07:34.366 eflags: explicit discovery connections, duplicate discovery information 00:07:34.366 sectype: none 00:07:34.366 =====Discovery Log Entry 1====== 00:07:34.366 trtype: tcp 00:07:34.366 adrfam: ipv4 00:07:34.366 subtype: nvme subsystem 00:07:34.366 treq: not required 00:07:34.366 portid: 0 00:07:34.366 trsvcid: 4420 00:07:34.366 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:34.366 traddr: 10.0.0.2 00:07:34.366 eflags: none 00:07:34.366 sectype: none 00:07:34.366 =====Discovery Log Entry 2====== 00:07:34.366 trtype: tcp 00:07:34.366 adrfam: ipv4 00:07:34.366 subtype: nvme subsystem 00:07:34.366 treq: not required 00:07:34.366 portid: 0 00:07:34.366 trsvcid: 4420 00:07:34.366 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:34.366 traddr: 10.0.0.2 00:07:34.366 eflags: none 00:07:34.366 sectype: none 00:07:34.366 =====Discovery Log Entry 3====== 00:07:34.366 trtype: tcp 00:07:34.366 adrfam: ipv4 00:07:34.366 subtype: nvme subsystem 00:07:34.366 treq: not required 00:07:34.366 portid: 0 00:07:34.366 trsvcid: 4420 00:07:34.366 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:34.366 traddr: 10.0.0.2 00:07:34.366 eflags: none 00:07:34.366 sectype: none 00:07:34.366 =====Discovery Log Entry 4====== 00:07:34.366 trtype: tcp 00:07:34.366 adrfam: ipv4 00:07:34.366 subtype: nvme subsystem 00:07:34.366 treq: not required 00:07:34.366 portid: 0 00:07:34.366 trsvcid: 4420 00:07:34.366 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:34.366 traddr: 10.0.0.2 00:07:34.366 eflags: none 00:07:34.366 sectype: none 00:07:34.366 =====Discovery Log Entry 5====== 00:07:34.366 trtype: tcp 00:07:34.366 adrfam: ipv4 00:07:34.366 subtype: discovery subsystem referral 00:07:34.366 treq: not required 00:07:34.366 portid: 0 00:07:34.366 trsvcid: 4430 00:07:34.366 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:34.366 traddr: 10.0.0.2 00:07:34.366 eflags: none 00:07:34.366 sectype: none 00:07:34.366 04:14:11 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:34.366 Perform nvmf subsystem discovery via RPC 00:07:34.366 04:14:11 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:34.366 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.366 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.366 [2024-11-28 04:14:11.542415] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:34.366 [ 00:07:34.366 { 00:07:34.366 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:34.366 "subtype": "Discovery", 00:07:34.366 "listen_addresses": [ 00:07:34.366 { 00:07:34.366 "transport": "TCP", 00:07:34.366 "trtype": "TCP", 00:07:34.366 "adrfam": "IPv4", 00:07:34.366 "traddr": "10.0.0.2", 00:07:34.366 "trsvcid": "4420" 00:07:34.366 } 00:07:34.366 ], 00:07:34.366 "allow_any_host": true, 00:07:34.366 "hosts": [] 00:07:34.366 }, 00:07:34.366 { 00:07:34.366 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:34.366 "subtype": "NVMe", 00:07:34.366 "listen_addresses": [ 00:07:34.366 { 00:07:34.366 "transport": "TCP", 00:07:34.366 "trtype": "TCP", 00:07:34.366 "adrfam": "IPv4", 00:07:34.366 "traddr": "10.0.0.2", 00:07:34.366 "trsvcid": "4420" 00:07:34.366 } 00:07:34.366 ], 00:07:34.366 "allow_any_host": true, 00:07:34.366 "hosts": [], 00:07:34.366 "serial_number": "SPDK00000000000001", 00:07:34.366 "model_number": "SPDK bdev Controller", 00:07:34.366 "max_namespaces": 32, 00:07:34.366 "min_cntlid": 1, 00:07:34.366 "max_cntlid": 65519, 00:07:34.366 "namespaces": [ 00:07:34.366 { 00:07:34.366 "nsid": 1, 00:07:34.366 "bdev_name": "Null1", 00:07:34.366 "name": "Null1", 00:07:34.366 "nguid": "1FDF989A87D84A9D8EDFC58E3B8DA135", 00:07:34.366 "uuid": "1fdf989a-87d8-4a9d-8edf-c58e3b8da135" 00:07:34.366 } 00:07:34.366 ] 00:07:34.366 }, 00:07:34.366 { 00:07:34.367 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:34.367 "subtype": "NVMe", 00:07:34.367 "listen_addresses": [ 00:07:34.367 { 00:07:34.367 "transport": "TCP", 00:07:34.367 "trtype": "TCP", 00:07:34.367 "adrfam": "IPv4", 00:07:34.367 "traddr": "10.0.0.2", 00:07:34.367 "trsvcid": "4420" 00:07:34.367 } 00:07:34.367 ], 00:07:34.367 "allow_any_host": true, 00:07:34.367 "hosts": [], 00:07:34.367 "serial_number": "SPDK00000000000002", 00:07:34.367 "model_number": "SPDK bdev Controller", 00:07:34.367 "max_namespaces": 32, 00:07:34.367 "min_cntlid": 1, 00:07:34.367 "max_cntlid": 65519, 00:07:34.367 "namespaces": [ 00:07:34.367 { 00:07:34.367 "nsid": 1, 00:07:34.367 "bdev_name": "Null2", 00:07:34.367 "name": "Null2", 00:07:34.367 "nguid": "0F822C1A3444475386C02EB2A44095F7", 00:07:34.367 "uuid": "0f822c1a-3444-4753-86c0-2eb2a44095f7" 00:07:34.367 } 00:07:34.367 ] 00:07:34.367 }, 00:07:34.367 { 00:07:34.367 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:34.367 "subtype": "NVMe", 00:07:34.367 "listen_addresses": [ 00:07:34.367 { 00:07:34.367 "transport": "TCP", 00:07:34.367 "trtype": "TCP", 00:07:34.367 "adrfam": "IPv4", 00:07:34.367 "traddr": "10.0.0.2", 00:07:34.367 "trsvcid": "4420" 00:07:34.367 } 00:07:34.367 ], 00:07:34.367 "allow_any_host": true, 00:07:34.367 "hosts": [], 00:07:34.367 "serial_number": "SPDK00000000000003", 00:07:34.367 "model_number": "SPDK bdev Controller", 00:07:34.367 "max_namespaces": 32, 00:07:34.367 "min_cntlid": 1, 00:07:34.367 "max_cntlid": 65519, 00:07:34.367 "namespaces": [ 00:07:34.367 { 00:07:34.367 "nsid": 1, 00:07:34.367 "bdev_name": "Null3", 00:07:34.367 "name": "Null3", 00:07:34.367 "nguid": "AB4E5E909ACC4D2A86DDD713714D8967", 00:07:34.367 "uuid": "ab4e5e90-9acc-4d2a-86dd-d713714d8967" 00:07:34.367 } 00:07:34.367 ] 00:07:34.367 }, 00:07:34.367 { 00:07:34.367 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:34.367 "subtype": "NVMe", 00:07:34.367 "listen_addresses": [ 00:07:34.367 { 00:07:34.367 "transport": "TCP", 00:07:34.367 "trtype": "TCP", 00:07:34.367 "adrfam": "IPv4", 00:07:34.367 "traddr": "10.0.0.2", 00:07:34.367 "trsvcid": "4420" 00:07:34.367 } 00:07:34.367 ], 00:07:34.367 "allow_any_host": true, 00:07:34.367 "hosts": [], 00:07:34.367 "serial_number": "SPDK00000000000004", 00:07:34.367 "model_number": "SPDK bdev Controller", 00:07:34.367 "max_namespaces": 32, 00:07:34.367 "min_cntlid": 1, 00:07:34.367 "max_cntlid": 65519, 00:07:34.367 "namespaces": [ 00:07:34.367 { 00:07:34.367 "nsid": 1, 00:07:34.367 "bdev_name": "Null4", 00:07:34.367 "name": "Null4", 00:07:34.367 "nguid": "D0EF6361C0C84C579E404D1F9D482362", 00:07:34.367 "uuid": "d0ef6361-c0c8-4c57-9e40-4d1f9d482362" 00:07:34.367 } 00:07:34.367 ] 00:07:34.367 } 00:07:34.367 ] 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@42 -- # seq 1 4 00:07:34.367 04:14:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.367 04:14:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.367 04:14:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.367 04:14:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.367 04:14:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.367 04:14:11 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:34.367 04:14:11 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:34.367 04:14:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.367 04:14:11 -- common/autotest_common.sh@10 -- # set +x 00:07:34.367 04:14:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.625 04:14:11 -- target/discovery.sh@49 -- # check_bdevs= 00:07:34.625 04:14:11 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:34.625 04:14:11 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:34.625 04:14:11 -- target/discovery.sh@57 -- # nvmftestfini 00:07:34.625 04:14:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:34.625 04:14:11 -- nvmf/common.sh@116 -- # sync 00:07:34.625 04:14:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:34.625 04:14:11 -- nvmf/common.sh@119 -- # set +e 00:07:34.625 04:14:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:34.625 04:14:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:34.625 rmmod nvme_tcp 00:07:34.625 rmmod nvme_fabrics 00:07:34.625 rmmod nvme_keyring 00:07:34.625 04:14:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:34.625 04:14:11 -- nvmf/common.sh@123 -- # set -e 00:07:34.625 04:14:11 -- nvmf/common.sh@124 -- # return 0 00:07:34.625 04:14:11 -- nvmf/common.sh@477 -- # '[' -n 3802884 ']' 00:07:34.625 04:14:11 -- nvmf/common.sh@478 -- # killprocess 3802884 00:07:34.625 04:14:11 -- common/autotest_common.sh@936 -- # '[' -z 3802884 ']' 00:07:34.625 04:14:11 -- common/autotest_common.sh@940 -- # kill -0 3802884 00:07:34.625 04:14:11 -- common/autotest_common.sh@941 -- # uname 00:07:34.625 04:14:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:34.626 04:14:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3802884 00:07:34.626 04:14:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:34.626 04:14:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:34.626 04:14:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3802884' 00:07:34.626 killing process with pid 3802884 00:07:34.626 04:14:11 -- common/autotest_common.sh@955 -- # kill 3802884 00:07:34.626 [2024-11-28 04:14:11.800670] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:34.626 04:14:11 -- common/autotest_common.sh@960 -- # wait 3802884 00:07:34.884 04:14:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:34.884 04:14:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:34.884 04:14:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:34.884 04:14:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:34.884 04:14:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:34.884 04:14:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:34.884 04:14:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:34.884 04:14:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:37.422 04:14:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:37.422 00:07:37.422 real 0m6.512s 00:07:37.422 user 0m8.133s 00:07:37.422 sys 0m1.971s 00:07:37.422 04:14:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.422 04:14:14 -- common/autotest_common.sh@10 -- # set +x 00:07:37.422 ************************************ 00:07:37.422 END TEST nvmf_discovery 00:07:37.422 ************************************ 00:07:37.422 04:14:14 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:37.422 04:14:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:37.422 04:14:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.422 04:14:14 -- common/autotest_common.sh@10 -- # set +x 00:07:37.422 ************************************ 00:07:37.422 START TEST nvmf_referrals 00:07:37.422 ************************************ 00:07:37.422 04:14:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:37.422 * Looking for test storage... 00:07:37.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:37.422 04:14:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:37.422 04:14:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:37.422 04:14:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:37.422 04:14:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:37.422 04:14:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:37.422 04:14:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:37.422 04:14:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:37.422 04:14:14 -- scripts/common.sh@335 -- # IFS=.-: 00:07:37.422 04:14:14 -- scripts/common.sh@335 -- # read -ra ver1 00:07:37.422 04:14:14 -- scripts/common.sh@336 -- # IFS=.-: 00:07:37.422 04:14:14 -- scripts/common.sh@336 -- # read -ra ver2 00:07:37.422 04:14:14 -- scripts/common.sh@337 -- # local 'op=<' 00:07:37.422 04:14:14 -- scripts/common.sh@339 -- # ver1_l=2 00:07:37.422 04:14:14 -- scripts/common.sh@340 -- # ver2_l=1 00:07:37.422 04:14:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:37.422 04:14:14 -- scripts/common.sh@343 -- # case "$op" in 00:07:37.422 04:14:14 -- scripts/common.sh@344 -- # : 1 00:07:37.422 04:14:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:37.422 04:14:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:37.422 04:14:14 -- scripts/common.sh@364 -- # decimal 1 00:07:37.422 04:14:14 -- scripts/common.sh@352 -- # local d=1 00:07:37.422 04:14:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:37.422 04:14:14 -- scripts/common.sh@354 -- # echo 1 00:07:37.422 04:14:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:37.422 04:14:14 -- scripts/common.sh@365 -- # decimal 2 00:07:37.422 04:14:14 -- scripts/common.sh@352 -- # local d=2 00:07:37.422 04:14:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:37.422 04:14:14 -- scripts/common.sh@354 -- # echo 2 00:07:37.422 04:14:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:37.422 04:14:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:37.422 04:14:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:37.422 04:14:14 -- scripts/common.sh@367 -- # return 0 00:07:37.422 04:14:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:37.422 04:14:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:37.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.422 --rc genhtml_branch_coverage=1 00:07:37.422 --rc genhtml_function_coverage=1 00:07:37.422 --rc genhtml_legend=1 00:07:37.422 --rc geninfo_all_blocks=1 00:07:37.422 --rc geninfo_unexecuted_blocks=1 00:07:37.422 00:07:37.422 ' 00:07:37.422 04:14:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:37.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.422 --rc genhtml_branch_coverage=1 00:07:37.422 --rc genhtml_function_coverage=1 00:07:37.422 --rc genhtml_legend=1 00:07:37.422 --rc geninfo_all_blocks=1 00:07:37.422 --rc geninfo_unexecuted_blocks=1 00:07:37.422 00:07:37.422 ' 00:07:37.422 04:14:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:37.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.422 --rc genhtml_branch_coverage=1 00:07:37.422 --rc genhtml_function_coverage=1 00:07:37.422 --rc genhtml_legend=1 00:07:37.422 --rc geninfo_all_blocks=1 00:07:37.422 --rc geninfo_unexecuted_blocks=1 00:07:37.422 00:07:37.422 ' 00:07:37.422 04:14:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:37.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.422 --rc genhtml_branch_coverage=1 00:07:37.422 --rc genhtml_function_coverage=1 00:07:37.422 --rc genhtml_legend=1 00:07:37.422 --rc geninfo_all_blocks=1 00:07:37.422 --rc geninfo_unexecuted_blocks=1 00:07:37.422 00:07:37.422 ' 00:07:37.422 04:14:14 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:37.422 04:14:14 -- nvmf/common.sh@7 -- # uname -s 00:07:37.422 04:14:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:37.422 04:14:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:37.422 04:14:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:37.422 04:14:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:37.422 04:14:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:37.422 04:14:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:37.422 04:14:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:37.422 04:14:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:37.422 04:14:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:37.422 04:14:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:37.422 04:14:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:37.422 04:14:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:37.422 04:14:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:37.422 04:14:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:37.422 04:14:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:37.422 04:14:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:37.422 04:14:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:37.422 04:14:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:37.422 04:14:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:37.422 04:14:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.422 04:14:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.422 04:14:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.422 04:14:14 -- paths/export.sh@5 -- # export PATH 00:07:37.422 04:14:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.422 04:14:14 -- nvmf/common.sh@46 -- # : 0 00:07:37.422 04:14:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:37.422 04:14:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:37.422 04:14:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:37.422 04:14:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:37.422 04:14:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:37.422 04:14:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:37.422 04:14:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:37.422 04:14:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:37.422 04:14:14 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:37.422 04:14:14 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:37.422 04:14:14 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:37.422 04:14:14 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:37.422 04:14:14 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:37.422 04:14:14 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:37.422 04:14:14 -- target/referrals.sh@37 -- # nvmftestinit 00:07:37.422 04:14:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:37.422 04:14:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:37.423 04:14:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:37.423 04:14:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:37.423 04:14:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:37.423 04:14:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:37.423 04:14:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:37.423 04:14:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:37.423 04:14:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:37.423 04:14:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:37.423 04:14:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:37.423 04:14:14 -- common/autotest_common.sh@10 -- # set +x 00:07:39.321 04:14:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:39.321 04:14:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:39.321 04:14:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:39.321 04:14:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:39.321 04:14:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:39.322 04:14:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:39.322 04:14:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:39.322 04:14:16 -- nvmf/common.sh@294 -- # net_devs=() 00:07:39.322 04:14:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:39.322 04:14:16 -- nvmf/common.sh@295 -- # e810=() 00:07:39.322 04:14:16 -- nvmf/common.sh@295 -- # local -ga e810 00:07:39.322 04:14:16 -- nvmf/common.sh@296 -- # x722=() 00:07:39.322 04:14:16 -- nvmf/common.sh@296 -- # local -ga x722 00:07:39.322 04:14:16 -- nvmf/common.sh@297 -- # mlx=() 00:07:39.322 04:14:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:39.322 04:14:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:39.322 04:14:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:39.322 04:14:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:39.322 04:14:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:39.322 04:14:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:39.322 04:14:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:39.322 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:39.322 04:14:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:39.322 04:14:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:39.322 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:39.322 04:14:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:39.322 04:14:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:39.322 04:14:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:39.322 04:14:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:39.322 04:14:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:39.322 04:14:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:39.322 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:39.322 04:14:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:39.322 04:14:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:39.322 04:14:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:39.322 04:14:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:39.322 04:14:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:39.322 04:14:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:39.322 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:39.322 04:14:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:39.322 04:14:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:39.322 04:14:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:39.322 04:14:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:39.322 04:14:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:39.322 04:14:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:39.322 04:14:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:39.322 04:14:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:39.322 04:14:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:39.322 04:14:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:39.322 04:14:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:39.322 04:14:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:39.322 04:14:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:39.322 04:14:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:39.322 04:14:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:39.322 04:14:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:39.322 04:14:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:39.322 04:14:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:39.322 04:14:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:39.322 04:14:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:39.322 04:14:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:39.322 04:14:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:39.322 04:14:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:39.322 04:14:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:39.322 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:39.322 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:07:39.322 00:07:39.322 --- 10.0.0.2 ping statistics --- 00:07:39.322 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:39.322 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:07:39.322 04:14:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:39.322 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:39.322 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:07:39.322 00:07:39.322 --- 10.0.0.1 ping statistics --- 00:07:39.322 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:39.322 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:07:39.322 04:14:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:39.322 04:14:16 -- nvmf/common.sh@410 -- # return 0 00:07:39.322 04:14:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:39.322 04:14:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:39.322 04:14:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:39.322 04:14:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:39.322 04:14:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:39.322 04:14:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:39.322 04:14:16 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:39.322 04:14:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:39.322 04:14:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:39.322 04:14:16 -- common/autotest_common.sh@10 -- # set +x 00:07:39.322 04:14:16 -- nvmf/common.sh@469 -- # nvmfpid=3805005 00:07:39.322 04:14:16 -- nvmf/common.sh@470 -- # waitforlisten 3805005 00:07:39.322 04:14:16 -- common/autotest_common.sh@829 -- # '[' -z 3805005 ']' 00:07:39.322 04:14:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:39.322 04:14:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:39.322 04:14:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:39.322 04:14:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:39.322 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:39.322 04:14:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:39.322 04:14:16 -- common/autotest_common.sh@10 -- # set +x 00:07:39.322 [2024-11-28 04:14:16.506123] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:39.322 [2024-11-28 04:14:16.506208] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:39.322 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.322 [2024-11-28 04:14:16.575112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:39.580 [2024-11-28 04:14:16.697211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:39.580 [2024-11-28 04:14:16.697362] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:39.580 [2024-11-28 04:14:16.697382] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:39.580 [2024-11-28 04:14:16.697396] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:39.580 [2024-11-28 04:14:16.697477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:39.580 [2024-11-28 04:14:16.697551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:39.580 [2024-11-28 04:14:16.697582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:39.580 [2024-11-28 04:14:16.697585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.515 04:14:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:40.515 04:14:17 -- common/autotest_common.sh@862 -- # return 0 00:07:40.515 04:14:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:40.515 04:14:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 04:14:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:40.515 04:14:17 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:40.515 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 [2024-11-28 04:14:17.555226] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:40.515 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:40.515 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 [2024-11-28 04:14:17.567432] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:40.515 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:40.515 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:40.515 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:40.515 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:40.515 04:14:17 -- target/referrals.sh@48 -- # jq length 00:07:40.515 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:40.515 04:14:17 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:40.515 04:14:17 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:40.515 04:14:17 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:40.515 04:14:17 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:40.515 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.515 04:14:17 -- target/referrals.sh@21 -- # sort 00:07:40.515 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.515 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:40.515 04:14:17 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:40.515 04:14:17 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:40.515 04:14:17 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:40.515 04:14:17 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:40.515 04:14:17 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:40.515 04:14:17 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:40.515 04:14:17 -- target/referrals.sh@26 -- # sort 00:07:40.773 04:14:17 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:40.773 04:14:17 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:40.773 04:14:17 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:40.773 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.773 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.773 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.773 04:14:17 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:40.773 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.773 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.773 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.773 04:14:17 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:40.773 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.773 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.773 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.773 04:14:17 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:40.773 04:14:17 -- target/referrals.sh@56 -- # jq length 00:07:40.773 04:14:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.773 04:14:17 -- common/autotest_common.sh@10 -- # set +x 00:07:40.773 04:14:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.773 04:14:17 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:40.773 04:14:17 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:40.773 04:14:17 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:40.773 04:14:17 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:40.773 04:14:17 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:40.773 04:14:17 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:40.773 04:14:17 -- target/referrals.sh@26 -- # sort 00:07:41.031 04:14:18 -- target/referrals.sh@26 -- # echo 00:07:41.031 04:14:18 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:41.031 04:14:18 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:41.031 04:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:41.031 04:14:18 -- common/autotest_common.sh@10 -- # set +x 00:07:41.031 04:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:41.031 04:14:18 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:41.031 04:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:41.031 04:14:18 -- common/autotest_common.sh@10 -- # set +x 00:07:41.031 04:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:41.031 04:14:18 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:41.031 04:14:18 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:41.031 04:14:18 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:41.031 04:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:41.031 04:14:18 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:41.031 04:14:18 -- common/autotest_common.sh@10 -- # set +x 00:07:41.031 04:14:18 -- target/referrals.sh@21 -- # sort 00:07:41.031 04:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:41.031 04:14:18 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:41.031 04:14:18 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:41.031 04:14:18 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:41.031 04:14:18 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:41.031 04:14:18 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:41.031 04:14:18 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:41.031 04:14:18 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:41.031 04:14:18 -- target/referrals.sh@26 -- # sort 00:07:41.289 04:14:18 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:41.289 04:14:18 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:41.289 04:14:18 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:41.289 04:14:18 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:41.289 04:14:18 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:41.289 04:14:18 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:41.289 04:14:18 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:41.289 04:14:18 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:41.289 04:14:18 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:41.289 04:14:18 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:41.289 04:14:18 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:41.289 04:14:18 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:41.289 04:14:18 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:41.548 04:14:18 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:41.548 04:14:18 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:41.548 04:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:41.548 04:14:18 -- common/autotest_common.sh@10 -- # set +x 00:07:41.548 04:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:41.548 04:14:18 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:41.548 04:14:18 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:41.548 04:14:18 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:41.548 04:14:18 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:41.548 04:14:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:41.548 04:14:18 -- common/autotest_common.sh@10 -- # set +x 00:07:41.548 04:14:18 -- target/referrals.sh@21 -- # sort 00:07:41.548 04:14:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:41.548 04:14:18 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:41.548 04:14:18 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:41.548 04:14:18 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:41.548 04:14:18 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:41.548 04:14:18 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:41.548 04:14:18 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:41.548 04:14:18 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:41.548 04:14:18 -- target/referrals.sh@26 -- # sort 00:07:41.806 04:14:18 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:41.806 04:14:18 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:41.806 04:14:18 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:41.806 04:14:18 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:41.806 04:14:18 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:41.806 04:14:18 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:41.806 04:14:18 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:42.065 04:14:19 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:42.065 04:14:19 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:42.065 04:14:19 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:42.065 04:14:19 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:42.065 04:14:19 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:42.065 04:14:19 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:42.065 04:14:19 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:42.065 04:14:19 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:42.065 04:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.065 04:14:19 -- common/autotest_common.sh@10 -- # set +x 00:07:42.065 04:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.065 04:14:19 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:42.065 04:14:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.065 04:14:19 -- target/referrals.sh@82 -- # jq length 00:07:42.065 04:14:19 -- common/autotest_common.sh@10 -- # set +x 00:07:42.065 04:14:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.065 04:14:19 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:42.065 04:14:19 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:42.065 04:14:19 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:42.065 04:14:19 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:42.065 04:14:19 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:42.065 04:14:19 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:42.065 04:14:19 -- target/referrals.sh@26 -- # sort 00:07:42.324 04:14:19 -- target/referrals.sh@26 -- # echo 00:07:42.324 04:14:19 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:42.324 04:14:19 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:42.324 04:14:19 -- target/referrals.sh@86 -- # nvmftestfini 00:07:42.324 04:14:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:42.324 04:14:19 -- nvmf/common.sh@116 -- # sync 00:07:42.324 04:14:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:42.324 04:14:19 -- nvmf/common.sh@119 -- # set +e 00:07:42.324 04:14:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:42.324 04:14:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:42.324 rmmod nvme_tcp 00:07:42.324 rmmod nvme_fabrics 00:07:42.324 rmmod nvme_keyring 00:07:42.324 04:14:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:42.324 04:14:19 -- nvmf/common.sh@123 -- # set -e 00:07:42.324 04:14:19 -- nvmf/common.sh@124 -- # return 0 00:07:42.324 04:14:19 -- nvmf/common.sh@477 -- # '[' -n 3805005 ']' 00:07:42.324 04:14:19 -- nvmf/common.sh@478 -- # killprocess 3805005 00:07:42.324 04:14:19 -- common/autotest_common.sh@936 -- # '[' -z 3805005 ']' 00:07:42.324 04:14:19 -- common/autotest_common.sh@940 -- # kill -0 3805005 00:07:42.324 04:14:19 -- common/autotest_common.sh@941 -- # uname 00:07:42.324 04:14:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:42.324 04:14:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3805005 00:07:42.324 04:14:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:42.324 04:14:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:42.324 04:14:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3805005' 00:07:42.324 killing process with pid 3805005 00:07:42.324 04:14:19 -- common/autotest_common.sh@955 -- # kill 3805005 00:07:42.324 04:14:19 -- common/autotest_common.sh@960 -- # wait 3805005 00:07:42.891 04:14:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:42.891 04:14:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:42.891 04:14:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:42.891 04:14:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:42.891 04:14:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:42.891 04:14:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:42.891 04:14:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:42.891 04:14:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.797 04:14:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:44.797 00:07:44.797 real 0m7.807s 00:07:44.797 user 0m14.472s 00:07:44.797 sys 0m2.200s 00:07:44.797 04:14:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.797 04:14:21 -- common/autotest_common.sh@10 -- # set +x 00:07:44.797 ************************************ 00:07:44.797 END TEST nvmf_referrals 00:07:44.797 ************************************ 00:07:44.797 04:14:21 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:44.797 04:14:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:44.797 04:14:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.797 04:14:21 -- common/autotest_common.sh@10 -- # set +x 00:07:44.797 ************************************ 00:07:44.797 START TEST nvmf_connect_disconnect 00:07:44.797 ************************************ 00:07:44.797 04:14:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:44.797 * Looking for test storage... 00:07:44.797 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:44.797 04:14:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:44.797 04:14:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:44.797 04:14:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:45.056 04:14:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:45.056 04:14:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:45.056 04:14:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:45.056 04:14:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:45.056 04:14:22 -- scripts/common.sh@335 -- # IFS=.-: 00:07:45.056 04:14:22 -- scripts/common.sh@335 -- # read -ra ver1 00:07:45.056 04:14:22 -- scripts/common.sh@336 -- # IFS=.-: 00:07:45.056 04:14:22 -- scripts/common.sh@336 -- # read -ra ver2 00:07:45.056 04:14:22 -- scripts/common.sh@337 -- # local 'op=<' 00:07:45.056 04:14:22 -- scripts/common.sh@339 -- # ver1_l=2 00:07:45.056 04:14:22 -- scripts/common.sh@340 -- # ver2_l=1 00:07:45.056 04:14:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:45.056 04:14:22 -- scripts/common.sh@343 -- # case "$op" in 00:07:45.056 04:14:22 -- scripts/common.sh@344 -- # : 1 00:07:45.056 04:14:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:45.056 04:14:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:45.056 04:14:22 -- scripts/common.sh@364 -- # decimal 1 00:07:45.056 04:14:22 -- scripts/common.sh@352 -- # local d=1 00:07:45.056 04:14:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:45.056 04:14:22 -- scripts/common.sh@354 -- # echo 1 00:07:45.056 04:14:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:45.056 04:14:22 -- scripts/common.sh@365 -- # decimal 2 00:07:45.056 04:14:22 -- scripts/common.sh@352 -- # local d=2 00:07:45.056 04:14:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:45.056 04:14:22 -- scripts/common.sh@354 -- # echo 2 00:07:45.056 04:14:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:45.056 04:14:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:45.056 04:14:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:45.056 04:14:22 -- scripts/common.sh@367 -- # return 0 00:07:45.056 04:14:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:45.056 04:14:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:45.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.056 --rc genhtml_branch_coverage=1 00:07:45.056 --rc genhtml_function_coverage=1 00:07:45.056 --rc genhtml_legend=1 00:07:45.056 --rc geninfo_all_blocks=1 00:07:45.056 --rc geninfo_unexecuted_blocks=1 00:07:45.056 00:07:45.056 ' 00:07:45.056 04:14:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:45.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.056 --rc genhtml_branch_coverage=1 00:07:45.056 --rc genhtml_function_coverage=1 00:07:45.056 --rc genhtml_legend=1 00:07:45.056 --rc geninfo_all_blocks=1 00:07:45.056 --rc geninfo_unexecuted_blocks=1 00:07:45.056 00:07:45.056 ' 00:07:45.056 04:14:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:45.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.056 --rc genhtml_branch_coverage=1 00:07:45.056 --rc genhtml_function_coverage=1 00:07:45.056 --rc genhtml_legend=1 00:07:45.056 --rc geninfo_all_blocks=1 00:07:45.056 --rc geninfo_unexecuted_blocks=1 00:07:45.056 00:07:45.056 ' 00:07:45.056 04:14:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:45.056 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:45.056 --rc genhtml_branch_coverage=1 00:07:45.056 --rc genhtml_function_coverage=1 00:07:45.056 --rc genhtml_legend=1 00:07:45.056 --rc geninfo_all_blocks=1 00:07:45.056 --rc geninfo_unexecuted_blocks=1 00:07:45.056 00:07:45.056 ' 00:07:45.056 04:14:22 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:45.056 04:14:22 -- nvmf/common.sh@7 -- # uname -s 00:07:45.056 04:14:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:45.056 04:14:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:45.056 04:14:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:45.056 04:14:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:45.056 04:14:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:45.056 04:14:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:45.056 04:14:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:45.056 04:14:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:45.056 04:14:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:45.056 04:14:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:45.056 04:14:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.056 04:14:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:45.056 04:14:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:45.056 04:14:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:45.056 04:14:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:45.056 04:14:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:45.057 04:14:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:45.057 04:14:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:45.057 04:14:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:45.057 04:14:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.057 04:14:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.057 04:14:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.057 04:14:22 -- paths/export.sh@5 -- # export PATH 00:07:45.057 04:14:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:45.057 04:14:22 -- nvmf/common.sh@46 -- # : 0 00:07:45.057 04:14:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:45.057 04:14:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:45.057 04:14:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:45.057 04:14:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:45.057 04:14:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:45.057 04:14:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:45.057 04:14:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:45.057 04:14:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:45.057 04:14:22 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:45.057 04:14:22 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:45.057 04:14:22 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:45.057 04:14:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:45.057 04:14:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:45.057 04:14:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:45.057 04:14:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:45.057 04:14:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:45.057 04:14:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:45.057 04:14:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:45.057 04:14:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:45.057 04:14:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:45.057 04:14:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:45.057 04:14:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:45.057 04:14:22 -- common/autotest_common.sh@10 -- # set +x 00:07:46.963 04:14:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:46.963 04:14:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:46.963 04:14:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:46.963 04:14:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:46.963 04:14:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:46.963 04:14:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:46.963 04:14:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:46.963 04:14:24 -- nvmf/common.sh@294 -- # net_devs=() 00:07:46.963 04:14:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:46.963 04:14:24 -- nvmf/common.sh@295 -- # e810=() 00:07:46.963 04:14:24 -- nvmf/common.sh@295 -- # local -ga e810 00:07:46.963 04:14:24 -- nvmf/common.sh@296 -- # x722=() 00:07:46.963 04:14:24 -- nvmf/common.sh@296 -- # local -ga x722 00:07:46.963 04:14:24 -- nvmf/common.sh@297 -- # mlx=() 00:07:46.963 04:14:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:46.963 04:14:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:46.963 04:14:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:46.964 04:14:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:46.964 04:14:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:46.964 04:14:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:46.964 04:14:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:46.964 04:14:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:46.964 04:14:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:46.964 04:14:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:46.964 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:46.964 04:14:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:46.964 04:14:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:46.964 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:46.964 04:14:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:46.964 04:14:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:46.964 04:14:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:46.964 04:14:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:46.964 04:14:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:46.964 04:14:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:46.964 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:46.964 04:14:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:46.964 04:14:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:46.964 04:14:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:46.964 04:14:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:46.964 04:14:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:46.964 04:14:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:46.964 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:46.964 04:14:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:46.964 04:14:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:46.964 04:14:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:46.964 04:14:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:46.964 04:14:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:46.964 04:14:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:46.964 04:14:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:46.964 04:14:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:46.964 04:14:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:46.964 04:14:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:46.964 04:14:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:46.964 04:14:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:46.964 04:14:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:46.964 04:14:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:46.964 04:14:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:46.964 04:14:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:46.964 04:14:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:46.964 04:14:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:47.223 04:14:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:47.223 04:14:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:47.223 04:14:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:47.223 04:14:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:47.223 04:14:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:47.223 04:14:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:47.223 04:14:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:47.223 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:47.223 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:07:47.223 00:07:47.223 --- 10.0.0.2 ping statistics --- 00:07:47.223 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.223 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:07:47.223 04:14:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:47.223 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:47.223 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:07:47.223 00:07:47.223 --- 10.0.0.1 ping statistics --- 00:07:47.223 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.223 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:07:47.223 04:14:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:47.223 04:14:24 -- nvmf/common.sh@410 -- # return 0 00:07:47.223 04:14:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:47.223 04:14:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:47.223 04:14:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:47.223 04:14:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:47.223 04:14:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:47.223 04:14:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:47.223 04:14:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:47.223 04:14:24 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:47.223 04:14:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:47.223 04:14:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:47.223 04:14:24 -- common/autotest_common.sh@10 -- # set +x 00:07:47.223 04:14:24 -- nvmf/common.sh@469 -- # nvmfpid=3807464 00:07:47.223 04:14:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:47.223 04:14:24 -- nvmf/common.sh@470 -- # waitforlisten 3807464 00:07:47.223 04:14:24 -- common/autotest_common.sh@829 -- # '[' -z 3807464 ']' 00:07:47.223 04:14:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.223 04:14:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:47.223 04:14:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.223 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.223 04:14:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:47.223 04:14:24 -- common/autotest_common.sh@10 -- # set +x 00:07:47.223 [2024-11-28 04:14:24.431424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.223 [2024-11-28 04:14:24.431492] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:47.223 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.223 [2024-11-28 04:14:24.498020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:47.482 [2024-11-28 04:14:24.622197] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:47.482 [2024-11-28 04:14:24.622361] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:47.482 [2024-11-28 04:14:24.622381] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:47.482 [2024-11-28 04:14:24.622395] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:47.482 [2024-11-28 04:14:24.622496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.482 [2024-11-28 04:14:24.622555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.482 [2024-11-28 04:14:24.622585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:47.482 [2024-11-28 04:14:24.622589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.412 04:14:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.412 04:14:25 -- common/autotest_common.sh@862 -- # return 0 00:07:48.412 04:14:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:48.412 04:14:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:48.412 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.412 04:14:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:48.412 04:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.412 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.412 [2024-11-28 04:14:25.500335] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:48.412 04:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:48.412 04:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.412 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.412 04:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:48.412 04:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.412 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.412 04:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:48.412 04:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.412 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.412 04:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:48.412 04:14:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.412 04:14:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.412 [2024-11-28 04:14:25.551694] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:48.412 04:14:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:48.412 04:14:25 -- target/connect_disconnect.sh@34 -- # set +x 00:07:50.938 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.361 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.410 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.309 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.336 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.864 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.908 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.815 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.237 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.197 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.806 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.178 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.620 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.046 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.571 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.992 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.516 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.937 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.495 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.916 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.341 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.867 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.393 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.816 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.343 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.870 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.767 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.819 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.344 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.282 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.838 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.736 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.788 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.737 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.637 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.690 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.217 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.639 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.163 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.636 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.581 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.109 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.606 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.138 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.036 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.565 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.416 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.944 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.843 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.371 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.855 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.309 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.208 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.735 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.163 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.117 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.117 04:18:17 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:40.117 04:18:17 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:40.117 04:18:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:40.117 04:18:17 -- nvmf/common.sh@116 -- # sync 00:11:40.117 04:18:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:40.117 04:18:17 -- nvmf/common.sh@119 -- # set +e 00:11:40.117 04:18:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:40.117 04:18:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:40.117 rmmod nvme_tcp 00:11:40.117 rmmod nvme_fabrics 00:11:40.117 rmmod nvme_keyring 00:11:40.117 04:18:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:40.117 04:18:17 -- nvmf/common.sh@123 -- # set -e 00:11:40.117 04:18:17 -- nvmf/common.sh@124 -- # return 0 00:11:40.117 04:18:17 -- nvmf/common.sh@477 -- # '[' -n 3807464 ']' 00:11:40.117 04:18:17 -- nvmf/common.sh@478 -- # killprocess 3807464 00:11:40.117 04:18:17 -- common/autotest_common.sh@936 -- # '[' -z 3807464 ']' 00:11:40.117 04:18:17 -- common/autotest_common.sh@940 -- # kill -0 3807464 00:11:40.117 04:18:17 -- common/autotest_common.sh@941 -- # uname 00:11:40.117 04:18:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:40.117 04:18:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3807464 00:11:40.117 04:18:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:40.117 04:18:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:40.117 04:18:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3807464' 00:11:40.117 killing process with pid 3807464 00:11:40.117 04:18:17 -- common/autotest_common.sh@955 -- # kill 3807464 00:11:40.117 04:18:17 -- common/autotest_common.sh@960 -- # wait 3807464 00:11:40.375 04:18:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:40.375 04:18:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:40.375 04:18:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:40.375 04:18:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:40.375 04:18:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:40.375 04:18:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:40.376 04:18:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:40.376 04:18:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:42.282 04:18:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:42.542 00:11:42.542 real 3m57.603s 00:11:42.542 user 15m7.385s 00:11:42.542 sys 0m33.462s 00:11:42.542 04:18:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:42.542 04:18:19 -- common/autotest_common.sh@10 -- # set +x 00:11:42.542 ************************************ 00:11:42.542 END TEST nvmf_connect_disconnect 00:11:42.542 ************************************ 00:11:42.542 04:18:19 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:42.543 04:18:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:42.543 04:18:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:42.543 04:18:19 -- common/autotest_common.sh@10 -- # set +x 00:11:42.543 ************************************ 00:11:42.543 START TEST nvmf_multitarget 00:11:42.543 ************************************ 00:11:42.543 04:18:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:42.543 * Looking for test storage... 00:11:42.543 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:42.543 04:18:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:42.543 04:18:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:42.543 04:18:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:42.543 04:18:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:42.543 04:18:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:42.543 04:18:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:42.543 04:18:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:42.543 04:18:19 -- scripts/common.sh@335 -- # IFS=.-: 00:11:42.543 04:18:19 -- scripts/common.sh@335 -- # read -ra ver1 00:11:42.543 04:18:19 -- scripts/common.sh@336 -- # IFS=.-: 00:11:42.543 04:18:19 -- scripts/common.sh@336 -- # read -ra ver2 00:11:42.543 04:18:19 -- scripts/common.sh@337 -- # local 'op=<' 00:11:42.543 04:18:19 -- scripts/common.sh@339 -- # ver1_l=2 00:11:42.543 04:18:19 -- scripts/common.sh@340 -- # ver2_l=1 00:11:42.543 04:18:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:42.543 04:18:19 -- scripts/common.sh@343 -- # case "$op" in 00:11:42.543 04:18:19 -- scripts/common.sh@344 -- # : 1 00:11:42.543 04:18:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:42.543 04:18:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:42.543 04:18:19 -- scripts/common.sh@364 -- # decimal 1 00:11:42.543 04:18:19 -- scripts/common.sh@352 -- # local d=1 00:11:42.543 04:18:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:42.543 04:18:19 -- scripts/common.sh@354 -- # echo 1 00:11:42.543 04:18:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:42.543 04:18:19 -- scripts/common.sh@365 -- # decimal 2 00:11:42.543 04:18:19 -- scripts/common.sh@352 -- # local d=2 00:11:42.543 04:18:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:42.543 04:18:19 -- scripts/common.sh@354 -- # echo 2 00:11:42.543 04:18:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:42.543 04:18:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:42.543 04:18:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:42.543 04:18:19 -- scripts/common.sh@367 -- # return 0 00:11:42.543 04:18:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:42.543 04:18:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:42.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.543 --rc genhtml_branch_coverage=1 00:11:42.543 --rc genhtml_function_coverage=1 00:11:42.543 --rc genhtml_legend=1 00:11:42.543 --rc geninfo_all_blocks=1 00:11:42.543 --rc geninfo_unexecuted_blocks=1 00:11:42.543 00:11:42.543 ' 00:11:42.543 04:18:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:42.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.543 --rc genhtml_branch_coverage=1 00:11:42.543 --rc genhtml_function_coverage=1 00:11:42.543 --rc genhtml_legend=1 00:11:42.543 --rc geninfo_all_blocks=1 00:11:42.543 --rc geninfo_unexecuted_blocks=1 00:11:42.543 00:11:42.543 ' 00:11:42.543 04:18:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:42.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.543 --rc genhtml_branch_coverage=1 00:11:42.543 --rc genhtml_function_coverage=1 00:11:42.543 --rc genhtml_legend=1 00:11:42.543 --rc geninfo_all_blocks=1 00:11:42.543 --rc geninfo_unexecuted_blocks=1 00:11:42.543 00:11:42.543 ' 00:11:42.543 04:18:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:42.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:42.543 --rc genhtml_branch_coverage=1 00:11:42.543 --rc genhtml_function_coverage=1 00:11:42.543 --rc genhtml_legend=1 00:11:42.543 --rc geninfo_all_blocks=1 00:11:42.543 --rc geninfo_unexecuted_blocks=1 00:11:42.543 00:11:42.543 ' 00:11:42.543 04:18:19 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:42.543 04:18:19 -- nvmf/common.sh@7 -- # uname -s 00:11:42.543 04:18:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:42.543 04:18:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:42.543 04:18:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:42.543 04:18:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:42.543 04:18:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:42.543 04:18:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:42.543 04:18:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:42.543 04:18:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:42.543 04:18:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:42.543 04:18:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:42.543 04:18:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:42.543 04:18:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:42.543 04:18:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:42.543 04:18:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:42.543 04:18:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:42.543 04:18:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:42.543 04:18:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:42.543 04:18:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:42.543 04:18:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:42.543 04:18:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.543 04:18:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.543 04:18:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.543 04:18:19 -- paths/export.sh@5 -- # export PATH 00:11:42.543 04:18:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:42.543 04:18:19 -- nvmf/common.sh@46 -- # : 0 00:11:42.543 04:18:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:42.543 04:18:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:42.543 04:18:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:42.543 04:18:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:42.543 04:18:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:42.543 04:18:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:42.543 04:18:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:42.543 04:18:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:42.543 04:18:19 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:42.543 04:18:19 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:42.543 04:18:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:42.543 04:18:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:42.543 04:18:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:42.543 04:18:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:42.543 04:18:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:42.543 04:18:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:42.543 04:18:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:42.543 04:18:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:42.543 04:18:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:42.543 04:18:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:42.543 04:18:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:42.543 04:18:19 -- common/autotest_common.sh@10 -- # set +x 00:11:45.079 04:18:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:45.079 04:18:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:45.079 04:18:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:45.079 04:18:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:45.079 04:18:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:45.079 04:18:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:45.079 04:18:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:45.079 04:18:21 -- nvmf/common.sh@294 -- # net_devs=() 00:11:45.079 04:18:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:45.079 04:18:21 -- nvmf/common.sh@295 -- # e810=() 00:11:45.079 04:18:21 -- nvmf/common.sh@295 -- # local -ga e810 00:11:45.079 04:18:21 -- nvmf/common.sh@296 -- # x722=() 00:11:45.079 04:18:21 -- nvmf/common.sh@296 -- # local -ga x722 00:11:45.079 04:18:21 -- nvmf/common.sh@297 -- # mlx=() 00:11:45.079 04:18:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:45.079 04:18:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:45.079 04:18:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:45.079 04:18:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:45.079 04:18:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:45.079 04:18:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:45.079 04:18:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:45.079 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:45.079 04:18:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:45.079 04:18:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:45.079 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:45.079 04:18:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:45.079 04:18:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:45.079 04:18:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.079 04:18:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:45.079 04:18:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.079 04:18:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:45.079 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:45.079 04:18:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.079 04:18:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:45.079 04:18:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.079 04:18:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:45.079 04:18:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.079 04:18:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:45.079 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:45.079 04:18:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.079 04:18:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:45.079 04:18:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:45.079 04:18:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:45.079 04:18:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:45.079 04:18:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:45.079 04:18:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:45.079 04:18:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:45.079 04:18:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:45.079 04:18:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:45.079 04:18:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:45.079 04:18:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:45.079 04:18:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:45.079 04:18:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:45.079 04:18:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:45.079 04:18:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:45.079 04:18:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:45.079 04:18:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:45.079 04:18:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:45.079 04:18:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:45.079 04:18:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:45.079 04:18:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:45.079 04:18:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:45.079 04:18:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:45.079 04:18:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:45.079 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:45.079 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:11:45.079 00:11:45.079 --- 10.0.0.2 ping statistics --- 00:11:45.079 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.079 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:11:45.079 04:18:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:45.079 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:45.079 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:11:45.079 00:11:45.079 --- 10.0.0.1 ping statistics --- 00:11:45.079 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.079 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:11:45.080 04:18:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:45.080 04:18:21 -- nvmf/common.sh@410 -- # return 0 00:11:45.080 04:18:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:45.080 04:18:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:45.080 04:18:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:45.080 04:18:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:45.080 04:18:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:45.080 04:18:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:45.080 04:18:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:45.080 04:18:21 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:45.080 04:18:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:45.080 04:18:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:45.080 04:18:21 -- common/autotest_common.sh@10 -- # set +x 00:11:45.080 04:18:21 -- nvmf/common.sh@469 -- # nvmfpid=3840210 00:11:45.080 04:18:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:45.080 04:18:21 -- nvmf/common.sh@470 -- # waitforlisten 3840210 00:11:45.080 04:18:21 -- common/autotest_common.sh@829 -- # '[' -z 3840210 ']' 00:11:45.080 04:18:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:45.080 04:18:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:45.080 04:18:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:45.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:45.080 04:18:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:45.080 04:18:21 -- common/autotest_common.sh@10 -- # set +x 00:11:45.080 [2024-11-28 04:18:21.981774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:45.080 [2024-11-28 04:18:21.981860] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:45.080 EAL: No free 2048 kB hugepages reported on node 1 00:11:45.080 [2024-11-28 04:18:22.053029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:45.080 [2024-11-28 04:18:22.178189] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:45.080 [2024-11-28 04:18:22.178354] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:45.080 [2024-11-28 04:18:22.178375] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:45.080 [2024-11-28 04:18:22.178390] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:45.080 [2024-11-28 04:18:22.178459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:45.080 [2024-11-28 04:18:22.178522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:45.080 [2024-11-28 04:18:22.178579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:45.080 [2024-11-28 04:18:22.178583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:46.013 04:18:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:46.013 04:18:23 -- common/autotest_common.sh@862 -- # return 0 00:11:46.013 04:18:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:46.013 04:18:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:46.013 04:18:23 -- common/autotest_common.sh@10 -- # set +x 00:11:46.013 04:18:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:46.013 04:18:23 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:46.013 04:18:23 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:46.013 04:18:23 -- target/multitarget.sh@21 -- # jq length 00:11:46.013 04:18:23 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:46.013 04:18:23 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:46.013 "nvmf_tgt_1" 00:11:46.013 04:18:23 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:46.271 "nvmf_tgt_2" 00:11:46.271 04:18:23 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:46.271 04:18:23 -- target/multitarget.sh@28 -- # jq length 00:11:46.271 04:18:23 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:46.271 04:18:23 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:46.528 true 00:11:46.528 04:18:23 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:46.528 true 00:11:46.528 04:18:23 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:46.528 04:18:23 -- target/multitarget.sh@35 -- # jq length 00:11:46.786 04:18:23 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:46.786 04:18:23 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:46.786 04:18:23 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:46.786 04:18:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:46.786 04:18:23 -- nvmf/common.sh@116 -- # sync 00:11:46.786 04:18:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:46.786 04:18:23 -- nvmf/common.sh@119 -- # set +e 00:11:46.786 04:18:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:46.786 04:18:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:46.786 rmmod nvme_tcp 00:11:46.786 rmmod nvme_fabrics 00:11:46.786 rmmod nvme_keyring 00:11:46.786 04:18:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:46.786 04:18:23 -- nvmf/common.sh@123 -- # set -e 00:11:46.786 04:18:23 -- nvmf/common.sh@124 -- # return 0 00:11:46.786 04:18:23 -- nvmf/common.sh@477 -- # '[' -n 3840210 ']' 00:11:46.786 04:18:23 -- nvmf/common.sh@478 -- # killprocess 3840210 00:11:46.786 04:18:23 -- common/autotest_common.sh@936 -- # '[' -z 3840210 ']' 00:11:46.786 04:18:23 -- common/autotest_common.sh@940 -- # kill -0 3840210 00:11:46.786 04:18:23 -- common/autotest_common.sh@941 -- # uname 00:11:46.786 04:18:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:46.786 04:18:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3840210 00:11:46.786 04:18:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:46.786 04:18:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:46.786 04:18:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3840210' 00:11:46.786 killing process with pid 3840210 00:11:46.786 04:18:23 -- common/autotest_common.sh@955 -- # kill 3840210 00:11:46.786 04:18:23 -- common/autotest_common.sh@960 -- # wait 3840210 00:11:47.046 04:18:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:47.046 04:18:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:47.046 04:18:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:47.046 04:18:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:47.046 04:18:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:47.046 04:18:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:47.046 04:18:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:47.046 04:18:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:49.586 04:18:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:49.586 00:11:49.586 real 0m6.673s 00:11:49.586 user 0m9.989s 00:11:49.586 sys 0m2.004s 00:11:49.586 04:18:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:49.586 04:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:49.586 ************************************ 00:11:49.586 END TEST nvmf_multitarget 00:11:49.586 ************************************ 00:11:49.586 04:18:26 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:49.586 04:18:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:49.586 04:18:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:49.586 04:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:49.586 ************************************ 00:11:49.586 START TEST nvmf_rpc 00:11:49.586 ************************************ 00:11:49.586 04:18:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:49.586 * Looking for test storage... 00:11:49.586 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:49.586 04:18:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:49.586 04:18:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:49.586 04:18:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:49.586 04:18:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:49.586 04:18:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:49.586 04:18:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:49.586 04:18:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:49.586 04:18:26 -- scripts/common.sh@335 -- # IFS=.-: 00:11:49.586 04:18:26 -- scripts/common.sh@335 -- # read -ra ver1 00:11:49.586 04:18:26 -- scripts/common.sh@336 -- # IFS=.-: 00:11:49.586 04:18:26 -- scripts/common.sh@336 -- # read -ra ver2 00:11:49.586 04:18:26 -- scripts/common.sh@337 -- # local 'op=<' 00:11:49.586 04:18:26 -- scripts/common.sh@339 -- # ver1_l=2 00:11:49.586 04:18:26 -- scripts/common.sh@340 -- # ver2_l=1 00:11:49.586 04:18:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:49.586 04:18:26 -- scripts/common.sh@343 -- # case "$op" in 00:11:49.586 04:18:26 -- scripts/common.sh@344 -- # : 1 00:11:49.586 04:18:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:49.586 04:18:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:49.586 04:18:26 -- scripts/common.sh@364 -- # decimal 1 00:11:49.586 04:18:26 -- scripts/common.sh@352 -- # local d=1 00:11:49.586 04:18:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:49.586 04:18:26 -- scripts/common.sh@354 -- # echo 1 00:11:49.586 04:18:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:49.586 04:18:26 -- scripts/common.sh@365 -- # decimal 2 00:11:49.586 04:18:26 -- scripts/common.sh@352 -- # local d=2 00:11:49.586 04:18:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:49.586 04:18:26 -- scripts/common.sh@354 -- # echo 2 00:11:49.586 04:18:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:49.586 04:18:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:49.586 04:18:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:49.586 04:18:26 -- scripts/common.sh@367 -- # return 0 00:11:49.586 04:18:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:49.586 04:18:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:49.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.586 --rc genhtml_branch_coverage=1 00:11:49.586 --rc genhtml_function_coverage=1 00:11:49.586 --rc genhtml_legend=1 00:11:49.586 --rc geninfo_all_blocks=1 00:11:49.586 --rc geninfo_unexecuted_blocks=1 00:11:49.586 00:11:49.586 ' 00:11:49.586 04:18:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:49.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.586 --rc genhtml_branch_coverage=1 00:11:49.586 --rc genhtml_function_coverage=1 00:11:49.586 --rc genhtml_legend=1 00:11:49.586 --rc geninfo_all_blocks=1 00:11:49.586 --rc geninfo_unexecuted_blocks=1 00:11:49.586 00:11:49.586 ' 00:11:49.586 04:18:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:49.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.586 --rc genhtml_branch_coverage=1 00:11:49.586 --rc genhtml_function_coverage=1 00:11:49.586 --rc genhtml_legend=1 00:11:49.586 --rc geninfo_all_blocks=1 00:11:49.586 --rc geninfo_unexecuted_blocks=1 00:11:49.586 00:11:49.586 ' 00:11:49.586 04:18:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:49.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:49.587 --rc genhtml_branch_coverage=1 00:11:49.587 --rc genhtml_function_coverage=1 00:11:49.587 --rc genhtml_legend=1 00:11:49.587 --rc geninfo_all_blocks=1 00:11:49.587 --rc geninfo_unexecuted_blocks=1 00:11:49.587 00:11:49.587 ' 00:11:49.587 04:18:26 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:49.587 04:18:26 -- nvmf/common.sh@7 -- # uname -s 00:11:49.587 04:18:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:49.587 04:18:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:49.587 04:18:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:49.587 04:18:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:49.587 04:18:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:49.587 04:18:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:49.587 04:18:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:49.587 04:18:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:49.587 04:18:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:49.587 04:18:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:49.587 04:18:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.587 04:18:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.587 04:18:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:49.587 04:18:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:49.587 04:18:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:49.587 04:18:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:49.587 04:18:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:49.587 04:18:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:49.587 04:18:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:49.587 04:18:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.587 04:18:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.587 04:18:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.587 04:18:26 -- paths/export.sh@5 -- # export PATH 00:11:49.587 04:18:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:49.587 04:18:26 -- nvmf/common.sh@46 -- # : 0 00:11:49.587 04:18:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:49.587 04:18:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:49.587 04:18:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:49.587 04:18:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:49.587 04:18:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:49.587 04:18:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:49.587 04:18:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:49.587 04:18:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:49.587 04:18:26 -- target/rpc.sh@11 -- # loops=5 00:11:49.587 04:18:26 -- target/rpc.sh@23 -- # nvmftestinit 00:11:49.587 04:18:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:49.587 04:18:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:49.587 04:18:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:49.587 04:18:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:49.587 04:18:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:49.587 04:18:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.587 04:18:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.587 04:18:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:49.587 04:18:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:49.587 04:18:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:49.587 04:18:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:49.587 04:18:26 -- common/autotest_common.sh@10 -- # set +x 00:11:51.491 04:18:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:51.492 04:18:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:51.492 04:18:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:51.492 04:18:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:51.492 04:18:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:51.492 04:18:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:51.492 04:18:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:51.492 04:18:28 -- nvmf/common.sh@294 -- # net_devs=() 00:11:51.492 04:18:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:51.492 04:18:28 -- nvmf/common.sh@295 -- # e810=() 00:11:51.492 04:18:28 -- nvmf/common.sh@295 -- # local -ga e810 00:11:51.492 04:18:28 -- nvmf/common.sh@296 -- # x722=() 00:11:51.492 04:18:28 -- nvmf/common.sh@296 -- # local -ga x722 00:11:51.492 04:18:28 -- nvmf/common.sh@297 -- # mlx=() 00:11:51.492 04:18:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:51.492 04:18:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:51.492 04:18:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:51.492 04:18:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:51.492 04:18:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:51.492 04:18:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:51.492 04:18:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:51.492 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:51.492 04:18:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:51.492 04:18:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:51.492 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:51.492 04:18:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:51.492 04:18:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:51.492 04:18:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:51.492 04:18:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:51.492 04:18:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:51.492 04:18:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:51.492 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:51.492 04:18:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:51.492 04:18:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:51.492 04:18:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:51.492 04:18:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:51.492 04:18:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:51.492 04:18:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:51.492 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:51.492 04:18:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:51.492 04:18:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:51.492 04:18:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:51.492 04:18:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:51.492 04:18:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:51.492 04:18:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:51.492 04:18:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:51.492 04:18:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:51.492 04:18:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:51.492 04:18:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:51.492 04:18:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:51.492 04:18:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:51.492 04:18:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:51.492 04:18:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:51.492 04:18:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:51.492 04:18:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:51.492 04:18:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:51.492 04:18:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:51.492 04:18:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:51.492 04:18:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:51.492 04:18:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:51.492 04:18:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:51.492 04:18:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:51.492 04:18:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:51.492 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:51.492 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:11:51.492 00:11:51.492 --- 10.0.0.2 ping statistics --- 00:11:51.492 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:51.492 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:11:51.492 04:18:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:51.492 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:51.492 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:11:51.492 00:11:51.492 --- 10.0.0.1 ping statistics --- 00:11:51.492 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:51.492 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:11:51.492 04:18:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:51.492 04:18:28 -- nvmf/common.sh@410 -- # return 0 00:11:51.492 04:18:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:51.492 04:18:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:51.492 04:18:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:51.492 04:18:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:51.492 04:18:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:51.492 04:18:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:51.492 04:18:28 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:51.492 04:18:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:51.493 04:18:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:51.493 04:18:28 -- common/autotest_common.sh@10 -- # set +x 00:11:51.753 04:18:28 -- nvmf/common.sh@469 -- # nvmfpid=3842480 00:11:51.753 04:18:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:51.753 04:18:28 -- nvmf/common.sh@470 -- # waitforlisten 3842480 00:11:51.753 04:18:28 -- common/autotest_common.sh@829 -- # '[' -z 3842480 ']' 00:11:51.753 04:18:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:51.753 04:18:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:51.753 04:18:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:51.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:51.753 04:18:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:51.753 04:18:28 -- common/autotest_common.sh@10 -- # set +x 00:11:51.753 [2024-11-28 04:18:28.843452] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:51.753 [2024-11-28 04:18:28.843520] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:51.753 EAL: No free 2048 kB hugepages reported on node 1 00:11:51.753 [2024-11-28 04:18:28.906725] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:51.753 [2024-11-28 04:18:29.014636] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:51.753 [2024-11-28 04:18:29.014802] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:51.753 [2024-11-28 04:18:29.014822] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:51.753 [2024-11-28 04:18:29.014836] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:51.753 [2024-11-28 04:18:29.014900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:51.753 [2024-11-28 04:18:29.014953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:51.753 [2024-11-28 04:18:29.015008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:51.753 [2024-11-28 04:18:29.015011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:52.832 04:18:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:52.832 04:18:29 -- common/autotest_common.sh@862 -- # return 0 00:11:52.832 04:18:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:52.832 04:18:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:52.832 04:18:29 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 04:18:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:52.832 04:18:29 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:52.832 04:18:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:29 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 04:18:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.832 04:18:29 -- target/rpc.sh@26 -- # stats='{ 00:11:52.832 "tick_rate": 2700000000, 00:11:52.832 "poll_groups": [ 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_0", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [] 00:11:52.832 }, 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_1", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [] 00:11:52.832 }, 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_2", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [] 00:11:52.832 }, 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_3", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [] 00:11:52.832 } 00:11:52.832 ] 00:11:52.832 }' 00:11:52.832 04:18:29 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:52.832 04:18:29 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:52.832 04:18:29 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:52.832 04:18:29 -- target/rpc.sh@15 -- # wc -l 00:11:52.832 04:18:29 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:52.832 04:18:29 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:52.832 04:18:29 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:52.832 04:18:29 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:52.832 04:18:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:29 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 [2024-11-28 04:18:29.975522] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:52.832 04:18:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.832 04:18:29 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:52.832 04:18:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:29 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 04:18:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.832 04:18:29 -- target/rpc.sh@33 -- # stats='{ 00:11:52.832 "tick_rate": 2700000000, 00:11:52.832 "poll_groups": [ 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_0", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [ 00:11:52.832 { 00:11:52.832 "trtype": "TCP" 00:11:52.832 } 00:11:52.832 ] 00:11:52.832 }, 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_1", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [ 00:11:52.832 { 00:11:52.832 "trtype": "TCP" 00:11:52.832 } 00:11:52.832 ] 00:11:52.832 }, 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_2", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [ 00:11:52.832 { 00:11:52.832 "trtype": "TCP" 00:11:52.832 } 00:11:52.832 ] 00:11:52.832 }, 00:11:52.832 { 00:11:52.832 "name": "nvmf_tgt_poll_group_3", 00:11:52.832 "admin_qpairs": 0, 00:11:52.832 "io_qpairs": 0, 00:11:52.832 "current_admin_qpairs": 0, 00:11:52.832 "current_io_qpairs": 0, 00:11:52.832 "pending_bdev_io": 0, 00:11:52.832 "completed_nvme_io": 0, 00:11:52.832 "transports": [ 00:11:52.832 { 00:11:52.832 "trtype": "TCP" 00:11:52.832 } 00:11:52.832 ] 00:11:52.832 } 00:11:52.832 ] 00:11:52.832 }' 00:11:52.832 04:18:29 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:52.832 04:18:29 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:52.832 04:18:29 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:52.832 04:18:29 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:52.832 04:18:30 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:52.832 04:18:30 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:52.832 04:18:30 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:52.832 04:18:30 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:52.832 04:18:30 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:52.832 04:18:30 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:52.832 04:18:30 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:52.832 04:18:30 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:52.832 04:18:30 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:52.832 04:18:30 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:52.832 04:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 Malloc1 00:11:52.832 04:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.832 04:18:30 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:52.832 04:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 04:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.832 04:18:30 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:52.832 04:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 04:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.832 04:18:30 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:52.832 04:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:52.832 04:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.832 04:18:30 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:52.832 04:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.832 04:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:53.091 [2024-11-28 04:18:30.128407] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:53.091 04:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.091 04:18:30 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:53.091 04:18:30 -- common/autotest_common.sh@650 -- # local es=0 00:11:53.091 04:18:30 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:53.091 04:18:30 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:53.091 04:18:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:53.091 04:18:30 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:53.091 04:18:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:53.091 04:18:30 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:53.091 04:18:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:53.091 04:18:30 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:53.091 04:18:30 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:53.091 04:18:30 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:53.091 [2024-11-28 04:18:30.150793] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:53.091 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:53.091 could not add new controller: failed to write to nvme-fabrics device 00:11:53.091 04:18:30 -- common/autotest_common.sh@653 -- # es=1 00:11:53.091 04:18:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:53.091 04:18:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:53.091 04:18:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:53.091 04:18:30 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:53.091 04:18:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.091 04:18:30 -- common/autotest_common.sh@10 -- # set +x 00:11:53.091 04:18:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.091 04:18:30 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.657 04:18:30 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:53.657 04:18:30 -- common/autotest_common.sh@1187 -- # local i=0 00:11:53.657 04:18:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:53.657 04:18:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:53.657 04:18:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:55.558 04:18:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:55.558 04:18:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:55.558 04:18:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:55.558 04:18:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:55.558 04:18:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:55.558 04:18:32 -- common/autotest_common.sh@1197 -- # return 0 00:11:55.558 04:18:32 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:55.817 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.817 04:18:32 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:55.817 04:18:32 -- common/autotest_common.sh@1208 -- # local i=0 00:11:55.817 04:18:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:55.817 04:18:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.817 04:18:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:55.817 04:18:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.817 04:18:32 -- common/autotest_common.sh@1220 -- # return 0 00:11:55.817 04:18:32 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:55.817 04:18:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.817 04:18:32 -- common/autotest_common.sh@10 -- # set +x 00:11:55.817 04:18:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.817 04:18:32 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:55.817 04:18:32 -- common/autotest_common.sh@650 -- # local es=0 00:11:55.817 04:18:32 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:55.817 04:18:32 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:55.817 04:18:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:55.817 04:18:32 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:55.817 04:18:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:55.817 04:18:32 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:55.817 04:18:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:55.817 04:18:32 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:55.817 04:18:32 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:55.817 04:18:32 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:55.817 [2024-11-28 04:18:32.944562] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:55.817 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:55.817 could not add new controller: failed to write to nvme-fabrics device 00:11:55.817 04:18:32 -- common/autotest_common.sh@653 -- # es=1 00:11:55.817 04:18:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:55.817 04:18:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:55.817 04:18:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:55.817 04:18:32 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:55.817 04:18:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.817 04:18:32 -- common/autotest_common.sh@10 -- # set +x 00:11:55.817 04:18:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.817 04:18:32 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:56.388 04:18:33 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:56.388 04:18:33 -- common/autotest_common.sh@1187 -- # local i=0 00:11:56.388 04:18:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:56.388 04:18:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:56.388 04:18:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:58.918 04:18:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:58.918 04:18:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:58.918 04:18:35 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:58.918 04:18:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:58.918 04:18:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:58.918 04:18:35 -- common/autotest_common.sh@1197 -- # return 0 00:11:58.918 04:18:35 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:58.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.918 04:18:35 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:58.918 04:18:35 -- common/autotest_common.sh@1208 -- # local i=0 00:11:58.918 04:18:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:58.918 04:18:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.918 04:18:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:58.918 04:18:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.918 04:18:35 -- common/autotest_common.sh@1220 -- # return 0 00:11:58.918 04:18:35 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:58.918 04:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.918 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:11:58.918 04:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.918 04:18:35 -- target/rpc.sh@81 -- # seq 1 5 00:11:58.918 04:18:35 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:58.918 04:18:35 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:58.918 04:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.918 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:11:58.918 04:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.918 04:18:35 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:58.918 04:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.918 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:11:58.918 [2024-11-28 04:18:35.777547] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:58.918 04:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.918 04:18:35 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:58.918 04:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.918 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:11:58.918 04:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.918 04:18:35 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:58.918 04:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.918 04:18:35 -- common/autotest_common.sh@10 -- # set +x 00:11:58.918 04:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.918 04:18:35 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:59.176 04:18:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:59.176 04:18:36 -- common/autotest_common.sh@1187 -- # local i=0 00:11:59.176 04:18:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:59.176 04:18:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:59.176 04:18:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:01.702 04:18:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:01.702 04:18:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:01.702 04:18:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:01.702 04:18:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:01.702 04:18:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:01.702 04:18:38 -- common/autotest_common.sh@1197 -- # return 0 00:12:01.702 04:18:38 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:01.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.702 04:18:38 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:01.702 04:18:38 -- common/autotest_common.sh@1208 -- # local i=0 00:12:01.702 04:18:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:01.702 04:18:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.702 04:18:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:01.702 04:18:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.702 04:18:38 -- common/autotest_common.sh@1220 -- # return 0 00:12:01.702 04:18:38 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:01.702 04:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.702 04:18:38 -- common/autotest_common.sh@10 -- # set +x 00:12:01.702 04:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.702 04:18:38 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:01.702 04:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.702 04:18:38 -- common/autotest_common.sh@10 -- # set +x 00:12:01.702 04:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.702 04:18:38 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:01.702 04:18:38 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:01.702 04:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.702 04:18:38 -- common/autotest_common.sh@10 -- # set +x 00:12:01.702 04:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.702 04:18:38 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.702 04:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.702 04:18:38 -- common/autotest_common.sh@10 -- # set +x 00:12:01.702 [2024-11-28 04:18:38.566764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.702 04:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.702 04:18:38 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:01.702 04:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.702 04:18:38 -- common/autotest_common.sh@10 -- # set +x 00:12:01.702 04:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.702 04:18:38 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:01.702 04:18:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.702 04:18:38 -- common/autotest_common.sh@10 -- # set +x 00:12:01.702 04:18:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.702 04:18:38 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.268 04:18:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.268 04:18:39 -- common/autotest_common.sh@1187 -- # local i=0 00:12:02.268 04:18:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.268 04:18:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:02.268 04:18:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:04.165 04:18:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:04.165 04:18:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:04.165 04:18:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:04.165 04:18:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:04.165 04:18:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:04.165 04:18:41 -- common/autotest_common.sh@1197 -- # return 0 00:12:04.165 04:18:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:04.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.165 04:18:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:04.165 04:18:41 -- common/autotest_common.sh@1208 -- # local i=0 00:12:04.165 04:18:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:04.165 04:18:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.165 04:18:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:04.165 04:18:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.165 04:18:41 -- common/autotest_common.sh@1220 -- # return 0 00:12:04.165 04:18:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:04.165 04:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.165 04:18:41 -- common/autotest_common.sh@10 -- # set +x 00:12:04.165 04:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.165 04:18:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:04.165 04:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.165 04:18:41 -- common/autotest_common.sh@10 -- # set +x 00:12:04.165 04:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.165 04:18:41 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:04.165 04:18:41 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:04.165 04:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.165 04:18:41 -- common/autotest_common.sh@10 -- # set +x 00:12:04.165 04:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.165 04:18:41 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:04.165 04:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.165 04:18:41 -- common/autotest_common.sh@10 -- # set +x 00:12:04.165 [2024-11-28 04:18:41.393137] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:04.165 04:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.165 04:18:41 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:04.165 04:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.165 04:18:41 -- common/autotest_common.sh@10 -- # set +x 00:12:04.165 04:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.165 04:18:41 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:04.165 04:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.165 04:18:41 -- common/autotest_common.sh@10 -- # set +x 00:12:04.165 04:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.165 04:18:41 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.731 04:18:42 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:04.731 04:18:42 -- common/autotest_common.sh@1187 -- # local i=0 00:12:04.731 04:18:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:04.731 04:18:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:04.731 04:18:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:07.257 04:18:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:07.257 04:18:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:07.257 04:18:44 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:07.257 04:18:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:07.257 04:18:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:07.257 04:18:44 -- common/autotest_common.sh@1197 -- # return 0 00:12:07.257 04:18:44 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:07.257 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.257 04:18:44 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:07.257 04:18:44 -- common/autotest_common.sh@1208 -- # local i=0 00:12:07.257 04:18:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:07.257 04:18:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.257 04:18:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:07.257 04:18:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.257 04:18:44 -- common/autotest_common.sh@1220 -- # return 0 00:12:07.257 04:18:44 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:07.257 04:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.257 04:18:44 -- common/autotest_common.sh@10 -- # set +x 00:12:07.257 04:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.257 04:18:44 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:07.257 04:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.257 04:18:44 -- common/autotest_common.sh@10 -- # set +x 00:12:07.257 04:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.257 04:18:44 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:07.257 04:18:44 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:07.257 04:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.258 04:18:44 -- common/autotest_common.sh@10 -- # set +x 00:12:07.258 04:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.258 04:18:44 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:07.258 04:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.258 04:18:44 -- common/autotest_common.sh@10 -- # set +x 00:12:07.258 [2024-11-28 04:18:44.179314] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:07.258 04:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.258 04:18:44 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:07.258 04:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.258 04:18:44 -- common/autotest_common.sh@10 -- # set +x 00:12:07.258 04:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.258 04:18:44 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:07.258 04:18:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.258 04:18:44 -- common/autotest_common.sh@10 -- # set +x 00:12:07.258 04:18:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.258 04:18:44 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:07.823 04:18:44 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:07.823 04:18:44 -- common/autotest_common.sh@1187 -- # local i=0 00:12:07.823 04:18:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:07.823 04:18:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:07.823 04:18:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:09.721 04:18:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:09.721 04:18:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:09.721 04:18:46 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:09.721 04:18:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:09.721 04:18:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:09.721 04:18:46 -- common/autotest_common.sh@1197 -- # return 0 00:12:09.721 04:18:46 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:09.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.721 04:18:46 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:09.721 04:18:46 -- common/autotest_common.sh@1208 -- # local i=0 00:12:09.721 04:18:46 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:09.721 04:18:46 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.721 04:18:46 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:09.721 04:18:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.721 04:18:46 -- common/autotest_common.sh@1220 -- # return 0 00:12:09.721 04:18:46 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:09.721 04:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.721 04:18:46 -- common/autotest_common.sh@10 -- # set +x 00:12:09.721 04:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.721 04:18:46 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.721 04:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.721 04:18:46 -- common/autotest_common.sh@10 -- # set +x 00:12:09.721 04:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.721 04:18:46 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:09.721 04:18:46 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.721 04:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.721 04:18:46 -- common/autotest_common.sh@10 -- # set +x 00:12:09.721 04:18:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.721 04:18:46 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.721 04:18:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.721 04:18:46 -- common/autotest_common.sh@10 -- # set +x 00:12:09.721 [2024-11-28 04:18:46.996643] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.721 04:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.721 04:18:47 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:09.721 04:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.721 04:18:47 -- common/autotest_common.sh@10 -- # set +x 00:12:09.721 04:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.721 04:18:47 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.721 04:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.721 04:18:47 -- common/autotest_common.sh@10 -- # set +x 00:12:09.721 04:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.721 04:18:47 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:10.655 04:18:47 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:10.655 04:18:47 -- common/autotest_common.sh@1187 -- # local i=0 00:12:10.655 04:18:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:10.655 04:18:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:10.655 04:18:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:12.556 04:18:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:12.556 04:18:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:12.556 04:18:49 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:12.556 04:18:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:12.556 04:18:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:12.556 04:18:49 -- common/autotest_common.sh@1197 -- # return 0 00:12:12.556 04:18:49 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:12.556 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.556 04:18:49 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:12.556 04:18:49 -- common/autotest_common.sh@1208 -- # local i=0 00:12:12.556 04:18:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:12.556 04:18:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.556 04:18:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:12.556 04:18:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.556 04:18:49 -- common/autotest_common.sh@1220 -- # return 0 00:12:12.556 04:18:49 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:12.556 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.556 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.556 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.556 04:18:49 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.556 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.556 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.556 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.556 04:18:49 -- target/rpc.sh@99 -- # seq 1 5 00:12:12.556 04:18:49 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:12.557 04:18:49 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 [2024-11-28 04:18:49.743478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:12.557 04:18:49 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 [2024-11-28 04:18:49.791582] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:12.557 04:18:49 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 [2024-11-28 04:18:49.839746] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.557 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.557 04:18:49 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:12.557 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.557 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:12.816 04:18:49 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 [2024-11-28 04:18:49.887913] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:12.816 04:18:49 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 [2024-11-28 04:18:49.936088] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:12.816 04:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.816 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:12:12.816 04:18:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.816 04:18:49 -- target/rpc.sh@110 -- # stats='{ 00:12:12.816 "tick_rate": 2700000000, 00:12:12.816 "poll_groups": [ 00:12:12.816 { 00:12:12.816 "name": "nvmf_tgt_poll_group_0", 00:12:12.816 "admin_qpairs": 2, 00:12:12.816 "io_qpairs": 84, 00:12:12.816 "current_admin_qpairs": 0, 00:12:12.816 "current_io_qpairs": 0, 00:12:12.816 "pending_bdev_io": 0, 00:12:12.816 "completed_nvme_io": 282, 00:12:12.816 "transports": [ 00:12:12.816 { 00:12:12.816 "trtype": "TCP" 00:12:12.816 } 00:12:12.816 ] 00:12:12.816 }, 00:12:12.816 { 00:12:12.816 "name": "nvmf_tgt_poll_group_1", 00:12:12.816 "admin_qpairs": 2, 00:12:12.816 "io_qpairs": 84, 00:12:12.816 "current_admin_qpairs": 0, 00:12:12.816 "current_io_qpairs": 0, 00:12:12.816 "pending_bdev_io": 0, 00:12:12.816 "completed_nvme_io": 134, 00:12:12.816 "transports": [ 00:12:12.816 { 00:12:12.816 "trtype": "TCP" 00:12:12.816 } 00:12:12.816 ] 00:12:12.816 }, 00:12:12.816 { 00:12:12.816 "name": "nvmf_tgt_poll_group_2", 00:12:12.816 "admin_qpairs": 1, 00:12:12.816 "io_qpairs": 84, 00:12:12.816 "current_admin_qpairs": 0, 00:12:12.816 "current_io_qpairs": 0, 00:12:12.816 "pending_bdev_io": 0, 00:12:12.816 "completed_nvme_io": 136, 00:12:12.816 "transports": [ 00:12:12.816 { 00:12:12.816 "trtype": "TCP" 00:12:12.816 } 00:12:12.816 ] 00:12:12.816 }, 00:12:12.816 { 00:12:12.816 "name": "nvmf_tgt_poll_group_3", 00:12:12.816 "admin_qpairs": 2, 00:12:12.816 "io_qpairs": 84, 00:12:12.816 "current_admin_qpairs": 0, 00:12:12.816 "current_io_qpairs": 0, 00:12:12.816 "pending_bdev_io": 0, 00:12:12.816 "completed_nvme_io": 134, 00:12:12.816 "transports": [ 00:12:12.816 { 00:12:12.816 "trtype": "TCP" 00:12:12.816 } 00:12:12.816 ] 00:12:12.816 } 00:12:12.816 ] 00:12:12.816 }' 00:12:12.816 04:18:49 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:12.816 04:18:49 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:12.816 04:18:49 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:12.816 04:18:49 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:12.816 04:18:50 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:12.816 04:18:50 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:12.816 04:18:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:12.816 04:18:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:12.816 04:18:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:12.816 04:18:50 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:12.816 04:18:50 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:12.816 04:18:50 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:12.816 04:18:50 -- target/rpc.sh@123 -- # nvmftestfini 00:12:12.816 04:18:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:12.816 04:18:50 -- nvmf/common.sh@116 -- # sync 00:12:12.816 04:18:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:12.816 04:18:50 -- nvmf/common.sh@119 -- # set +e 00:12:12.816 04:18:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:12.816 04:18:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:12.816 rmmod nvme_tcp 00:12:12.816 rmmod nvme_fabrics 00:12:12.816 rmmod nvme_keyring 00:12:13.074 04:18:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:13.074 04:18:50 -- nvmf/common.sh@123 -- # set -e 00:12:13.075 04:18:50 -- nvmf/common.sh@124 -- # return 0 00:12:13.075 04:18:50 -- nvmf/common.sh@477 -- # '[' -n 3842480 ']' 00:12:13.075 04:18:50 -- nvmf/common.sh@478 -- # killprocess 3842480 00:12:13.075 04:18:50 -- common/autotest_common.sh@936 -- # '[' -z 3842480 ']' 00:12:13.075 04:18:50 -- common/autotest_common.sh@940 -- # kill -0 3842480 00:12:13.075 04:18:50 -- common/autotest_common.sh@941 -- # uname 00:12:13.075 04:18:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:13.075 04:18:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3842480 00:12:13.075 04:18:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:13.075 04:18:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:13.075 04:18:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3842480' 00:12:13.075 killing process with pid 3842480 00:12:13.075 04:18:50 -- common/autotest_common.sh@955 -- # kill 3842480 00:12:13.075 04:18:50 -- common/autotest_common.sh@960 -- # wait 3842480 00:12:13.333 04:18:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:13.333 04:18:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:13.333 04:18:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:13.333 04:18:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:13.333 04:18:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:13.333 04:18:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:13.333 04:18:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:13.333 04:18:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:15.241 04:18:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:15.241 00:12:15.241 real 0m26.207s 00:12:15.241 user 1m25.357s 00:12:15.241 sys 0m4.146s 00:12:15.241 04:18:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:15.241 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:12:15.241 ************************************ 00:12:15.241 END TEST nvmf_rpc 00:12:15.241 ************************************ 00:12:15.500 04:18:52 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:15.500 04:18:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:15.500 04:18:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:15.500 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:12:15.500 ************************************ 00:12:15.500 START TEST nvmf_invalid 00:12:15.500 ************************************ 00:12:15.500 04:18:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:15.500 * Looking for test storage... 00:12:15.500 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:15.500 04:18:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:15.500 04:18:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:15.500 04:18:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:15.500 04:18:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:15.500 04:18:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:15.500 04:18:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:15.500 04:18:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:15.500 04:18:52 -- scripts/common.sh@335 -- # IFS=.-: 00:12:15.500 04:18:52 -- scripts/common.sh@335 -- # read -ra ver1 00:12:15.500 04:18:52 -- scripts/common.sh@336 -- # IFS=.-: 00:12:15.500 04:18:52 -- scripts/common.sh@336 -- # read -ra ver2 00:12:15.500 04:18:52 -- scripts/common.sh@337 -- # local 'op=<' 00:12:15.500 04:18:52 -- scripts/common.sh@339 -- # ver1_l=2 00:12:15.500 04:18:52 -- scripts/common.sh@340 -- # ver2_l=1 00:12:15.500 04:18:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:15.500 04:18:52 -- scripts/common.sh@343 -- # case "$op" in 00:12:15.500 04:18:52 -- scripts/common.sh@344 -- # : 1 00:12:15.500 04:18:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:15.500 04:18:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:15.500 04:18:52 -- scripts/common.sh@364 -- # decimal 1 00:12:15.500 04:18:52 -- scripts/common.sh@352 -- # local d=1 00:12:15.500 04:18:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:15.500 04:18:52 -- scripts/common.sh@354 -- # echo 1 00:12:15.500 04:18:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:15.500 04:18:52 -- scripts/common.sh@365 -- # decimal 2 00:12:15.500 04:18:52 -- scripts/common.sh@352 -- # local d=2 00:12:15.500 04:18:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:15.500 04:18:52 -- scripts/common.sh@354 -- # echo 2 00:12:15.500 04:18:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:15.500 04:18:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:15.500 04:18:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:15.500 04:18:52 -- scripts/common.sh@367 -- # return 0 00:12:15.500 04:18:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:15.500 04:18:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.500 --rc genhtml_branch_coverage=1 00:12:15.500 --rc genhtml_function_coverage=1 00:12:15.500 --rc genhtml_legend=1 00:12:15.500 --rc geninfo_all_blocks=1 00:12:15.500 --rc geninfo_unexecuted_blocks=1 00:12:15.500 00:12:15.500 ' 00:12:15.500 04:18:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.500 --rc genhtml_branch_coverage=1 00:12:15.500 --rc genhtml_function_coverage=1 00:12:15.500 --rc genhtml_legend=1 00:12:15.500 --rc geninfo_all_blocks=1 00:12:15.500 --rc geninfo_unexecuted_blocks=1 00:12:15.500 00:12:15.500 ' 00:12:15.500 04:18:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.500 --rc genhtml_branch_coverage=1 00:12:15.500 --rc genhtml_function_coverage=1 00:12:15.500 --rc genhtml_legend=1 00:12:15.500 --rc geninfo_all_blocks=1 00:12:15.500 --rc geninfo_unexecuted_blocks=1 00:12:15.500 00:12:15.500 ' 00:12:15.500 04:18:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:15.500 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.500 --rc genhtml_branch_coverage=1 00:12:15.500 --rc genhtml_function_coverage=1 00:12:15.500 --rc genhtml_legend=1 00:12:15.500 --rc geninfo_all_blocks=1 00:12:15.500 --rc geninfo_unexecuted_blocks=1 00:12:15.500 00:12:15.500 ' 00:12:15.500 04:18:52 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:15.500 04:18:52 -- nvmf/common.sh@7 -- # uname -s 00:12:15.500 04:18:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:15.500 04:18:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:15.500 04:18:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:15.500 04:18:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:15.500 04:18:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:15.500 04:18:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:15.500 04:18:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:15.500 04:18:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:15.500 04:18:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:15.500 04:18:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:15.500 04:18:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:15.500 04:18:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:15.500 04:18:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:15.500 04:18:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:15.500 04:18:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:15.500 04:18:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:15.500 04:18:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:15.500 04:18:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:15.500 04:18:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:15.500 04:18:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.500 04:18:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.500 04:18:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.500 04:18:52 -- paths/export.sh@5 -- # export PATH 00:12:15.500 04:18:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.500 04:18:52 -- nvmf/common.sh@46 -- # : 0 00:12:15.500 04:18:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:15.501 04:18:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:15.501 04:18:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:15.501 04:18:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:15.501 04:18:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:15.501 04:18:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:15.501 04:18:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:15.501 04:18:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:15.501 04:18:52 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:15.501 04:18:52 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:15.501 04:18:52 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:15.501 04:18:52 -- target/invalid.sh@14 -- # target=foobar 00:12:15.501 04:18:52 -- target/invalid.sh@16 -- # RANDOM=0 00:12:15.501 04:18:52 -- target/invalid.sh@34 -- # nvmftestinit 00:12:15.501 04:18:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:15.501 04:18:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:15.501 04:18:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:15.501 04:18:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:15.501 04:18:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:15.501 04:18:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:15.501 04:18:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:15.501 04:18:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:15.501 04:18:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:15.501 04:18:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:15.501 04:18:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:15.501 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:12:18.035 04:18:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:18.035 04:18:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:18.035 04:18:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:18.035 04:18:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:18.035 04:18:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:18.035 04:18:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:18.035 04:18:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:18.035 04:18:54 -- nvmf/common.sh@294 -- # net_devs=() 00:12:18.035 04:18:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:18.035 04:18:54 -- nvmf/common.sh@295 -- # e810=() 00:12:18.035 04:18:54 -- nvmf/common.sh@295 -- # local -ga e810 00:12:18.035 04:18:54 -- nvmf/common.sh@296 -- # x722=() 00:12:18.035 04:18:54 -- nvmf/common.sh@296 -- # local -ga x722 00:12:18.035 04:18:54 -- nvmf/common.sh@297 -- # mlx=() 00:12:18.035 04:18:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:18.035 04:18:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:18.035 04:18:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:18.035 04:18:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:18.035 04:18:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:18.035 04:18:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:18.035 04:18:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:18.035 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:18.035 04:18:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:18.035 04:18:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:18.035 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:18.035 04:18:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:18.035 04:18:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:18.035 04:18:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:18.035 04:18:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:18.035 04:18:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:18.035 04:18:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:18.035 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:18.035 04:18:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:18.035 04:18:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:18.035 04:18:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:18.035 04:18:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:18.035 04:18:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:18.035 04:18:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:18.035 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:18.035 04:18:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:18.035 04:18:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:18.035 04:18:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:18.035 04:18:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:18.035 04:18:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:18.035 04:18:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:18.035 04:18:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:18.035 04:18:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:18.035 04:18:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:18.035 04:18:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:18.035 04:18:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:18.035 04:18:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:18.035 04:18:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:18.035 04:18:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:18.035 04:18:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:18.035 04:18:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:18.035 04:18:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:18.035 04:18:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:18.035 04:18:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:18.035 04:18:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:18.035 04:18:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:18.035 04:18:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:18.035 04:18:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:18.035 04:18:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:18.035 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:18.035 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:12:18.035 00:12:18.035 --- 10.0.0.2 ping statistics --- 00:12:18.035 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:18.035 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:12:18.035 04:18:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:18.035 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:18.035 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:12:18.035 00:12:18.035 --- 10.0.0.1 ping statistics --- 00:12:18.035 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:18.035 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:12:18.035 04:18:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:18.035 04:18:54 -- nvmf/common.sh@410 -- # return 0 00:12:18.035 04:18:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:18.035 04:18:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:18.035 04:18:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:18.035 04:18:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:18.036 04:18:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:18.036 04:18:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:18.036 04:18:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:18.036 04:18:54 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:18.036 04:18:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:18.036 04:18:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:18.036 04:18:54 -- common/autotest_common.sh@10 -- # set +x 00:12:18.036 04:18:54 -- nvmf/common.sh@469 -- # nvmfpid=3847202 00:12:18.036 04:18:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:18.036 04:18:54 -- nvmf/common.sh@470 -- # waitforlisten 3847202 00:12:18.036 04:18:54 -- common/autotest_common.sh@829 -- # '[' -z 3847202 ']' 00:12:18.036 04:18:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:18.036 04:18:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:18.036 04:18:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:18.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:18.036 04:18:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:18.036 04:18:54 -- common/autotest_common.sh@10 -- # set +x 00:12:18.036 [2024-11-28 04:18:54.971254] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:18.036 [2024-11-28 04:18:54.971332] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:18.036 EAL: No free 2048 kB hugepages reported on node 1 00:12:18.036 [2024-11-28 04:18:55.040256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:18.036 [2024-11-28 04:18:55.160638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:18.036 [2024-11-28 04:18:55.160780] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:18.036 [2024-11-28 04:18:55.160798] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:18.036 [2024-11-28 04:18:55.160827] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:18.036 [2024-11-28 04:18:55.160914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:18.036 [2024-11-28 04:18:55.160945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:18.036 [2024-11-28 04:18:55.161010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:18.036 [2024-11-28 04:18:55.161012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:18.968 04:18:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:18.968 04:18:55 -- common/autotest_common.sh@862 -- # return 0 00:12:18.968 04:18:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:18.968 04:18:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:18.968 04:18:55 -- common/autotest_common.sh@10 -- # set +x 00:12:18.968 04:18:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:18.968 04:18:56 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:18.968 04:18:56 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode27260 00:12:18.968 [2024-11-28 04:18:56.263000] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:19.226 04:18:56 -- target/invalid.sh@40 -- # out='request: 00:12:19.226 { 00:12:19.226 "nqn": "nqn.2016-06.io.spdk:cnode27260", 00:12:19.226 "tgt_name": "foobar", 00:12:19.226 "method": "nvmf_create_subsystem", 00:12:19.226 "req_id": 1 00:12:19.226 } 00:12:19.226 Got JSON-RPC error response 00:12:19.226 response: 00:12:19.226 { 00:12:19.226 "code": -32603, 00:12:19.226 "message": "Unable to find target foobar" 00:12:19.226 }' 00:12:19.226 04:18:56 -- target/invalid.sh@41 -- # [[ request: 00:12:19.226 { 00:12:19.226 "nqn": "nqn.2016-06.io.spdk:cnode27260", 00:12:19.226 "tgt_name": "foobar", 00:12:19.226 "method": "nvmf_create_subsystem", 00:12:19.226 "req_id": 1 00:12:19.226 } 00:12:19.226 Got JSON-RPC error response 00:12:19.226 response: 00:12:19.226 { 00:12:19.226 "code": -32603, 00:12:19.226 "message": "Unable to find target foobar" 00:12:19.226 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:19.226 04:18:56 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:19.226 04:18:56 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode14192 00:12:19.226 [2024-11-28 04:18:56.519866] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14192: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:19.484 04:18:56 -- target/invalid.sh@45 -- # out='request: 00:12:19.484 { 00:12:19.484 "nqn": "nqn.2016-06.io.spdk:cnode14192", 00:12:19.484 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:19.484 "method": "nvmf_create_subsystem", 00:12:19.484 "req_id": 1 00:12:19.484 } 00:12:19.484 Got JSON-RPC error response 00:12:19.484 response: 00:12:19.484 { 00:12:19.484 "code": -32602, 00:12:19.484 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:19.484 }' 00:12:19.484 04:18:56 -- target/invalid.sh@46 -- # [[ request: 00:12:19.484 { 00:12:19.484 "nqn": "nqn.2016-06.io.spdk:cnode14192", 00:12:19.484 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:19.484 "method": "nvmf_create_subsystem", 00:12:19.484 "req_id": 1 00:12:19.484 } 00:12:19.484 Got JSON-RPC error response 00:12:19.484 response: 00:12:19.484 { 00:12:19.484 "code": -32602, 00:12:19.484 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:19.484 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:19.484 04:18:56 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:19.484 04:18:56 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode32600 00:12:19.484 [2024-11-28 04:18:56.776708] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32600: invalid model number 'SPDK_Controller' 00:12:19.742 04:18:56 -- target/invalid.sh@50 -- # out='request: 00:12:19.742 { 00:12:19.742 "nqn": "nqn.2016-06.io.spdk:cnode32600", 00:12:19.742 "model_number": "SPDK_Controller\u001f", 00:12:19.742 "method": "nvmf_create_subsystem", 00:12:19.742 "req_id": 1 00:12:19.742 } 00:12:19.742 Got JSON-RPC error response 00:12:19.742 response: 00:12:19.742 { 00:12:19.742 "code": -32602, 00:12:19.742 "message": "Invalid MN SPDK_Controller\u001f" 00:12:19.742 }' 00:12:19.742 04:18:56 -- target/invalid.sh@51 -- # [[ request: 00:12:19.742 { 00:12:19.742 "nqn": "nqn.2016-06.io.spdk:cnode32600", 00:12:19.742 "model_number": "SPDK_Controller\u001f", 00:12:19.742 "method": "nvmf_create_subsystem", 00:12:19.742 "req_id": 1 00:12:19.742 } 00:12:19.742 Got JSON-RPC error response 00:12:19.742 response: 00:12:19.742 { 00:12:19.742 "code": -32602, 00:12:19.742 "message": "Invalid MN SPDK_Controller\u001f" 00:12:19.742 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:19.742 04:18:56 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:19.742 04:18:56 -- target/invalid.sh@19 -- # local length=21 ll 00:12:19.742 04:18:56 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:19.742 04:18:56 -- target/invalid.sh@21 -- # local chars 00:12:19.742 04:18:56 -- target/invalid.sh@22 -- # local string 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # printf %x 114 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # string+=r 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # printf %x 110 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # string+=n 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # printf %x 51 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # string+=3 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # printf %x 120 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:19.742 04:18:56 -- target/invalid.sh@25 -- # string+=x 00:12:19.742 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 97 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=a 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 114 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=r 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 108 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=l 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 41 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=')' 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 57 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=9 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 36 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+='$' 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 122 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=z 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 76 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=L 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 64 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=@ 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 85 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=U 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 77 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=M 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 85 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=U 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 99 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x63' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=c 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 110 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=n 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 110 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=n 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 76 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=L 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # printf %x 51 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:19.743 04:18:56 -- target/invalid.sh@25 -- # string+=3 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:19.743 04:18:56 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:19.743 04:18:56 -- target/invalid.sh@28 -- # [[ r == \- ]] 00:12:19.743 04:18:56 -- target/invalid.sh@31 -- # echo 'rn3xarl)9$zL@UMUcnnL3' 00:12:19.743 04:18:56 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'rn3xarl)9$zL@UMUcnnL3' nqn.2016-06.io.spdk:cnode11348 00:12:20.002 [2024-11-28 04:18:57.101809] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11348: invalid serial number 'rn3xarl)9$zL@UMUcnnL3' 00:12:20.002 04:18:57 -- target/invalid.sh@54 -- # out='request: 00:12:20.002 { 00:12:20.002 "nqn": "nqn.2016-06.io.spdk:cnode11348", 00:12:20.002 "serial_number": "rn3xarl)9$zL@UMUcnnL3", 00:12:20.002 "method": "nvmf_create_subsystem", 00:12:20.002 "req_id": 1 00:12:20.002 } 00:12:20.002 Got JSON-RPC error response 00:12:20.002 response: 00:12:20.002 { 00:12:20.002 "code": -32602, 00:12:20.002 "message": "Invalid SN rn3xarl)9$zL@UMUcnnL3" 00:12:20.002 }' 00:12:20.002 04:18:57 -- target/invalid.sh@55 -- # [[ request: 00:12:20.002 { 00:12:20.002 "nqn": "nqn.2016-06.io.spdk:cnode11348", 00:12:20.002 "serial_number": "rn3xarl)9$zL@UMUcnnL3", 00:12:20.002 "method": "nvmf_create_subsystem", 00:12:20.002 "req_id": 1 00:12:20.002 } 00:12:20.002 Got JSON-RPC error response 00:12:20.002 response: 00:12:20.002 { 00:12:20.002 "code": -32602, 00:12:20.002 "message": "Invalid SN rn3xarl)9$zL@UMUcnnL3" 00:12:20.002 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:20.002 04:18:57 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:20.002 04:18:57 -- target/invalid.sh@19 -- # local length=41 ll 00:12:20.002 04:18:57 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:20.002 04:18:57 -- target/invalid.sh@21 -- # local chars 00:12:20.002 04:18:57 -- target/invalid.sh@22 -- # local string 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 70 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=F 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 88 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=X 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 94 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+='^' 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 93 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=']' 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 84 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=T 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 88 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=X 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 56 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=8 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 83 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=S 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 104 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=h 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 83 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=S 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 71 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=G 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 113 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=q 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 114 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=r 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # printf %x 73 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:20.002 04:18:57 -- target/invalid.sh@25 -- # string+=I 00:12:20.002 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 120 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=x 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 52 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=4 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 50 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=2 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 84 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=T 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 85 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=U 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 48 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=0 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 127 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 94 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+='^' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 57 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=9 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 33 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+='!' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 126 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+='~' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 93 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=']' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 50 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=2 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 81 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=Q 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 91 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+='[' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 79 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=O 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 103 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=g 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 40 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+='(' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 41 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=')' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 35 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+='#' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 85 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=U 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 68 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=D 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 72 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=H 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 90 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=Z 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 41 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=')' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 93 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=']' 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # printf %x 108 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:20.003 04:18:57 -- target/invalid.sh@25 -- # string+=l 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:20.003 04:18:57 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:20.003 04:18:57 -- target/invalid.sh@28 -- # [[ F == \- ]] 00:12:20.003 04:18:57 -- target/invalid.sh@31 -- # echo 'FX^]TX8ShSGqrIx42TU0^9!~]2Q[Og()#UDHZ)]l' 00:12:20.003 04:18:57 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'FX^]TX8ShSGqrIx42TU0^9!~]2Q[Og()#UDHZ)]l' nqn.2016-06.io.spdk:cnode1131 00:12:20.261 [2024-11-28 04:18:57.511164] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1131: invalid model number 'FX^]TX8ShSGqrIx42TU0^9!~]2Q[Og()#UDHZ)]l' 00:12:20.261 04:18:57 -- target/invalid.sh@58 -- # out='request: 00:12:20.261 { 00:12:20.261 "nqn": "nqn.2016-06.io.spdk:cnode1131", 00:12:20.261 "model_number": "FX^]TX8ShSGqrIx42TU0\u007f^9!~]2Q[Og()#UDHZ)]l", 00:12:20.261 "method": "nvmf_create_subsystem", 00:12:20.261 "req_id": 1 00:12:20.261 } 00:12:20.261 Got JSON-RPC error response 00:12:20.261 response: 00:12:20.261 { 00:12:20.261 "code": -32602, 00:12:20.261 "message": "Invalid MN FX^]TX8ShSGqrIx42TU0\u007f^9!~]2Q[Og()#UDHZ)]l" 00:12:20.261 }' 00:12:20.261 04:18:57 -- target/invalid.sh@59 -- # [[ request: 00:12:20.261 { 00:12:20.261 "nqn": "nqn.2016-06.io.spdk:cnode1131", 00:12:20.261 "model_number": "FX^]TX8ShSGqrIx42TU0\u007f^9!~]2Q[Og()#UDHZ)]l", 00:12:20.261 "method": "nvmf_create_subsystem", 00:12:20.261 "req_id": 1 00:12:20.261 } 00:12:20.261 Got JSON-RPC error response 00:12:20.261 response: 00:12:20.261 { 00:12:20.261 "code": -32602, 00:12:20.262 "message": "Invalid MN FX^]TX8ShSGqrIx42TU0\u007f^9!~]2Q[Og()#UDHZ)]l" 00:12:20.262 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:20.262 04:18:57 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:20.520 [2024-11-28 04:18:57.776126] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:20.520 04:18:57 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:20.806 04:18:58 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:20.806 04:18:58 -- target/invalid.sh@67 -- # echo '' 00:12:20.806 04:18:58 -- target/invalid.sh@67 -- # head -n 1 00:12:20.806 04:18:58 -- target/invalid.sh@67 -- # IP= 00:12:20.806 04:18:58 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:21.092 [2024-11-28 04:18:58.273910] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:21.092 04:18:58 -- target/invalid.sh@69 -- # out='request: 00:12:21.092 { 00:12:21.092 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:21.092 "listen_address": { 00:12:21.092 "trtype": "tcp", 00:12:21.092 "traddr": "", 00:12:21.092 "trsvcid": "4421" 00:12:21.092 }, 00:12:21.092 "method": "nvmf_subsystem_remove_listener", 00:12:21.092 "req_id": 1 00:12:21.092 } 00:12:21.092 Got JSON-RPC error response 00:12:21.092 response: 00:12:21.092 { 00:12:21.092 "code": -32602, 00:12:21.092 "message": "Invalid parameters" 00:12:21.092 }' 00:12:21.092 04:18:58 -- target/invalid.sh@70 -- # [[ request: 00:12:21.092 { 00:12:21.092 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:21.092 "listen_address": { 00:12:21.092 "trtype": "tcp", 00:12:21.092 "traddr": "", 00:12:21.092 "trsvcid": "4421" 00:12:21.092 }, 00:12:21.092 "method": "nvmf_subsystem_remove_listener", 00:12:21.092 "req_id": 1 00:12:21.092 } 00:12:21.092 Got JSON-RPC error response 00:12:21.092 response: 00:12:21.092 { 00:12:21.092 "code": -32602, 00:12:21.092 "message": "Invalid parameters" 00:12:21.092 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:21.092 04:18:58 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8249 -i 0 00:12:21.350 [2024-11-28 04:18:58.546750] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8249: invalid cntlid range [0-65519] 00:12:21.350 04:18:58 -- target/invalid.sh@73 -- # out='request: 00:12:21.350 { 00:12:21.350 "nqn": "nqn.2016-06.io.spdk:cnode8249", 00:12:21.350 "min_cntlid": 0, 00:12:21.350 "method": "nvmf_create_subsystem", 00:12:21.350 "req_id": 1 00:12:21.350 } 00:12:21.350 Got JSON-RPC error response 00:12:21.350 response: 00:12:21.350 { 00:12:21.350 "code": -32602, 00:12:21.350 "message": "Invalid cntlid range [0-65519]" 00:12:21.350 }' 00:12:21.350 04:18:58 -- target/invalid.sh@74 -- # [[ request: 00:12:21.350 { 00:12:21.350 "nqn": "nqn.2016-06.io.spdk:cnode8249", 00:12:21.350 "min_cntlid": 0, 00:12:21.350 "method": "nvmf_create_subsystem", 00:12:21.350 "req_id": 1 00:12:21.350 } 00:12:21.350 Got JSON-RPC error response 00:12:21.350 response: 00:12:21.350 { 00:12:21.350 "code": -32602, 00:12:21.350 "message": "Invalid cntlid range [0-65519]" 00:12:21.350 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:21.350 04:18:58 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode26099 -i 65520 00:12:21.608 [2024-11-28 04:18:58.803620] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26099: invalid cntlid range [65520-65519] 00:12:21.609 04:18:58 -- target/invalid.sh@75 -- # out='request: 00:12:21.609 { 00:12:21.609 "nqn": "nqn.2016-06.io.spdk:cnode26099", 00:12:21.609 "min_cntlid": 65520, 00:12:21.609 "method": "nvmf_create_subsystem", 00:12:21.609 "req_id": 1 00:12:21.609 } 00:12:21.609 Got JSON-RPC error response 00:12:21.609 response: 00:12:21.609 { 00:12:21.609 "code": -32602, 00:12:21.609 "message": "Invalid cntlid range [65520-65519]" 00:12:21.609 }' 00:12:21.609 04:18:58 -- target/invalid.sh@76 -- # [[ request: 00:12:21.609 { 00:12:21.609 "nqn": "nqn.2016-06.io.spdk:cnode26099", 00:12:21.609 "min_cntlid": 65520, 00:12:21.609 "method": "nvmf_create_subsystem", 00:12:21.609 "req_id": 1 00:12:21.609 } 00:12:21.609 Got JSON-RPC error response 00:12:21.609 response: 00:12:21.609 { 00:12:21.609 "code": -32602, 00:12:21.609 "message": "Invalid cntlid range [65520-65519]" 00:12:21.609 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:21.609 04:18:58 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6583 -I 0 00:12:21.866 [2024-11-28 04:18:59.056466] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6583: invalid cntlid range [1-0] 00:12:21.866 04:18:59 -- target/invalid.sh@77 -- # out='request: 00:12:21.866 { 00:12:21.866 "nqn": "nqn.2016-06.io.spdk:cnode6583", 00:12:21.866 "max_cntlid": 0, 00:12:21.866 "method": "nvmf_create_subsystem", 00:12:21.866 "req_id": 1 00:12:21.866 } 00:12:21.866 Got JSON-RPC error response 00:12:21.866 response: 00:12:21.866 { 00:12:21.866 "code": -32602, 00:12:21.866 "message": "Invalid cntlid range [1-0]" 00:12:21.866 }' 00:12:21.866 04:18:59 -- target/invalid.sh@78 -- # [[ request: 00:12:21.866 { 00:12:21.866 "nqn": "nqn.2016-06.io.spdk:cnode6583", 00:12:21.866 "max_cntlid": 0, 00:12:21.866 "method": "nvmf_create_subsystem", 00:12:21.866 "req_id": 1 00:12:21.866 } 00:12:21.866 Got JSON-RPC error response 00:12:21.866 response: 00:12:21.866 { 00:12:21.866 "code": -32602, 00:12:21.866 "message": "Invalid cntlid range [1-0]" 00:12:21.866 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:21.866 04:18:59 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode30843 -I 65520 00:12:22.125 [2024-11-28 04:18:59.305297] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30843: invalid cntlid range [1-65520] 00:12:22.125 04:18:59 -- target/invalid.sh@79 -- # out='request: 00:12:22.125 { 00:12:22.125 "nqn": "nqn.2016-06.io.spdk:cnode30843", 00:12:22.125 "max_cntlid": 65520, 00:12:22.125 "method": "nvmf_create_subsystem", 00:12:22.125 "req_id": 1 00:12:22.125 } 00:12:22.125 Got JSON-RPC error response 00:12:22.125 response: 00:12:22.125 { 00:12:22.125 "code": -32602, 00:12:22.125 "message": "Invalid cntlid range [1-65520]" 00:12:22.125 }' 00:12:22.125 04:18:59 -- target/invalid.sh@80 -- # [[ request: 00:12:22.125 { 00:12:22.125 "nqn": "nqn.2016-06.io.spdk:cnode30843", 00:12:22.125 "max_cntlid": 65520, 00:12:22.125 "method": "nvmf_create_subsystem", 00:12:22.125 "req_id": 1 00:12:22.125 } 00:12:22.125 Got JSON-RPC error response 00:12:22.125 response: 00:12:22.125 { 00:12:22.125 "code": -32602, 00:12:22.125 "message": "Invalid cntlid range [1-65520]" 00:12:22.125 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:22.125 04:18:59 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode12590 -i 6 -I 5 00:12:22.383 [2024-11-28 04:18:59.558178] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode12590: invalid cntlid range [6-5] 00:12:22.383 04:18:59 -- target/invalid.sh@83 -- # out='request: 00:12:22.383 { 00:12:22.383 "nqn": "nqn.2016-06.io.spdk:cnode12590", 00:12:22.383 "min_cntlid": 6, 00:12:22.383 "max_cntlid": 5, 00:12:22.383 "method": "nvmf_create_subsystem", 00:12:22.383 "req_id": 1 00:12:22.383 } 00:12:22.383 Got JSON-RPC error response 00:12:22.383 response: 00:12:22.383 { 00:12:22.383 "code": -32602, 00:12:22.383 "message": "Invalid cntlid range [6-5]" 00:12:22.383 }' 00:12:22.383 04:18:59 -- target/invalid.sh@84 -- # [[ request: 00:12:22.383 { 00:12:22.383 "nqn": "nqn.2016-06.io.spdk:cnode12590", 00:12:22.383 "min_cntlid": 6, 00:12:22.383 "max_cntlid": 5, 00:12:22.383 "method": "nvmf_create_subsystem", 00:12:22.383 "req_id": 1 00:12:22.383 } 00:12:22.383 Got JSON-RPC error response 00:12:22.383 response: 00:12:22.383 { 00:12:22.383 "code": -32602, 00:12:22.383 "message": "Invalid cntlid range [6-5]" 00:12:22.383 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:22.383 04:18:59 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:22.641 04:18:59 -- target/invalid.sh@87 -- # out='request: 00:12:22.641 { 00:12:22.641 "name": "foobar", 00:12:22.641 "method": "nvmf_delete_target", 00:12:22.641 "req_id": 1 00:12:22.641 } 00:12:22.641 Got JSON-RPC error response 00:12:22.641 response: 00:12:22.641 { 00:12:22.641 "code": -32602, 00:12:22.641 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:22.641 }' 00:12:22.641 04:18:59 -- target/invalid.sh@88 -- # [[ request: 00:12:22.641 { 00:12:22.641 "name": "foobar", 00:12:22.641 "method": "nvmf_delete_target", 00:12:22.641 "req_id": 1 00:12:22.641 } 00:12:22.641 Got JSON-RPC error response 00:12:22.641 response: 00:12:22.641 { 00:12:22.641 "code": -32602, 00:12:22.641 "message": "The specified target doesn't exist, cannot delete it." 00:12:22.641 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:22.641 04:18:59 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:22.641 04:18:59 -- target/invalid.sh@91 -- # nvmftestfini 00:12:22.641 04:18:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:22.641 04:18:59 -- nvmf/common.sh@116 -- # sync 00:12:22.641 04:18:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:22.641 04:18:59 -- nvmf/common.sh@119 -- # set +e 00:12:22.641 04:18:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:22.641 04:18:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:22.641 rmmod nvme_tcp 00:12:22.641 rmmod nvme_fabrics 00:12:22.641 rmmod nvme_keyring 00:12:22.641 04:18:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:22.641 04:18:59 -- nvmf/common.sh@123 -- # set -e 00:12:22.641 04:18:59 -- nvmf/common.sh@124 -- # return 0 00:12:22.641 04:18:59 -- nvmf/common.sh@477 -- # '[' -n 3847202 ']' 00:12:22.641 04:18:59 -- nvmf/common.sh@478 -- # killprocess 3847202 00:12:22.641 04:18:59 -- common/autotest_common.sh@936 -- # '[' -z 3847202 ']' 00:12:22.641 04:18:59 -- common/autotest_common.sh@940 -- # kill -0 3847202 00:12:22.641 04:18:59 -- common/autotest_common.sh@941 -- # uname 00:12:22.641 04:18:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:22.641 04:18:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3847202 00:12:22.641 04:18:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:22.641 04:18:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:22.641 04:18:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3847202' 00:12:22.641 killing process with pid 3847202 00:12:22.641 04:18:59 -- common/autotest_common.sh@955 -- # kill 3847202 00:12:22.641 04:18:59 -- common/autotest_common.sh@960 -- # wait 3847202 00:12:22.900 04:19:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:22.900 04:19:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:22.900 04:19:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:22.900 04:19:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:22.900 04:19:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:22.900 04:19:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:22.900 04:19:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:22.901 04:19:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:24.815 04:19:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:24.815 00:12:24.815 real 0m9.563s 00:12:24.815 user 0m23.511s 00:12:24.815 sys 0m2.529s 00:12:24.815 04:19:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:24.815 04:19:02 -- common/autotest_common.sh@10 -- # set +x 00:12:24.815 ************************************ 00:12:24.815 END TEST nvmf_invalid 00:12:24.815 ************************************ 00:12:25.074 04:19:02 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:25.074 04:19:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:25.074 04:19:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:25.074 04:19:02 -- common/autotest_common.sh@10 -- # set +x 00:12:25.074 ************************************ 00:12:25.074 START TEST nvmf_abort 00:12:25.074 ************************************ 00:12:25.074 04:19:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:25.074 * Looking for test storage... 00:12:25.074 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:25.074 04:19:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:25.074 04:19:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:25.074 04:19:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:25.074 04:19:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:25.074 04:19:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:25.074 04:19:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:25.074 04:19:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:25.074 04:19:02 -- scripts/common.sh@335 -- # IFS=.-: 00:12:25.074 04:19:02 -- scripts/common.sh@335 -- # read -ra ver1 00:12:25.074 04:19:02 -- scripts/common.sh@336 -- # IFS=.-: 00:12:25.074 04:19:02 -- scripts/common.sh@336 -- # read -ra ver2 00:12:25.074 04:19:02 -- scripts/common.sh@337 -- # local 'op=<' 00:12:25.074 04:19:02 -- scripts/common.sh@339 -- # ver1_l=2 00:12:25.074 04:19:02 -- scripts/common.sh@340 -- # ver2_l=1 00:12:25.074 04:19:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:25.074 04:19:02 -- scripts/common.sh@343 -- # case "$op" in 00:12:25.074 04:19:02 -- scripts/common.sh@344 -- # : 1 00:12:25.074 04:19:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:25.074 04:19:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:25.074 04:19:02 -- scripts/common.sh@364 -- # decimal 1 00:12:25.074 04:19:02 -- scripts/common.sh@352 -- # local d=1 00:12:25.074 04:19:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:25.074 04:19:02 -- scripts/common.sh@354 -- # echo 1 00:12:25.074 04:19:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:25.074 04:19:02 -- scripts/common.sh@365 -- # decimal 2 00:12:25.074 04:19:02 -- scripts/common.sh@352 -- # local d=2 00:12:25.074 04:19:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:25.074 04:19:02 -- scripts/common.sh@354 -- # echo 2 00:12:25.074 04:19:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:25.074 04:19:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:25.074 04:19:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:25.074 04:19:02 -- scripts/common.sh@367 -- # return 0 00:12:25.074 04:19:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:25.074 04:19:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:25.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.074 --rc genhtml_branch_coverage=1 00:12:25.074 --rc genhtml_function_coverage=1 00:12:25.074 --rc genhtml_legend=1 00:12:25.074 --rc geninfo_all_blocks=1 00:12:25.074 --rc geninfo_unexecuted_blocks=1 00:12:25.074 00:12:25.074 ' 00:12:25.074 04:19:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:25.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.074 --rc genhtml_branch_coverage=1 00:12:25.074 --rc genhtml_function_coverage=1 00:12:25.074 --rc genhtml_legend=1 00:12:25.074 --rc geninfo_all_blocks=1 00:12:25.074 --rc geninfo_unexecuted_blocks=1 00:12:25.074 00:12:25.074 ' 00:12:25.074 04:19:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:25.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.074 --rc genhtml_branch_coverage=1 00:12:25.074 --rc genhtml_function_coverage=1 00:12:25.074 --rc genhtml_legend=1 00:12:25.074 --rc geninfo_all_blocks=1 00:12:25.074 --rc geninfo_unexecuted_blocks=1 00:12:25.074 00:12:25.074 ' 00:12:25.074 04:19:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:25.074 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:25.074 --rc genhtml_branch_coverage=1 00:12:25.074 --rc genhtml_function_coverage=1 00:12:25.074 --rc genhtml_legend=1 00:12:25.074 --rc geninfo_all_blocks=1 00:12:25.074 --rc geninfo_unexecuted_blocks=1 00:12:25.074 00:12:25.074 ' 00:12:25.074 04:19:02 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:25.074 04:19:02 -- nvmf/common.sh@7 -- # uname -s 00:12:25.074 04:19:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:25.074 04:19:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:25.074 04:19:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:25.074 04:19:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:25.074 04:19:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:25.074 04:19:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:25.074 04:19:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:25.074 04:19:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:25.074 04:19:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:25.074 04:19:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:25.074 04:19:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:25.074 04:19:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:25.074 04:19:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:25.074 04:19:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:25.074 04:19:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:25.074 04:19:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:25.074 04:19:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:25.074 04:19:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:25.074 04:19:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:25.074 04:19:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.074 04:19:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.074 04:19:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.074 04:19:02 -- paths/export.sh@5 -- # export PATH 00:12:25.075 04:19:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:25.075 04:19:02 -- nvmf/common.sh@46 -- # : 0 00:12:25.075 04:19:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:25.075 04:19:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:25.075 04:19:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:25.075 04:19:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:25.075 04:19:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:25.075 04:19:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:25.075 04:19:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:25.075 04:19:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:25.075 04:19:02 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:25.075 04:19:02 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:25.075 04:19:02 -- target/abort.sh@14 -- # nvmftestinit 00:12:25.075 04:19:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:25.075 04:19:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:25.075 04:19:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:25.075 04:19:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:25.075 04:19:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:25.075 04:19:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:25.075 04:19:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:25.075 04:19:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:25.075 04:19:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:25.075 04:19:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:25.075 04:19:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:25.075 04:19:02 -- common/autotest_common.sh@10 -- # set +x 00:12:27.608 04:19:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:27.608 04:19:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:27.608 04:19:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:27.608 04:19:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:27.608 04:19:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:27.608 04:19:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:27.608 04:19:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:27.608 04:19:04 -- nvmf/common.sh@294 -- # net_devs=() 00:12:27.608 04:19:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:27.608 04:19:04 -- nvmf/common.sh@295 -- # e810=() 00:12:27.608 04:19:04 -- nvmf/common.sh@295 -- # local -ga e810 00:12:27.608 04:19:04 -- nvmf/common.sh@296 -- # x722=() 00:12:27.608 04:19:04 -- nvmf/common.sh@296 -- # local -ga x722 00:12:27.608 04:19:04 -- nvmf/common.sh@297 -- # mlx=() 00:12:27.608 04:19:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:27.608 04:19:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:27.608 04:19:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:27.608 04:19:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:27.608 04:19:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:27.608 04:19:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:27.608 04:19:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:27.608 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:27.608 04:19:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:27.608 04:19:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:27.608 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:27.608 04:19:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:27.608 04:19:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:27.608 04:19:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:27.608 04:19:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:27.608 04:19:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:27.608 04:19:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:27.608 04:19:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:27.608 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:27.608 04:19:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:27.608 04:19:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:27.608 04:19:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:27.608 04:19:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:27.608 04:19:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:27.608 04:19:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:27.608 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:27.608 04:19:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:27.608 04:19:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:27.608 04:19:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:27.608 04:19:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:27.609 04:19:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:27.609 04:19:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:27.609 04:19:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:27.609 04:19:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:27.609 04:19:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:27.609 04:19:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:27.609 04:19:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:27.609 04:19:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:27.609 04:19:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:27.609 04:19:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:27.609 04:19:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:27.609 04:19:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:27.609 04:19:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:27.609 04:19:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:27.609 04:19:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:27.609 04:19:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:27.609 04:19:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:27.609 04:19:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:27.609 04:19:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:27.609 04:19:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:27.609 04:19:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:27.609 04:19:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:27.609 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:27.609 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.199 ms 00:12:27.609 00:12:27.609 --- 10.0.0.2 ping statistics --- 00:12:27.609 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:27.609 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:12:27.609 04:19:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:27.609 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:27.609 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:12:27.609 00:12:27.609 --- 10.0.0.1 ping statistics --- 00:12:27.609 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:27.609 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:12:27.609 04:19:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:27.609 04:19:04 -- nvmf/common.sh@410 -- # return 0 00:12:27.609 04:19:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:27.609 04:19:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:27.609 04:19:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:27.609 04:19:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:27.609 04:19:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:27.609 04:19:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:27.609 04:19:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:27.609 04:19:04 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:27.609 04:19:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:27.609 04:19:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:27.609 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:12:27.609 04:19:04 -- nvmf/common.sh@469 -- # nvmfpid=3850001 00:12:27.609 04:19:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:27.609 04:19:04 -- nvmf/common.sh@470 -- # waitforlisten 3850001 00:12:27.609 04:19:04 -- common/autotest_common.sh@829 -- # '[' -z 3850001 ']' 00:12:27.609 04:19:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:27.609 04:19:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:27.609 04:19:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:27.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:27.609 04:19:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:27.609 04:19:04 -- common/autotest_common.sh@10 -- # set +x 00:12:27.609 [2024-11-28 04:19:04.566055] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:27.609 [2024-11-28 04:19:04.566123] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:27.609 EAL: No free 2048 kB hugepages reported on node 1 00:12:27.609 [2024-11-28 04:19:04.632722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:27.609 [2024-11-28 04:19:04.752048] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:27.609 [2024-11-28 04:19:04.752209] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:27.609 [2024-11-28 04:19:04.752228] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:27.609 [2024-11-28 04:19:04.752243] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:27.609 [2024-11-28 04:19:04.752321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:27.609 [2024-11-28 04:19:04.752376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:27.609 [2024-11-28 04:19:04.752379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:28.542 04:19:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:28.542 04:19:05 -- common/autotest_common.sh@862 -- # return 0 00:12:28.542 04:19:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:28.542 04:19:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 04:19:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:28.542 04:19:05 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:28.542 04:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 [2024-11-28 04:19:05.661138] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:28.542 04:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.542 04:19:05 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:28.542 04:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 Malloc0 00:12:28.542 04:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.542 04:19:05 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:28.542 04:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 Delay0 00:12:28.542 04:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.542 04:19:05 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:28.542 04:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 04:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.542 04:19:05 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:28.542 04:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 04:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.542 04:19:05 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:28.542 04:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 [2024-11-28 04:19:05.735209] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:28.542 04:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.542 04:19:05 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:28.542 04:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.542 04:19:05 -- common/autotest_common.sh@10 -- # set +x 00:12:28.542 04:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.542 04:19:05 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:28.542 EAL: No free 2048 kB hugepages reported on node 1 00:12:28.542 [2024-11-28 04:19:05.840514] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:31.071 Initializing NVMe Controllers 00:12:31.071 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:31.071 controller IO queue size 128 less than required 00:12:31.071 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:31.071 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:31.071 Initialization complete. Launching workers. 00:12:31.071 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 34235 00:12:31.071 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34300, failed to submit 62 00:12:31.071 success 34235, unsuccess 65, failed 0 00:12:31.071 04:19:07 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:31.071 04:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.071 04:19:07 -- common/autotest_common.sh@10 -- # set +x 00:12:31.071 04:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.071 04:19:07 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:31.071 04:19:07 -- target/abort.sh@38 -- # nvmftestfini 00:12:31.071 04:19:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:31.071 04:19:07 -- nvmf/common.sh@116 -- # sync 00:12:31.071 04:19:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:31.071 04:19:07 -- nvmf/common.sh@119 -- # set +e 00:12:31.071 04:19:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:31.071 04:19:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:31.071 rmmod nvme_tcp 00:12:31.071 rmmod nvme_fabrics 00:12:31.071 rmmod nvme_keyring 00:12:31.071 04:19:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:31.071 04:19:07 -- nvmf/common.sh@123 -- # set -e 00:12:31.071 04:19:07 -- nvmf/common.sh@124 -- # return 0 00:12:31.071 04:19:07 -- nvmf/common.sh@477 -- # '[' -n 3850001 ']' 00:12:31.071 04:19:07 -- nvmf/common.sh@478 -- # killprocess 3850001 00:12:31.071 04:19:07 -- common/autotest_common.sh@936 -- # '[' -z 3850001 ']' 00:12:31.071 04:19:07 -- common/autotest_common.sh@940 -- # kill -0 3850001 00:12:31.071 04:19:07 -- common/autotest_common.sh@941 -- # uname 00:12:31.071 04:19:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:31.071 04:19:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3850001 00:12:31.071 04:19:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:31.071 04:19:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:31.071 04:19:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3850001' 00:12:31.071 killing process with pid 3850001 00:12:31.071 04:19:08 -- common/autotest_common.sh@955 -- # kill 3850001 00:12:31.071 04:19:08 -- common/autotest_common.sh@960 -- # wait 3850001 00:12:31.071 04:19:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:31.071 04:19:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:31.071 04:19:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:31.071 04:19:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:31.071 04:19:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:31.071 04:19:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:31.071 04:19:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:31.071 04:19:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:33.603 04:19:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:33.603 00:12:33.603 real 0m8.213s 00:12:33.603 user 0m13.231s 00:12:33.603 sys 0m2.561s 00:12:33.603 04:19:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:33.603 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:12:33.603 ************************************ 00:12:33.603 END TEST nvmf_abort 00:12:33.603 ************************************ 00:12:33.603 04:19:10 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:33.603 04:19:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:33.603 04:19:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:33.603 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:12:33.603 ************************************ 00:12:33.603 START TEST nvmf_ns_hotplug_stress 00:12:33.603 ************************************ 00:12:33.603 04:19:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:33.603 * Looking for test storage... 00:12:33.603 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:33.603 04:19:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:33.603 04:19:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:33.603 04:19:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:33.603 04:19:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:33.603 04:19:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:33.603 04:19:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:33.603 04:19:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:33.603 04:19:10 -- scripts/common.sh@335 -- # IFS=.-: 00:12:33.603 04:19:10 -- scripts/common.sh@335 -- # read -ra ver1 00:12:33.603 04:19:10 -- scripts/common.sh@336 -- # IFS=.-: 00:12:33.603 04:19:10 -- scripts/common.sh@336 -- # read -ra ver2 00:12:33.603 04:19:10 -- scripts/common.sh@337 -- # local 'op=<' 00:12:33.603 04:19:10 -- scripts/common.sh@339 -- # ver1_l=2 00:12:33.603 04:19:10 -- scripts/common.sh@340 -- # ver2_l=1 00:12:33.603 04:19:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:33.603 04:19:10 -- scripts/common.sh@343 -- # case "$op" in 00:12:33.603 04:19:10 -- scripts/common.sh@344 -- # : 1 00:12:33.603 04:19:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:33.603 04:19:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:33.603 04:19:10 -- scripts/common.sh@364 -- # decimal 1 00:12:33.603 04:19:10 -- scripts/common.sh@352 -- # local d=1 00:12:33.603 04:19:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:33.603 04:19:10 -- scripts/common.sh@354 -- # echo 1 00:12:33.603 04:19:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:33.603 04:19:10 -- scripts/common.sh@365 -- # decimal 2 00:12:33.603 04:19:10 -- scripts/common.sh@352 -- # local d=2 00:12:33.603 04:19:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:33.603 04:19:10 -- scripts/common.sh@354 -- # echo 2 00:12:33.603 04:19:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:33.603 04:19:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:33.603 04:19:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:33.603 04:19:10 -- scripts/common.sh@367 -- # return 0 00:12:33.603 04:19:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:33.603 04:19:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:33.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.603 --rc genhtml_branch_coverage=1 00:12:33.603 --rc genhtml_function_coverage=1 00:12:33.603 --rc genhtml_legend=1 00:12:33.603 --rc geninfo_all_blocks=1 00:12:33.603 --rc geninfo_unexecuted_blocks=1 00:12:33.603 00:12:33.603 ' 00:12:33.603 04:19:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:33.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.603 --rc genhtml_branch_coverage=1 00:12:33.603 --rc genhtml_function_coverage=1 00:12:33.603 --rc genhtml_legend=1 00:12:33.603 --rc geninfo_all_blocks=1 00:12:33.603 --rc geninfo_unexecuted_blocks=1 00:12:33.603 00:12:33.603 ' 00:12:33.603 04:19:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:33.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.603 --rc genhtml_branch_coverage=1 00:12:33.603 --rc genhtml_function_coverage=1 00:12:33.603 --rc genhtml_legend=1 00:12:33.603 --rc geninfo_all_blocks=1 00:12:33.603 --rc geninfo_unexecuted_blocks=1 00:12:33.603 00:12:33.603 ' 00:12:33.603 04:19:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:33.603 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.603 --rc genhtml_branch_coverage=1 00:12:33.603 --rc genhtml_function_coverage=1 00:12:33.603 --rc genhtml_legend=1 00:12:33.603 --rc geninfo_all_blocks=1 00:12:33.603 --rc geninfo_unexecuted_blocks=1 00:12:33.603 00:12:33.603 ' 00:12:33.603 04:19:10 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:33.603 04:19:10 -- nvmf/common.sh@7 -- # uname -s 00:12:33.603 04:19:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:33.603 04:19:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:33.603 04:19:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:33.603 04:19:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:33.603 04:19:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:33.603 04:19:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:33.603 04:19:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:33.603 04:19:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:33.603 04:19:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:33.603 04:19:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:33.603 04:19:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:33.603 04:19:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:33.603 04:19:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:33.603 04:19:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:33.603 04:19:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:33.603 04:19:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:33.603 04:19:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:33.603 04:19:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:33.603 04:19:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:33.603 04:19:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.603 04:19:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.603 04:19:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.603 04:19:10 -- paths/export.sh@5 -- # export PATH 00:12:33.603 04:19:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.603 04:19:10 -- nvmf/common.sh@46 -- # : 0 00:12:33.603 04:19:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:33.603 04:19:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:33.603 04:19:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:33.603 04:19:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:33.603 04:19:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:33.603 04:19:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:33.603 04:19:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:33.603 04:19:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:33.604 04:19:10 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:33.604 04:19:10 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:33.604 04:19:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:33.604 04:19:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:33.604 04:19:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:33.604 04:19:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:33.604 04:19:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:33.604 04:19:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:33.604 04:19:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:33.604 04:19:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:33.604 04:19:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:33.604 04:19:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:33.604 04:19:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:33.604 04:19:10 -- common/autotest_common.sh@10 -- # set +x 00:12:35.506 04:19:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:35.506 04:19:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:35.506 04:19:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:35.506 04:19:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:35.506 04:19:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:35.506 04:19:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:35.506 04:19:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:35.506 04:19:12 -- nvmf/common.sh@294 -- # net_devs=() 00:12:35.506 04:19:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:35.506 04:19:12 -- nvmf/common.sh@295 -- # e810=() 00:12:35.506 04:19:12 -- nvmf/common.sh@295 -- # local -ga e810 00:12:35.506 04:19:12 -- nvmf/common.sh@296 -- # x722=() 00:12:35.506 04:19:12 -- nvmf/common.sh@296 -- # local -ga x722 00:12:35.506 04:19:12 -- nvmf/common.sh@297 -- # mlx=() 00:12:35.506 04:19:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:35.506 04:19:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:35.506 04:19:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:35.506 04:19:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:35.506 04:19:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:35.506 04:19:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:35.506 04:19:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:35.506 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:35.506 04:19:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:35.506 04:19:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:35.506 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:35.506 04:19:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:35.506 04:19:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:35.506 04:19:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:35.506 04:19:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:35.506 04:19:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:35.506 04:19:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:35.506 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:35.506 04:19:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:35.506 04:19:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:35.506 04:19:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:35.506 04:19:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:35.506 04:19:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:35.506 04:19:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:35.506 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:35.506 04:19:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:35.506 04:19:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:35.506 04:19:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:35.506 04:19:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:35.506 04:19:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:35.506 04:19:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:35.506 04:19:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:35.506 04:19:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:35.506 04:19:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:35.506 04:19:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:35.506 04:19:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:35.506 04:19:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:35.506 04:19:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:35.506 04:19:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:35.506 04:19:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:35.506 04:19:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:35.506 04:19:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:35.506 04:19:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:35.506 04:19:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:35.506 04:19:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:35.506 04:19:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:35.506 04:19:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:35.765 04:19:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:35.765 04:19:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:35.765 04:19:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:35.765 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:35.765 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.169 ms 00:12:35.765 00:12:35.765 --- 10.0.0.2 ping statistics --- 00:12:35.765 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:35.765 rtt min/avg/max/mdev = 0.169/0.169/0.169/0.000 ms 00:12:35.765 04:19:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:35.765 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:35.765 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:12:35.765 00:12:35.765 --- 10.0.0.1 ping statistics --- 00:12:35.765 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:35.765 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:12:35.765 04:19:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:35.765 04:19:12 -- nvmf/common.sh@410 -- # return 0 00:12:35.765 04:19:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:35.765 04:19:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:35.765 04:19:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:35.765 04:19:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:35.765 04:19:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:35.765 04:19:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:35.765 04:19:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:35.765 04:19:12 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:35.765 04:19:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:35.765 04:19:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:35.765 04:19:12 -- common/autotest_common.sh@10 -- # set +x 00:12:35.765 04:19:12 -- nvmf/common.sh@469 -- # nvmfpid=3852382 00:12:35.765 04:19:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:35.765 04:19:12 -- nvmf/common.sh@470 -- # waitforlisten 3852382 00:12:35.765 04:19:12 -- common/autotest_common.sh@829 -- # '[' -z 3852382 ']' 00:12:35.765 04:19:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:35.765 04:19:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:35.765 04:19:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:35.765 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:35.765 04:19:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:35.765 04:19:12 -- common/autotest_common.sh@10 -- # set +x 00:12:35.765 [2024-11-28 04:19:12.913189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:35.765 [2024-11-28 04:19:12.913263] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:35.765 EAL: No free 2048 kB hugepages reported on node 1 00:12:35.765 [2024-11-28 04:19:12.984702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:36.023 [2024-11-28 04:19:13.105592] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:36.023 [2024-11-28 04:19:13.105745] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:36.023 [2024-11-28 04:19:13.105765] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:36.023 [2024-11-28 04:19:13.105788] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:36.023 [2024-11-28 04:19:13.105885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:36.023 [2024-11-28 04:19:13.105917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:36.023 [2024-11-28 04:19:13.105921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:36.957 04:19:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:36.957 04:19:13 -- common/autotest_common.sh@862 -- # return 0 00:12:36.957 04:19:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:36.957 04:19:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:36.957 04:19:13 -- common/autotest_common.sh@10 -- # set +x 00:12:36.957 04:19:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:36.957 04:19:13 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:36.957 04:19:13 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:36.957 [2024-11-28 04:19:14.223259] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:36.957 04:19:14 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:37.215 04:19:14 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:37.473 [2024-11-28 04:19:14.738291] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:37.473 04:19:14 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:37.731 04:19:15 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:37.991 Malloc0 00:12:37.991 04:19:15 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:38.249 Delay0 00:12:38.249 04:19:15 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.508 04:19:15 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:38.766 NULL1 00:12:38.766 04:19:16 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:39.024 04:19:16 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3852824 00:12:39.024 04:19:16 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:39.024 04:19:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:39.024 04:19:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.024 EAL: No free 2048 kB hugepages reported on node 1 00:12:39.283 04:19:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.541 04:19:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:39.541 04:19:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:39.798 true 00:12:39.798 04:19:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:39.798 04:19:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.056 04:19:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.314 04:19:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:40.314 04:19:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:40.572 true 00:12:40.572 04:19:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:40.572 04:19:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.507 Read completed with error (sct=0, sc=11) 00:12:41.507 04:19:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.507 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:41.765 04:19:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:41.765 04:19:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:42.023 true 00:12:42.023 04:19:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:42.023 04:19:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.281 04:19:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.539 04:19:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:42.539 04:19:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:42.798 true 00:12:42.798 04:19:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:42.798 04:19:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.732 04:19:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.732 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.990 04:19:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:43.990 04:19:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:44.247 true 00:12:44.248 04:19:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:44.248 04:19:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.506 04:19:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.764 04:19:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:44.764 04:19:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:45.022 true 00:12:45.022 04:19:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:45.022 04:19:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.279 04:19:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.537 04:19:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:45.537 04:19:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:45.795 true 00:12:45.795 04:19:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:45.795 04:19:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.729 04:19:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.987 04:19:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:46.987 04:19:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:47.245 true 00:12:47.245 04:19:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:47.245 04:19:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.503 04:19:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.762 04:19:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:47.762 04:19:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:48.019 true 00:12:48.019 04:19:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:48.019 04:19:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.276 04:19:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.534 04:19:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:48.534 04:19:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:48.791 true 00:12:48.791 04:19:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:48.791 04:19:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.722 04:19:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.979 04:19:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:49.979 04:19:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:50.288 true 00:12:50.288 04:19:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:50.288 04:19:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.545 04:19:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.802 04:19:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:50.802 04:19:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:51.058 true 00:12:51.058 04:19:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:51.058 04:19:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.990 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.990 04:19:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.990 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.990 04:19:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:51.990 04:19:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:52.247 true 00:12:52.247 04:19:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:52.247 04:19:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.505 04:19:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.764 04:19:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:52.764 04:19:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:53.022 true 00:12:53.022 04:19:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:53.022 04:19:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.954 04:19:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:54.212 04:19:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:54.212 04:19:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:54.470 true 00:12:54.470 04:19:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:54.470 04:19:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.728 04:19:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.986 04:19:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:54.986 04:19:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:55.243 true 00:12:55.243 04:19:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:55.243 04:19:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.501 04:19:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.759 04:19:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:55.759 04:19:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:56.043 true 00:12:56.043 04:19:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:56.043 04:19:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.041 04:19:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.041 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.041 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.041 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.299 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.299 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.299 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.299 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.299 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.299 04:19:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:57.299 04:19:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:57.556 true 00:12:57.556 04:19:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:57.556 04:19:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:58.489 04:19:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.748 04:19:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:58.748 04:19:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:59.006 true 00:12:59.006 04:19:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:59.006 04:19:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.265 04:19:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.523 04:19:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:59.523 04:19:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:59.782 true 00:12:59.782 04:19:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:12:59.782 04:19:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.716 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:00.716 04:19:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.716 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:00.716 04:19:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:00.716 04:19:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:00.974 true 00:13:00.974 04:19:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:00.974 04:19:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.232 04:19:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.490 04:19:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:01.490 04:19:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:01.748 true 00:13:01.748 04:19:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:01.748 04:19:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.681 04:19:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.940 04:19:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:02.940 04:19:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:03.198 true 00:13:03.198 04:19:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:03.198 04:19:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.456 04:19:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.714 04:19:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:03.714 04:19:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:03.972 true 00:13:03.972 04:19:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:03.972 04:19:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.230 04:19:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.488 04:19:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:04.488 04:19:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:04.746 true 00:13:04.746 04:19:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:04.746 04:19:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.680 04:19:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.680 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.939 04:19:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:05.939 04:19:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:06.197 true 00:13:06.197 04:19:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:06.197 04:19:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.455 04:19:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.714 04:19:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:06.714 04:19:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:06.972 true 00:13:06.973 04:19:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:06.973 04:19:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.907 04:19:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.907 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.164 04:19:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:08.164 04:19:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:08.164 true 00:13:08.421 04:19:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:08.421 04:19:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.679 04:19:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.938 04:19:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:08.938 04:19:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:08.938 true 00:13:09.196 04:19:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:09.196 04:19:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.132 Initializing NVMe Controllers 00:13:10.132 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:10.132 Controller IO queue size 128, less than required. 00:13:10.132 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:10.132 Controller IO queue size 128, less than required. 00:13:10.132 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:10.132 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:10.132 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:10.132 Initialization complete. Launching workers. 00:13:10.132 ======================================================== 00:13:10.132 Latency(us) 00:13:10.132 Device Information : IOPS MiB/s Average min max 00:13:10.132 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 656.23 0.32 93598.99 2357.26 1049127.49 00:13:10.132 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10904.93 5.32 11703.15 2755.74 446479.45 00:13:10.132 ======================================================== 00:13:10.132 Total : 11561.17 5.65 16351.71 2357.26 1049127.49 00:13:10.132 00:13:10.132 04:19:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.132 04:19:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:13:10.132 04:19:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:10.390 true 00:13:10.390 04:19:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3852824 00:13:10.390 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3852824) - No such process 00:13:10.390 04:19:47 -- target/ns_hotplug_stress.sh@53 -- # wait 3852824 00:13:10.390 04:19:47 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.648 04:19:47 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.907 04:19:48 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:10.907 04:19:48 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:10.907 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:10.907 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:10.907 04:19:48 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:11.165 null0 00:13:11.165 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:11.165 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:11.165 04:19:48 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:11.424 null1 00:13:11.424 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:11.424 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:11.424 04:19:48 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:11.681 null2 00:13:11.681 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:11.681 04:19:48 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:11.681 04:19:48 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:11.939 null3 00:13:11.939 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:11.939 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:11.939 04:19:49 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:12.196 null4 00:13:12.196 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:12.196 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:12.196 04:19:49 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:12.454 null5 00:13:12.454 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:12.454 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:12.454 04:19:49 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:12.712 null6 00:13:12.712 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:12.712 04:19:49 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:12.712 04:19:49 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:12.970 null7 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.970 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@66 -- # wait 3857115 3857116 3857117 3857120 3857122 3857124 3857126 3857128 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.971 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:13.229 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.488 04:19:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:13.746 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:13.746 04:19:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:13.746 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:13.746 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.746 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:13.746 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:13.746 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:13.746 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.005 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:14.263 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:14.263 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:14.263 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:14.263 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.263 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:14.521 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.521 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:14.521 04:19:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.779 04:19:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:15.038 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.296 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:15.554 04:19:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:15.812 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:15.813 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.813 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.813 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:15.813 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.813 04:19:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.813 04:19:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:16.071 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.330 04:19:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:16.588 04:19:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.847 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:17.105 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:17.105 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:17.105 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:17.105 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.105 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:17.105 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:17.105 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.363 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:17.621 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.621 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.621 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:17.621 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.621 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.621 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:17.621 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.622 04:19:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:17.880 04:19:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.137 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.138 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:18.138 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.138 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.138 04:19:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.395 04:19:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:18.654 04:19:55 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:18.654 04:19:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:18.654 04:19:55 -- nvmf/common.sh@116 -- # sync 00:13:18.654 04:19:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:18.654 04:19:55 -- nvmf/common.sh@119 -- # set +e 00:13:18.654 04:19:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:18.654 04:19:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:18.654 rmmod nvme_tcp 00:13:18.654 rmmod nvme_fabrics 00:13:18.654 rmmod nvme_keyring 00:13:18.654 04:19:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:18.654 04:19:55 -- nvmf/common.sh@123 -- # set -e 00:13:18.654 04:19:55 -- nvmf/common.sh@124 -- # return 0 00:13:18.654 04:19:55 -- nvmf/common.sh@477 -- # '[' -n 3852382 ']' 00:13:18.654 04:19:55 -- nvmf/common.sh@478 -- # killprocess 3852382 00:13:18.654 04:19:55 -- common/autotest_common.sh@936 -- # '[' -z 3852382 ']' 00:13:18.654 04:19:55 -- common/autotest_common.sh@940 -- # kill -0 3852382 00:13:18.654 04:19:55 -- common/autotest_common.sh@941 -- # uname 00:13:18.654 04:19:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:18.654 04:19:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3852382 00:13:18.654 04:19:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:18.654 04:19:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:18.654 04:19:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3852382' 00:13:18.654 killing process with pid 3852382 00:13:18.654 04:19:55 -- common/autotest_common.sh@955 -- # kill 3852382 00:13:18.654 04:19:55 -- common/autotest_common.sh@960 -- # wait 3852382 00:13:18.912 04:19:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:18.913 04:19:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:18.913 04:19:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:18.913 04:19:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:18.913 04:19:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:18.913 04:19:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:18.913 04:19:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:18.913 04:19:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:21.447 04:19:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:21.448 00:13:21.448 real 0m47.873s 00:13:21.448 user 3m38.831s 00:13:21.448 sys 0m15.333s 00:13:21.448 04:19:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:21.448 04:19:58 -- common/autotest_common.sh@10 -- # set +x 00:13:21.448 ************************************ 00:13:21.448 END TEST nvmf_ns_hotplug_stress 00:13:21.448 ************************************ 00:13:21.448 04:19:58 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:21.448 04:19:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:21.448 04:19:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:21.448 04:19:58 -- common/autotest_common.sh@10 -- # set +x 00:13:21.448 ************************************ 00:13:21.448 START TEST nvmf_connect_stress 00:13:21.448 ************************************ 00:13:21.448 04:19:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:21.448 * Looking for test storage... 00:13:21.448 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:21.448 04:19:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:21.448 04:19:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:21.448 04:19:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:21.448 04:19:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:21.448 04:19:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:21.448 04:19:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:21.448 04:19:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:21.448 04:19:58 -- scripts/common.sh@335 -- # IFS=.-: 00:13:21.448 04:19:58 -- scripts/common.sh@335 -- # read -ra ver1 00:13:21.448 04:19:58 -- scripts/common.sh@336 -- # IFS=.-: 00:13:21.448 04:19:58 -- scripts/common.sh@336 -- # read -ra ver2 00:13:21.448 04:19:58 -- scripts/common.sh@337 -- # local 'op=<' 00:13:21.448 04:19:58 -- scripts/common.sh@339 -- # ver1_l=2 00:13:21.448 04:19:58 -- scripts/common.sh@340 -- # ver2_l=1 00:13:21.448 04:19:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:21.448 04:19:58 -- scripts/common.sh@343 -- # case "$op" in 00:13:21.448 04:19:58 -- scripts/common.sh@344 -- # : 1 00:13:21.448 04:19:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:21.448 04:19:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:21.448 04:19:58 -- scripts/common.sh@364 -- # decimal 1 00:13:21.448 04:19:58 -- scripts/common.sh@352 -- # local d=1 00:13:21.448 04:19:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:21.448 04:19:58 -- scripts/common.sh@354 -- # echo 1 00:13:21.448 04:19:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:21.448 04:19:58 -- scripts/common.sh@365 -- # decimal 2 00:13:21.448 04:19:58 -- scripts/common.sh@352 -- # local d=2 00:13:21.448 04:19:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:21.448 04:19:58 -- scripts/common.sh@354 -- # echo 2 00:13:21.448 04:19:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:21.448 04:19:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:21.448 04:19:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:21.448 04:19:58 -- scripts/common.sh@367 -- # return 0 00:13:21.448 04:19:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:21.448 04:19:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:21.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.448 --rc genhtml_branch_coverage=1 00:13:21.448 --rc genhtml_function_coverage=1 00:13:21.448 --rc genhtml_legend=1 00:13:21.448 --rc geninfo_all_blocks=1 00:13:21.448 --rc geninfo_unexecuted_blocks=1 00:13:21.448 00:13:21.448 ' 00:13:21.448 04:19:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:21.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.448 --rc genhtml_branch_coverage=1 00:13:21.448 --rc genhtml_function_coverage=1 00:13:21.448 --rc genhtml_legend=1 00:13:21.448 --rc geninfo_all_blocks=1 00:13:21.448 --rc geninfo_unexecuted_blocks=1 00:13:21.448 00:13:21.448 ' 00:13:21.448 04:19:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:21.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.448 --rc genhtml_branch_coverage=1 00:13:21.448 --rc genhtml_function_coverage=1 00:13:21.448 --rc genhtml_legend=1 00:13:21.448 --rc geninfo_all_blocks=1 00:13:21.448 --rc geninfo_unexecuted_blocks=1 00:13:21.448 00:13:21.448 ' 00:13:21.448 04:19:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:21.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:21.448 --rc genhtml_branch_coverage=1 00:13:21.448 --rc genhtml_function_coverage=1 00:13:21.448 --rc genhtml_legend=1 00:13:21.448 --rc geninfo_all_blocks=1 00:13:21.448 --rc geninfo_unexecuted_blocks=1 00:13:21.448 00:13:21.448 ' 00:13:21.448 04:19:58 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:21.448 04:19:58 -- nvmf/common.sh@7 -- # uname -s 00:13:21.448 04:19:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:21.448 04:19:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:21.448 04:19:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:21.448 04:19:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:21.448 04:19:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:21.448 04:19:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:21.448 04:19:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:21.448 04:19:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:21.448 04:19:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:21.448 04:19:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:21.448 04:19:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:21.448 04:19:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:21.448 04:19:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:21.448 04:19:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:21.448 04:19:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:21.448 04:19:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:21.448 04:19:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:21.448 04:19:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:21.448 04:19:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:21.448 04:19:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.448 04:19:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.448 04:19:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.448 04:19:58 -- paths/export.sh@5 -- # export PATH 00:13:21.448 04:19:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:21.448 04:19:58 -- nvmf/common.sh@46 -- # : 0 00:13:21.448 04:19:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:21.448 04:19:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:21.448 04:19:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:21.448 04:19:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:21.448 04:19:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:21.448 04:19:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:21.448 04:19:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:21.448 04:19:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:21.448 04:19:58 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:21.448 04:19:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:21.448 04:19:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:21.448 04:19:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:21.448 04:19:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:21.448 04:19:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:21.448 04:19:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:21.448 04:19:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:21.448 04:19:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:21.448 04:19:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:21.448 04:19:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:21.448 04:19:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:21.448 04:19:58 -- common/autotest_common.sh@10 -- # set +x 00:13:23.351 04:20:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:23.351 04:20:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:23.351 04:20:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:23.351 04:20:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:23.351 04:20:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:23.351 04:20:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:23.351 04:20:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:23.351 04:20:00 -- nvmf/common.sh@294 -- # net_devs=() 00:13:23.351 04:20:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:23.351 04:20:00 -- nvmf/common.sh@295 -- # e810=() 00:13:23.351 04:20:00 -- nvmf/common.sh@295 -- # local -ga e810 00:13:23.351 04:20:00 -- nvmf/common.sh@296 -- # x722=() 00:13:23.351 04:20:00 -- nvmf/common.sh@296 -- # local -ga x722 00:13:23.351 04:20:00 -- nvmf/common.sh@297 -- # mlx=() 00:13:23.351 04:20:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:23.351 04:20:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:23.351 04:20:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:23.351 04:20:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:23.351 04:20:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:23.351 04:20:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:23.351 04:20:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:23.351 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:23.351 04:20:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:23.351 04:20:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:23.351 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:23.351 04:20:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:23.351 04:20:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:23.351 04:20:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:23.351 04:20:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:23.351 04:20:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:23.351 04:20:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:23.351 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:23.351 04:20:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:23.351 04:20:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:23.351 04:20:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:23.351 04:20:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:23.351 04:20:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:23.351 04:20:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:23.351 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:23.351 04:20:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:23.351 04:20:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:23.351 04:20:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:23.351 04:20:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:23.351 04:20:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:23.351 04:20:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:23.351 04:20:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:23.351 04:20:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:23.351 04:20:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:23.351 04:20:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:23.351 04:20:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:23.351 04:20:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:23.351 04:20:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:23.351 04:20:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:23.351 04:20:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:23.351 04:20:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:23.351 04:20:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:23.351 04:20:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:23.610 04:20:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:23.610 04:20:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:23.610 04:20:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:23.610 04:20:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:23.610 04:20:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:23.610 04:20:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:23.610 04:20:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:23.610 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:23.611 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:13:23.611 00:13:23.611 --- 10.0.0.2 ping statistics --- 00:13:23.611 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:23.611 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:13:23.611 04:20:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:23.611 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:23.611 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:13:23.611 00:13:23.611 --- 10.0.0.1 ping statistics --- 00:13:23.611 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:23.611 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:13:23.611 04:20:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:23.611 04:20:00 -- nvmf/common.sh@410 -- # return 0 00:13:23.611 04:20:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:23.611 04:20:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:23.611 04:20:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:23.611 04:20:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:23.611 04:20:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:23.611 04:20:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:23.611 04:20:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:23.611 04:20:00 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:23.611 04:20:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:23.611 04:20:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:23.611 04:20:00 -- common/autotest_common.sh@10 -- # set +x 00:13:23.611 04:20:00 -- nvmf/common.sh@469 -- # nvmfpid=3859915 00:13:23.611 04:20:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:23.611 04:20:00 -- nvmf/common.sh@470 -- # waitforlisten 3859915 00:13:23.611 04:20:00 -- common/autotest_common.sh@829 -- # '[' -z 3859915 ']' 00:13:23.611 04:20:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:23.611 04:20:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:23.611 04:20:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:23.611 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:23.611 04:20:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:23.611 04:20:00 -- common/autotest_common.sh@10 -- # set +x 00:13:23.611 [2024-11-28 04:20:00.806597] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:23.611 [2024-11-28 04:20:00.806674] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:23.611 EAL: No free 2048 kB hugepages reported on node 1 00:13:23.611 [2024-11-28 04:20:00.872662] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:23.869 [2024-11-28 04:20:00.983749] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:23.869 [2024-11-28 04:20:00.983905] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:23.869 [2024-11-28 04:20:00.983922] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:23.869 [2024-11-28 04:20:00.983935] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:23.869 [2024-11-28 04:20:00.983990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:23.869 [2024-11-28 04:20:00.984050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:23.869 [2024-11-28 04:20:00.984053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:24.800 04:20:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:24.800 04:20:01 -- common/autotest_common.sh@862 -- # return 0 00:13:24.800 04:20:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:24.800 04:20:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:24.800 04:20:01 -- common/autotest_common.sh@10 -- # set +x 00:13:24.800 04:20:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:24.800 04:20:01 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:24.800 04:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.800 04:20:01 -- common/autotest_common.sh@10 -- # set +x 00:13:24.800 [2024-11-28 04:20:01.803532] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:24.800 04:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.800 04:20:01 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:24.800 04:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.800 04:20:01 -- common/autotest_common.sh@10 -- # set +x 00:13:24.800 04:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.800 04:20:01 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:24.800 04:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.801 04:20:01 -- common/autotest_common.sh@10 -- # set +x 00:13:24.801 [2024-11-28 04:20:01.837714] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:24.801 04:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.801 04:20:01 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:24.801 04:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.801 04:20:01 -- common/autotest_common.sh@10 -- # set +x 00:13:24.801 NULL1 00:13:24.801 04:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.801 04:20:01 -- target/connect_stress.sh@21 -- # PERF_PID=3860073 00:13:24.801 04:20:01 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:24.801 04:20:01 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:24.801 04:20:01 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 EAL: No free 2048 kB hugepages reported on node 1 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:24.801 04:20:01 -- target/connect_stress.sh@28 -- # cat 00:13:24.801 04:20:01 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:24.801 04:20:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.801 04:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.801 04:20:01 -- common/autotest_common.sh@10 -- # set +x 00:13:25.060 04:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.060 04:20:02 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:25.060 04:20:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.060 04:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.060 04:20:02 -- common/autotest_common.sh@10 -- # set +x 00:13:25.359 04:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.359 04:20:02 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:25.359 04:20:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.359 04:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.359 04:20:02 -- common/autotest_common.sh@10 -- # set +x 00:13:25.641 04:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.641 04:20:02 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:25.641 04:20:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.641 04:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.641 04:20:02 -- common/autotest_common.sh@10 -- # set +x 00:13:25.899 04:20:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.899 04:20:03 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:25.899 04:20:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.899 04:20:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.899 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:13:26.465 04:20:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.465 04:20:03 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:26.465 04:20:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.465 04:20:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.465 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:13:26.723 04:20:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.723 04:20:03 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:26.723 04:20:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.723 04:20:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.723 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:13:26.980 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.980 04:20:04 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:26.980 04:20:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.980 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.980 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:27.245 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.245 04:20:04 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:27.245 04:20:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.245 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.245 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:27.503 04:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.503 04:20:04 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:27.503 04:20:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.503 04:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.503 04:20:04 -- common/autotest_common.sh@10 -- # set +x 00:13:28.067 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.067 04:20:05 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:28.067 04:20:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.067 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.067 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:13:28.325 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.325 04:20:05 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:28.325 04:20:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.325 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.325 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:13:28.583 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.583 04:20:05 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:28.583 04:20:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.583 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.583 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:13:28.840 04:20:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.840 04:20:06 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:28.840 04:20:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.840 04:20:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.840 04:20:06 -- common/autotest_common.sh@10 -- # set +x 00:13:29.097 04:20:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.097 04:20:06 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:29.097 04:20:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.097 04:20:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.097 04:20:06 -- common/autotest_common.sh@10 -- # set +x 00:13:29.660 04:20:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.660 04:20:06 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:29.660 04:20:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.660 04:20:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.660 04:20:06 -- common/autotest_common.sh@10 -- # set +x 00:13:29.916 04:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.916 04:20:07 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:29.916 04:20:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.916 04:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.916 04:20:07 -- common/autotest_common.sh@10 -- # set +x 00:13:30.173 04:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.173 04:20:07 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:30.173 04:20:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.173 04:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.173 04:20:07 -- common/autotest_common.sh@10 -- # set +x 00:13:30.429 04:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.429 04:20:07 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:30.429 04:20:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.429 04:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.429 04:20:07 -- common/autotest_common.sh@10 -- # set +x 00:13:30.994 04:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.994 04:20:08 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:30.994 04:20:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.994 04:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.994 04:20:08 -- common/autotest_common.sh@10 -- # set +x 00:13:31.252 04:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.252 04:20:08 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:31.252 04:20:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.252 04:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.252 04:20:08 -- common/autotest_common.sh@10 -- # set +x 00:13:31.510 04:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.510 04:20:08 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:31.510 04:20:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.510 04:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.510 04:20:08 -- common/autotest_common.sh@10 -- # set +x 00:13:31.767 04:20:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.767 04:20:08 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:31.767 04:20:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.767 04:20:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.767 04:20:08 -- common/autotest_common.sh@10 -- # set +x 00:13:32.025 04:20:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.025 04:20:09 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:32.025 04:20:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.025 04:20:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.025 04:20:09 -- common/autotest_common.sh@10 -- # set +x 00:13:32.591 04:20:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.591 04:20:09 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:32.591 04:20:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.591 04:20:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.591 04:20:09 -- common/autotest_common.sh@10 -- # set +x 00:13:32.849 04:20:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.849 04:20:09 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:32.849 04:20:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.849 04:20:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.849 04:20:09 -- common/autotest_common.sh@10 -- # set +x 00:13:33.107 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.107 04:20:10 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:33.107 04:20:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.107 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.107 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.365 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.365 04:20:10 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:33.365 04:20:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.365 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.365 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.623 04:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.623 04:20:10 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:33.623 04:20:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.623 04:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.623 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:13:34.188 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.188 04:20:11 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:34.188 04:20:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.188 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.188 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:13:34.445 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.445 04:20:11 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:34.445 04:20:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.445 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.445 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:13:34.703 04:20:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.703 04:20:11 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:34.703 04:20:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.703 04:20:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.703 04:20:11 -- common/autotest_common.sh@10 -- # set +x 00:13:34.703 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:34.961 04:20:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.961 04:20:12 -- target/connect_stress.sh@34 -- # kill -0 3860073 00:13:34.961 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3860073) - No such process 00:13:34.961 04:20:12 -- target/connect_stress.sh@38 -- # wait 3860073 00:13:34.961 04:20:12 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:34.961 04:20:12 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:34.961 04:20:12 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:34.961 04:20:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:34.961 04:20:12 -- nvmf/common.sh@116 -- # sync 00:13:34.961 04:20:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:34.961 04:20:12 -- nvmf/common.sh@119 -- # set +e 00:13:34.961 04:20:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:34.961 04:20:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:34.961 rmmod nvme_tcp 00:13:34.961 rmmod nvme_fabrics 00:13:34.961 rmmod nvme_keyring 00:13:34.961 04:20:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:34.961 04:20:12 -- nvmf/common.sh@123 -- # set -e 00:13:34.961 04:20:12 -- nvmf/common.sh@124 -- # return 0 00:13:34.961 04:20:12 -- nvmf/common.sh@477 -- # '[' -n 3859915 ']' 00:13:34.961 04:20:12 -- nvmf/common.sh@478 -- # killprocess 3859915 00:13:34.961 04:20:12 -- common/autotest_common.sh@936 -- # '[' -z 3859915 ']' 00:13:34.961 04:20:12 -- common/autotest_common.sh@940 -- # kill -0 3859915 00:13:34.961 04:20:12 -- common/autotest_common.sh@941 -- # uname 00:13:34.961 04:20:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:34.961 04:20:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3859915 00:13:35.220 04:20:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:35.220 04:20:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:35.220 04:20:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3859915' 00:13:35.220 killing process with pid 3859915 00:13:35.220 04:20:12 -- common/autotest_common.sh@955 -- # kill 3859915 00:13:35.220 04:20:12 -- common/autotest_common.sh@960 -- # wait 3859915 00:13:35.479 04:20:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:35.479 04:20:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:35.479 04:20:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:35.479 04:20:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:35.479 04:20:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:35.479 04:20:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.479 04:20:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:35.479 04:20:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.383 04:20:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:37.383 00:13:37.383 real 0m16.288s 00:13:37.383 user 0m40.947s 00:13:37.383 sys 0m5.724s 00:13:37.383 04:20:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:37.383 04:20:14 -- common/autotest_common.sh@10 -- # set +x 00:13:37.383 ************************************ 00:13:37.383 END TEST nvmf_connect_stress 00:13:37.383 ************************************ 00:13:37.383 04:20:14 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:37.383 04:20:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:37.383 04:20:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:37.383 04:20:14 -- common/autotest_common.sh@10 -- # set +x 00:13:37.383 ************************************ 00:13:37.383 START TEST nvmf_fused_ordering 00:13:37.383 ************************************ 00:13:37.383 04:20:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:37.383 * Looking for test storage... 00:13:37.383 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:37.383 04:20:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:37.383 04:20:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:37.383 04:20:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:37.641 04:20:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:37.641 04:20:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:37.641 04:20:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:37.641 04:20:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:37.641 04:20:14 -- scripts/common.sh@335 -- # IFS=.-: 00:13:37.641 04:20:14 -- scripts/common.sh@335 -- # read -ra ver1 00:13:37.641 04:20:14 -- scripts/common.sh@336 -- # IFS=.-: 00:13:37.641 04:20:14 -- scripts/common.sh@336 -- # read -ra ver2 00:13:37.641 04:20:14 -- scripts/common.sh@337 -- # local 'op=<' 00:13:37.641 04:20:14 -- scripts/common.sh@339 -- # ver1_l=2 00:13:37.641 04:20:14 -- scripts/common.sh@340 -- # ver2_l=1 00:13:37.641 04:20:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:37.641 04:20:14 -- scripts/common.sh@343 -- # case "$op" in 00:13:37.641 04:20:14 -- scripts/common.sh@344 -- # : 1 00:13:37.641 04:20:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:37.641 04:20:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:37.641 04:20:14 -- scripts/common.sh@364 -- # decimal 1 00:13:37.641 04:20:14 -- scripts/common.sh@352 -- # local d=1 00:13:37.641 04:20:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:37.641 04:20:14 -- scripts/common.sh@354 -- # echo 1 00:13:37.641 04:20:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:37.641 04:20:14 -- scripts/common.sh@365 -- # decimal 2 00:13:37.641 04:20:14 -- scripts/common.sh@352 -- # local d=2 00:13:37.641 04:20:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:37.641 04:20:14 -- scripts/common.sh@354 -- # echo 2 00:13:37.641 04:20:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:37.641 04:20:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:37.641 04:20:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:37.641 04:20:14 -- scripts/common.sh@367 -- # return 0 00:13:37.641 04:20:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:37.641 04:20:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:37.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.641 --rc genhtml_branch_coverage=1 00:13:37.641 --rc genhtml_function_coverage=1 00:13:37.641 --rc genhtml_legend=1 00:13:37.641 --rc geninfo_all_blocks=1 00:13:37.641 --rc geninfo_unexecuted_blocks=1 00:13:37.641 00:13:37.641 ' 00:13:37.641 04:20:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:37.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.641 --rc genhtml_branch_coverage=1 00:13:37.641 --rc genhtml_function_coverage=1 00:13:37.641 --rc genhtml_legend=1 00:13:37.641 --rc geninfo_all_blocks=1 00:13:37.641 --rc geninfo_unexecuted_blocks=1 00:13:37.641 00:13:37.641 ' 00:13:37.641 04:20:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:37.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.641 --rc genhtml_branch_coverage=1 00:13:37.641 --rc genhtml_function_coverage=1 00:13:37.641 --rc genhtml_legend=1 00:13:37.641 --rc geninfo_all_blocks=1 00:13:37.641 --rc geninfo_unexecuted_blocks=1 00:13:37.641 00:13:37.641 ' 00:13:37.641 04:20:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:37.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.641 --rc genhtml_branch_coverage=1 00:13:37.641 --rc genhtml_function_coverage=1 00:13:37.641 --rc genhtml_legend=1 00:13:37.641 --rc geninfo_all_blocks=1 00:13:37.641 --rc geninfo_unexecuted_blocks=1 00:13:37.641 00:13:37.641 ' 00:13:37.641 04:20:14 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:37.641 04:20:14 -- nvmf/common.sh@7 -- # uname -s 00:13:37.641 04:20:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:37.641 04:20:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:37.641 04:20:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:37.641 04:20:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:37.641 04:20:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:37.641 04:20:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:37.641 04:20:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:37.641 04:20:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:37.641 04:20:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:37.641 04:20:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:37.641 04:20:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.641 04:20:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.641 04:20:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:37.641 04:20:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:37.641 04:20:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:37.641 04:20:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:37.641 04:20:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:37.641 04:20:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:37.641 04:20:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:37.641 04:20:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.642 04:20:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.642 04:20:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.642 04:20:14 -- paths/export.sh@5 -- # export PATH 00:13:37.642 04:20:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.642 04:20:14 -- nvmf/common.sh@46 -- # : 0 00:13:37.642 04:20:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:37.642 04:20:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:37.642 04:20:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:37.642 04:20:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:37.642 04:20:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:37.642 04:20:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:37.642 04:20:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:37.642 04:20:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:37.642 04:20:14 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:37.642 04:20:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:37.642 04:20:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:37.642 04:20:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:37.642 04:20:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:37.642 04:20:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:37.642 04:20:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.642 04:20:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.642 04:20:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.642 04:20:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:37.642 04:20:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:37.642 04:20:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:37.642 04:20:14 -- common/autotest_common.sh@10 -- # set +x 00:13:39.542 04:20:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:39.542 04:20:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:39.542 04:20:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:39.542 04:20:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:39.542 04:20:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:39.542 04:20:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:39.542 04:20:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:39.542 04:20:16 -- nvmf/common.sh@294 -- # net_devs=() 00:13:39.542 04:20:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:39.542 04:20:16 -- nvmf/common.sh@295 -- # e810=() 00:13:39.542 04:20:16 -- nvmf/common.sh@295 -- # local -ga e810 00:13:39.542 04:20:16 -- nvmf/common.sh@296 -- # x722=() 00:13:39.542 04:20:16 -- nvmf/common.sh@296 -- # local -ga x722 00:13:39.542 04:20:16 -- nvmf/common.sh@297 -- # mlx=() 00:13:39.542 04:20:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:39.542 04:20:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:39.542 04:20:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:39.542 04:20:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:39.542 04:20:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:39.542 04:20:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.542 04:20:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:39.542 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:39.542 04:20:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.542 04:20:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:39.542 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:39.542 04:20:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:39.542 04:20:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:39.542 04:20:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.542 04:20:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.542 04:20:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.542 04:20:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.542 04:20:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:39.542 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:39.542 04:20:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.542 04:20:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.543 04:20:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.543 04:20:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.543 04:20:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.543 04:20:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:39.543 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:39.543 04:20:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.543 04:20:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:39.543 04:20:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:39.543 04:20:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:39.543 04:20:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:39.543 04:20:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:39.543 04:20:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:39.543 04:20:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:39.543 04:20:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:39.543 04:20:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:39.543 04:20:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:39.543 04:20:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:39.543 04:20:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:39.543 04:20:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:39.543 04:20:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:39.543 04:20:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:39.543 04:20:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:39.543 04:20:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:39.543 04:20:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:39.543 04:20:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:39.543 04:20:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:39.801 04:20:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:39.801 04:20:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:39.801 04:20:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:39.801 04:20:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:39.801 04:20:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:39.801 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:39.801 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:13:39.801 00:13:39.801 --- 10.0.0.2 ping statistics --- 00:13:39.801 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.801 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:13:39.801 04:20:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:39.801 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:39.801 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:13:39.801 00:13:39.801 --- 10.0.0.1 ping statistics --- 00:13:39.801 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.801 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:13:39.801 04:20:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:39.801 04:20:16 -- nvmf/common.sh@410 -- # return 0 00:13:39.801 04:20:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:39.801 04:20:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:39.801 04:20:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:39.801 04:20:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:39.801 04:20:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:39.801 04:20:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:39.801 04:20:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:39.801 04:20:16 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:39.801 04:20:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:39.802 04:20:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:39.802 04:20:16 -- common/autotest_common.sh@10 -- # set +x 00:13:39.802 04:20:16 -- nvmf/common.sh@469 -- # nvmfpid=3863279 00:13:39.802 04:20:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:39.802 04:20:16 -- nvmf/common.sh@470 -- # waitforlisten 3863279 00:13:39.802 04:20:16 -- common/autotest_common.sh@829 -- # '[' -z 3863279 ']' 00:13:39.802 04:20:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:39.802 04:20:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:39.802 04:20:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:39.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:39.802 04:20:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:39.802 04:20:16 -- common/autotest_common.sh@10 -- # set +x 00:13:39.802 [2024-11-28 04:20:16.977477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:39.802 [2024-11-28 04:20:16.977583] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:39.802 EAL: No free 2048 kB hugepages reported on node 1 00:13:39.802 [2024-11-28 04:20:17.043405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:40.060 [2024-11-28 04:20:17.162215] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:40.060 [2024-11-28 04:20:17.162380] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:40.060 [2024-11-28 04:20:17.162400] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:40.060 [2024-11-28 04:20:17.162415] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:40.060 [2024-11-28 04:20:17.162445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:40.994 04:20:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:40.994 04:20:17 -- common/autotest_common.sh@862 -- # return 0 00:13:40.994 04:20:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:40.994 04:20:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:40.994 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:13:40.994 04:20:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:40.994 04:20:17 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:40.994 04:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.994 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:13:40.994 [2024-11-28 04:20:17.971240] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:40.994 04:20:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.994 04:20:17 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:40.994 04:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.994 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:13:40.994 04:20:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.994 04:20:17 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:40.994 04:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.994 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:13:40.994 [2024-11-28 04:20:17.987403] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:40.994 04:20:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.994 04:20:17 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:40.994 04:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.994 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:13:40.994 NULL1 00:13:40.994 04:20:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.994 04:20:17 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:40.994 04:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.994 04:20:17 -- common/autotest_common.sh@10 -- # set +x 00:13:40.994 04:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.994 04:20:18 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:40.994 04:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.994 04:20:18 -- common/autotest_common.sh@10 -- # set +x 00:13:40.994 04:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.994 04:20:18 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:40.994 [2024-11-28 04:20:18.032136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:40.994 [2024-11-28 04:20:18.032175] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3863436 ] 00:13:40.994 EAL: No free 2048 kB hugepages reported on node 1 00:13:41.252 Attached to nqn.2016-06.io.spdk:cnode1 00:13:41.252 Namespace ID: 1 size: 1GB 00:13:41.252 fused_ordering(0) 00:13:41.252 fused_ordering(1) 00:13:41.252 fused_ordering(2) 00:13:41.252 fused_ordering(3) 00:13:41.252 fused_ordering(4) 00:13:41.252 fused_ordering(5) 00:13:41.252 fused_ordering(6) 00:13:41.252 fused_ordering(7) 00:13:41.252 fused_ordering(8) 00:13:41.252 fused_ordering(9) 00:13:41.252 fused_ordering(10) 00:13:41.252 fused_ordering(11) 00:13:41.252 fused_ordering(12) 00:13:41.252 fused_ordering(13) 00:13:41.252 fused_ordering(14) 00:13:41.252 fused_ordering(15) 00:13:41.252 fused_ordering(16) 00:13:41.252 fused_ordering(17) 00:13:41.252 fused_ordering(18) 00:13:41.252 fused_ordering(19) 00:13:41.252 fused_ordering(20) 00:13:41.252 fused_ordering(21) 00:13:41.252 fused_ordering(22) 00:13:41.252 fused_ordering(23) 00:13:41.252 fused_ordering(24) 00:13:41.252 fused_ordering(25) 00:13:41.252 fused_ordering(26) 00:13:41.252 fused_ordering(27) 00:13:41.252 fused_ordering(28) 00:13:41.252 fused_ordering(29) 00:13:41.252 fused_ordering(30) 00:13:41.252 fused_ordering(31) 00:13:41.252 fused_ordering(32) 00:13:41.252 fused_ordering(33) 00:13:41.252 fused_ordering(34) 00:13:41.252 fused_ordering(35) 00:13:41.252 fused_ordering(36) 00:13:41.252 fused_ordering(37) 00:13:41.252 fused_ordering(38) 00:13:41.252 fused_ordering(39) 00:13:41.252 fused_ordering(40) 00:13:41.252 fused_ordering(41) 00:13:41.252 fused_ordering(42) 00:13:41.252 fused_ordering(43) 00:13:41.252 fused_ordering(44) 00:13:41.252 fused_ordering(45) 00:13:41.252 fused_ordering(46) 00:13:41.252 fused_ordering(47) 00:13:41.252 fused_ordering(48) 00:13:41.252 fused_ordering(49) 00:13:41.252 fused_ordering(50) 00:13:41.252 fused_ordering(51) 00:13:41.252 fused_ordering(52) 00:13:41.252 fused_ordering(53) 00:13:41.252 fused_ordering(54) 00:13:41.252 fused_ordering(55) 00:13:41.252 fused_ordering(56) 00:13:41.252 fused_ordering(57) 00:13:41.252 fused_ordering(58) 00:13:41.252 fused_ordering(59) 00:13:41.252 fused_ordering(60) 00:13:41.252 fused_ordering(61) 00:13:41.252 fused_ordering(62) 00:13:41.252 fused_ordering(63) 00:13:41.252 fused_ordering(64) 00:13:41.252 fused_ordering(65) 00:13:41.252 fused_ordering(66) 00:13:41.252 fused_ordering(67) 00:13:41.252 fused_ordering(68) 00:13:41.252 fused_ordering(69) 00:13:41.252 fused_ordering(70) 00:13:41.252 fused_ordering(71) 00:13:41.252 fused_ordering(72) 00:13:41.252 fused_ordering(73) 00:13:41.252 fused_ordering(74) 00:13:41.252 fused_ordering(75) 00:13:41.252 fused_ordering(76) 00:13:41.252 fused_ordering(77) 00:13:41.252 fused_ordering(78) 00:13:41.252 fused_ordering(79) 00:13:41.252 fused_ordering(80) 00:13:41.252 fused_ordering(81) 00:13:41.252 fused_ordering(82) 00:13:41.252 fused_ordering(83) 00:13:41.252 fused_ordering(84) 00:13:41.252 fused_ordering(85) 00:13:41.252 fused_ordering(86) 00:13:41.253 fused_ordering(87) 00:13:41.253 fused_ordering(88) 00:13:41.253 fused_ordering(89) 00:13:41.253 fused_ordering(90) 00:13:41.253 fused_ordering(91) 00:13:41.253 fused_ordering(92) 00:13:41.253 fused_ordering(93) 00:13:41.253 fused_ordering(94) 00:13:41.253 fused_ordering(95) 00:13:41.253 fused_ordering(96) 00:13:41.253 fused_ordering(97) 00:13:41.253 fused_ordering(98) 00:13:41.253 fused_ordering(99) 00:13:41.253 fused_ordering(100) 00:13:41.253 fused_ordering(101) 00:13:41.253 fused_ordering(102) 00:13:41.253 fused_ordering(103) 00:13:41.253 fused_ordering(104) 00:13:41.253 fused_ordering(105) 00:13:41.253 fused_ordering(106) 00:13:41.253 fused_ordering(107) 00:13:41.253 fused_ordering(108) 00:13:41.253 fused_ordering(109) 00:13:41.253 fused_ordering(110) 00:13:41.253 fused_ordering(111) 00:13:41.253 fused_ordering(112) 00:13:41.253 fused_ordering(113) 00:13:41.253 fused_ordering(114) 00:13:41.253 fused_ordering(115) 00:13:41.253 fused_ordering(116) 00:13:41.253 fused_ordering(117) 00:13:41.253 fused_ordering(118) 00:13:41.253 fused_ordering(119) 00:13:41.253 fused_ordering(120) 00:13:41.253 fused_ordering(121) 00:13:41.253 fused_ordering(122) 00:13:41.253 fused_ordering(123) 00:13:41.253 fused_ordering(124) 00:13:41.253 fused_ordering(125) 00:13:41.253 fused_ordering(126) 00:13:41.253 fused_ordering(127) 00:13:41.253 fused_ordering(128) 00:13:41.253 fused_ordering(129) 00:13:41.253 fused_ordering(130) 00:13:41.253 fused_ordering(131) 00:13:41.253 fused_ordering(132) 00:13:41.253 fused_ordering(133) 00:13:41.253 fused_ordering(134) 00:13:41.253 fused_ordering(135) 00:13:41.253 fused_ordering(136) 00:13:41.253 fused_ordering(137) 00:13:41.253 fused_ordering(138) 00:13:41.253 fused_ordering(139) 00:13:41.253 fused_ordering(140) 00:13:41.253 fused_ordering(141) 00:13:41.253 fused_ordering(142) 00:13:41.253 fused_ordering(143) 00:13:41.253 fused_ordering(144) 00:13:41.253 fused_ordering(145) 00:13:41.253 fused_ordering(146) 00:13:41.253 fused_ordering(147) 00:13:41.253 fused_ordering(148) 00:13:41.253 fused_ordering(149) 00:13:41.253 fused_ordering(150) 00:13:41.253 fused_ordering(151) 00:13:41.253 fused_ordering(152) 00:13:41.253 fused_ordering(153) 00:13:41.253 fused_ordering(154) 00:13:41.253 fused_ordering(155) 00:13:41.253 fused_ordering(156) 00:13:41.253 fused_ordering(157) 00:13:41.253 fused_ordering(158) 00:13:41.253 fused_ordering(159) 00:13:41.253 fused_ordering(160) 00:13:41.253 fused_ordering(161) 00:13:41.253 fused_ordering(162) 00:13:41.253 fused_ordering(163) 00:13:41.253 fused_ordering(164) 00:13:41.253 fused_ordering(165) 00:13:41.253 fused_ordering(166) 00:13:41.253 fused_ordering(167) 00:13:41.253 fused_ordering(168) 00:13:41.253 fused_ordering(169) 00:13:41.253 fused_ordering(170) 00:13:41.253 fused_ordering(171) 00:13:41.253 fused_ordering(172) 00:13:41.253 fused_ordering(173) 00:13:41.253 fused_ordering(174) 00:13:41.253 fused_ordering(175) 00:13:41.253 fused_ordering(176) 00:13:41.253 fused_ordering(177) 00:13:41.253 fused_ordering(178) 00:13:41.253 fused_ordering(179) 00:13:41.253 fused_ordering(180) 00:13:41.253 fused_ordering(181) 00:13:41.253 fused_ordering(182) 00:13:41.253 fused_ordering(183) 00:13:41.253 fused_ordering(184) 00:13:41.253 fused_ordering(185) 00:13:41.253 fused_ordering(186) 00:13:41.253 fused_ordering(187) 00:13:41.253 fused_ordering(188) 00:13:41.253 fused_ordering(189) 00:13:41.253 fused_ordering(190) 00:13:41.253 fused_ordering(191) 00:13:41.253 fused_ordering(192) 00:13:41.253 fused_ordering(193) 00:13:41.253 fused_ordering(194) 00:13:41.253 fused_ordering(195) 00:13:41.253 fused_ordering(196) 00:13:41.253 fused_ordering(197) 00:13:41.253 fused_ordering(198) 00:13:41.253 fused_ordering(199) 00:13:41.253 fused_ordering(200) 00:13:41.253 fused_ordering(201) 00:13:41.253 fused_ordering(202) 00:13:41.253 fused_ordering(203) 00:13:41.253 fused_ordering(204) 00:13:41.253 fused_ordering(205) 00:13:41.819 fused_ordering(206) 00:13:41.819 fused_ordering(207) 00:13:41.819 fused_ordering(208) 00:13:41.819 fused_ordering(209) 00:13:41.819 fused_ordering(210) 00:13:41.819 fused_ordering(211) 00:13:41.819 fused_ordering(212) 00:13:41.819 fused_ordering(213) 00:13:41.819 fused_ordering(214) 00:13:41.819 fused_ordering(215) 00:13:41.819 fused_ordering(216) 00:13:41.819 fused_ordering(217) 00:13:41.819 fused_ordering(218) 00:13:41.819 fused_ordering(219) 00:13:41.819 fused_ordering(220) 00:13:41.819 fused_ordering(221) 00:13:41.819 fused_ordering(222) 00:13:41.819 fused_ordering(223) 00:13:41.819 fused_ordering(224) 00:13:41.819 fused_ordering(225) 00:13:41.819 fused_ordering(226) 00:13:41.819 fused_ordering(227) 00:13:41.819 fused_ordering(228) 00:13:41.819 fused_ordering(229) 00:13:41.819 fused_ordering(230) 00:13:41.819 fused_ordering(231) 00:13:41.819 fused_ordering(232) 00:13:41.819 fused_ordering(233) 00:13:41.819 fused_ordering(234) 00:13:41.819 fused_ordering(235) 00:13:41.819 fused_ordering(236) 00:13:41.819 fused_ordering(237) 00:13:41.819 fused_ordering(238) 00:13:41.819 fused_ordering(239) 00:13:41.819 fused_ordering(240) 00:13:41.819 fused_ordering(241) 00:13:41.819 fused_ordering(242) 00:13:41.819 fused_ordering(243) 00:13:41.819 fused_ordering(244) 00:13:41.819 fused_ordering(245) 00:13:41.819 fused_ordering(246) 00:13:41.819 fused_ordering(247) 00:13:41.819 fused_ordering(248) 00:13:41.819 fused_ordering(249) 00:13:41.819 fused_ordering(250) 00:13:41.819 fused_ordering(251) 00:13:41.819 fused_ordering(252) 00:13:41.819 fused_ordering(253) 00:13:41.819 fused_ordering(254) 00:13:41.819 fused_ordering(255) 00:13:41.819 fused_ordering(256) 00:13:41.819 fused_ordering(257) 00:13:41.819 fused_ordering(258) 00:13:41.819 fused_ordering(259) 00:13:41.819 fused_ordering(260) 00:13:41.819 fused_ordering(261) 00:13:41.819 fused_ordering(262) 00:13:41.819 fused_ordering(263) 00:13:41.819 fused_ordering(264) 00:13:41.819 fused_ordering(265) 00:13:41.819 fused_ordering(266) 00:13:41.819 fused_ordering(267) 00:13:41.819 fused_ordering(268) 00:13:41.819 fused_ordering(269) 00:13:41.819 fused_ordering(270) 00:13:41.819 fused_ordering(271) 00:13:41.819 fused_ordering(272) 00:13:41.819 fused_ordering(273) 00:13:41.819 fused_ordering(274) 00:13:41.819 fused_ordering(275) 00:13:41.819 fused_ordering(276) 00:13:41.819 fused_ordering(277) 00:13:41.819 fused_ordering(278) 00:13:41.819 fused_ordering(279) 00:13:41.819 fused_ordering(280) 00:13:41.819 fused_ordering(281) 00:13:41.819 fused_ordering(282) 00:13:41.819 fused_ordering(283) 00:13:41.819 fused_ordering(284) 00:13:41.819 fused_ordering(285) 00:13:41.819 fused_ordering(286) 00:13:41.819 fused_ordering(287) 00:13:41.819 fused_ordering(288) 00:13:41.819 fused_ordering(289) 00:13:41.819 fused_ordering(290) 00:13:41.819 fused_ordering(291) 00:13:41.819 fused_ordering(292) 00:13:41.819 fused_ordering(293) 00:13:41.819 fused_ordering(294) 00:13:41.819 fused_ordering(295) 00:13:41.819 fused_ordering(296) 00:13:41.819 fused_ordering(297) 00:13:41.819 fused_ordering(298) 00:13:41.819 fused_ordering(299) 00:13:41.819 fused_ordering(300) 00:13:41.819 fused_ordering(301) 00:13:41.819 fused_ordering(302) 00:13:41.819 fused_ordering(303) 00:13:41.819 fused_ordering(304) 00:13:41.819 fused_ordering(305) 00:13:41.819 fused_ordering(306) 00:13:41.819 fused_ordering(307) 00:13:41.819 fused_ordering(308) 00:13:41.819 fused_ordering(309) 00:13:41.819 fused_ordering(310) 00:13:41.819 fused_ordering(311) 00:13:41.819 fused_ordering(312) 00:13:41.819 fused_ordering(313) 00:13:41.819 fused_ordering(314) 00:13:41.819 fused_ordering(315) 00:13:41.819 fused_ordering(316) 00:13:41.819 fused_ordering(317) 00:13:41.819 fused_ordering(318) 00:13:41.819 fused_ordering(319) 00:13:41.819 fused_ordering(320) 00:13:41.819 fused_ordering(321) 00:13:41.819 fused_ordering(322) 00:13:41.819 fused_ordering(323) 00:13:41.819 fused_ordering(324) 00:13:41.819 fused_ordering(325) 00:13:41.819 fused_ordering(326) 00:13:41.819 fused_ordering(327) 00:13:41.819 fused_ordering(328) 00:13:41.819 fused_ordering(329) 00:13:41.819 fused_ordering(330) 00:13:41.819 fused_ordering(331) 00:13:41.819 fused_ordering(332) 00:13:41.819 fused_ordering(333) 00:13:41.819 fused_ordering(334) 00:13:41.819 fused_ordering(335) 00:13:41.819 fused_ordering(336) 00:13:41.819 fused_ordering(337) 00:13:41.819 fused_ordering(338) 00:13:41.819 fused_ordering(339) 00:13:41.819 fused_ordering(340) 00:13:41.819 fused_ordering(341) 00:13:41.819 fused_ordering(342) 00:13:41.819 fused_ordering(343) 00:13:41.819 fused_ordering(344) 00:13:41.819 fused_ordering(345) 00:13:41.819 fused_ordering(346) 00:13:41.819 fused_ordering(347) 00:13:41.819 fused_ordering(348) 00:13:41.819 fused_ordering(349) 00:13:41.819 fused_ordering(350) 00:13:41.819 fused_ordering(351) 00:13:41.819 fused_ordering(352) 00:13:41.819 fused_ordering(353) 00:13:41.819 fused_ordering(354) 00:13:41.819 fused_ordering(355) 00:13:41.819 fused_ordering(356) 00:13:41.819 fused_ordering(357) 00:13:41.819 fused_ordering(358) 00:13:41.819 fused_ordering(359) 00:13:41.819 fused_ordering(360) 00:13:41.819 fused_ordering(361) 00:13:41.819 fused_ordering(362) 00:13:41.819 fused_ordering(363) 00:13:41.819 fused_ordering(364) 00:13:41.819 fused_ordering(365) 00:13:41.819 fused_ordering(366) 00:13:41.819 fused_ordering(367) 00:13:41.819 fused_ordering(368) 00:13:41.819 fused_ordering(369) 00:13:41.819 fused_ordering(370) 00:13:41.819 fused_ordering(371) 00:13:41.819 fused_ordering(372) 00:13:41.819 fused_ordering(373) 00:13:41.819 fused_ordering(374) 00:13:41.819 fused_ordering(375) 00:13:41.819 fused_ordering(376) 00:13:41.819 fused_ordering(377) 00:13:41.819 fused_ordering(378) 00:13:41.819 fused_ordering(379) 00:13:41.819 fused_ordering(380) 00:13:41.819 fused_ordering(381) 00:13:41.819 fused_ordering(382) 00:13:41.819 fused_ordering(383) 00:13:41.819 fused_ordering(384) 00:13:41.819 fused_ordering(385) 00:13:41.819 fused_ordering(386) 00:13:41.819 fused_ordering(387) 00:13:41.819 fused_ordering(388) 00:13:41.819 fused_ordering(389) 00:13:41.819 fused_ordering(390) 00:13:41.819 fused_ordering(391) 00:13:41.819 fused_ordering(392) 00:13:41.819 fused_ordering(393) 00:13:41.819 fused_ordering(394) 00:13:41.819 fused_ordering(395) 00:13:41.819 fused_ordering(396) 00:13:41.819 fused_ordering(397) 00:13:41.819 fused_ordering(398) 00:13:41.819 fused_ordering(399) 00:13:41.819 fused_ordering(400) 00:13:41.819 fused_ordering(401) 00:13:41.819 fused_ordering(402) 00:13:41.819 fused_ordering(403) 00:13:41.819 fused_ordering(404) 00:13:41.819 fused_ordering(405) 00:13:41.819 fused_ordering(406) 00:13:41.819 fused_ordering(407) 00:13:41.819 fused_ordering(408) 00:13:41.819 fused_ordering(409) 00:13:41.819 fused_ordering(410) 00:13:42.077 fused_ordering(411) 00:13:42.077 fused_ordering(412) 00:13:42.077 fused_ordering(413) 00:13:42.077 fused_ordering(414) 00:13:42.077 fused_ordering(415) 00:13:42.077 fused_ordering(416) 00:13:42.077 fused_ordering(417) 00:13:42.077 fused_ordering(418) 00:13:42.077 fused_ordering(419) 00:13:42.077 fused_ordering(420) 00:13:42.077 fused_ordering(421) 00:13:42.077 fused_ordering(422) 00:13:42.077 fused_ordering(423) 00:13:42.077 fused_ordering(424) 00:13:42.077 fused_ordering(425) 00:13:42.077 fused_ordering(426) 00:13:42.077 fused_ordering(427) 00:13:42.077 fused_ordering(428) 00:13:42.077 fused_ordering(429) 00:13:42.077 fused_ordering(430) 00:13:42.077 fused_ordering(431) 00:13:42.077 fused_ordering(432) 00:13:42.077 fused_ordering(433) 00:13:42.077 fused_ordering(434) 00:13:42.077 fused_ordering(435) 00:13:42.077 fused_ordering(436) 00:13:42.077 fused_ordering(437) 00:13:42.077 fused_ordering(438) 00:13:42.077 fused_ordering(439) 00:13:42.077 fused_ordering(440) 00:13:42.077 fused_ordering(441) 00:13:42.077 fused_ordering(442) 00:13:42.077 fused_ordering(443) 00:13:42.077 fused_ordering(444) 00:13:42.077 fused_ordering(445) 00:13:42.077 fused_ordering(446) 00:13:42.077 fused_ordering(447) 00:13:42.077 fused_ordering(448) 00:13:42.077 fused_ordering(449) 00:13:42.077 fused_ordering(450) 00:13:42.077 fused_ordering(451) 00:13:42.077 fused_ordering(452) 00:13:42.077 fused_ordering(453) 00:13:42.077 fused_ordering(454) 00:13:42.077 fused_ordering(455) 00:13:42.077 fused_ordering(456) 00:13:42.077 fused_ordering(457) 00:13:42.077 fused_ordering(458) 00:13:42.077 fused_ordering(459) 00:13:42.077 fused_ordering(460) 00:13:42.078 fused_ordering(461) 00:13:42.078 fused_ordering(462) 00:13:42.078 fused_ordering(463) 00:13:42.078 fused_ordering(464) 00:13:42.078 fused_ordering(465) 00:13:42.078 fused_ordering(466) 00:13:42.078 fused_ordering(467) 00:13:42.078 fused_ordering(468) 00:13:42.078 fused_ordering(469) 00:13:42.078 fused_ordering(470) 00:13:42.078 fused_ordering(471) 00:13:42.078 fused_ordering(472) 00:13:42.078 fused_ordering(473) 00:13:42.078 fused_ordering(474) 00:13:42.078 fused_ordering(475) 00:13:42.078 fused_ordering(476) 00:13:42.078 fused_ordering(477) 00:13:42.078 fused_ordering(478) 00:13:42.078 fused_ordering(479) 00:13:42.078 fused_ordering(480) 00:13:42.078 fused_ordering(481) 00:13:42.078 fused_ordering(482) 00:13:42.078 fused_ordering(483) 00:13:42.078 fused_ordering(484) 00:13:42.078 fused_ordering(485) 00:13:42.078 fused_ordering(486) 00:13:42.078 fused_ordering(487) 00:13:42.078 fused_ordering(488) 00:13:42.078 fused_ordering(489) 00:13:42.078 fused_ordering(490) 00:13:42.078 fused_ordering(491) 00:13:42.078 fused_ordering(492) 00:13:42.078 fused_ordering(493) 00:13:42.078 fused_ordering(494) 00:13:42.078 fused_ordering(495) 00:13:42.078 fused_ordering(496) 00:13:42.078 fused_ordering(497) 00:13:42.078 fused_ordering(498) 00:13:42.078 fused_ordering(499) 00:13:42.078 fused_ordering(500) 00:13:42.078 fused_ordering(501) 00:13:42.078 fused_ordering(502) 00:13:42.078 fused_ordering(503) 00:13:42.078 fused_ordering(504) 00:13:42.078 fused_ordering(505) 00:13:42.078 fused_ordering(506) 00:13:42.078 fused_ordering(507) 00:13:42.078 fused_ordering(508) 00:13:42.078 fused_ordering(509) 00:13:42.078 fused_ordering(510) 00:13:42.078 fused_ordering(511) 00:13:42.078 fused_ordering(512) 00:13:42.078 fused_ordering(513) 00:13:42.078 fused_ordering(514) 00:13:42.078 fused_ordering(515) 00:13:42.078 fused_ordering(516) 00:13:42.078 fused_ordering(517) 00:13:42.078 fused_ordering(518) 00:13:42.078 fused_ordering(519) 00:13:42.078 fused_ordering(520) 00:13:42.078 fused_ordering(521) 00:13:42.078 fused_ordering(522) 00:13:42.078 fused_ordering(523) 00:13:42.078 fused_ordering(524) 00:13:42.078 fused_ordering(525) 00:13:42.078 fused_ordering(526) 00:13:42.078 fused_ordering(527) 00:13:42.078 fused_ordering(528) 00:13:42.078 fused_ordering(529) 00:13:42.078 fused_ordering(530) 00:13:42.078 fused_ordering(531) 00:13:42.078 fused_ordering(532) 00:13:42.078 fused_ordering(533) 00:13:42.078 fused_ordering(534) 00:13:42.078 fused_ordering(535) 00:13:42.078 fused_ordering(536) 00:13:42.078 fused_ordering(537) 00:13:42.078 fused_ordering(538) 00:13:42.078 fused_ordering(539) 00:13:42.078 fused_ordering(540) 00:13:42.078 fused_ordering(541) 00:13:42.078 fused_ordering(542) 00:13:42.078 fused_ordering(543) 00:13:42.078 fused_ordering(544) 00:13:42.078 fused_ordering(545) 00:13:42.078 fused_ordering(546) 00:13:42.078 fused_ordering(547) 00:13:42.078 fused_ordering(548) 00:13:42.078 fused_ordering(549) 00:13:42.078 fused_ordering(550) 00:13:42.078 fused_ordering(551) 00:13:42.078 fused_ordering(552) 00:13:42.078 fused_ordering(553) 00:13:42.078 fused_ordering(554) 00:13:42.078 fused_ordering(555) 00:13:42.078 fused_ordering(556) 00:13:42.078 fused_ordering(557) 00:13:42.078 fused_ordering(558) 00:13:42.078 fused_ordering(559) 00:13:42.078 fused_ordering(560) 00:13:42.078 fused_ordering(561) 00:13:42.078 fused_ordering(562) 00:13:42.078 fused_ordering(563) 00:13:42.078 fused_ordering(564) 00:13:42.078 fused_ordering(565) 00:13:42.078 fused_ordering(566) 00:13:42.078 fused_ordering(567) 00:13:42.078 fused_ordering(568) 00:13:42.078 fused_ordering(569) 00:13:42.078 fused_ordering(570) 00:13:42.078 fused_ordering(571) 00:13:42.078 fused_ordering(572) 00:13:42.078 fused_ordering(573) 00:13:42.078 fused_ordering(574) 00:13:42.078 fused_ordering(575) 00:13:42.078 fused_ordering(576) 00:13:42.078 fused_ordering(577) 00:13:42.078 fused_ordering(578) 00:13:42.078 fused_ordering(579) 00:13:42.078 fused_ordering(580) 00:13:42.078 fused_ordering(581) 00:13:42.078 fused_ordering(582) 00:13:42.078 fused_ordering(583) 00:13:42.078 fused_ordering(584) 00:13:42.078 fused_ordering(585) 00:13:42.078 fused_ordering(586) 00:13:42.078 fused_ordering(587) 00:13:42.078 fused_ordering(588) 00:13:42.078 fused_ordering(589) 00:13:42.078 fused_ordering(590) 00:13:42.078 fused_ordering(591) 00:13:42.078 fused_ordering(592) 00:13:42.078 fused_ordering(593) 00:13:42.078 fused_ordering(594) 00:13:42.078 fused_ordering(595) 00:13:42.078 fused_ordering(596) 00:13:42.078 fused_ordering(597) 00:13:42.078 fused_ordering(598) 00:13:42.078 fused_ordering(599) 00:13:42.078 fused_ordering(600) 00:13:42.078 fused_ordering(601) 00:13:42.078 fused_ordering(602) 00:13:42.078 fused_ordering(603) 00:13:42.078 fused_ordering(604) 00:13:42.078 fused_ordering(605) 00:13:42.078 fused_ordering(606) 00:13:42.078 fused_ordering(607) 00:13:42.078 fused_ordering(608) 00:13:42.078 fused_ordering(609) 00:13:42.078 fused_ordering(610) 00:13:42.078 fused_ordering(611) 00:13:42.078 fused_ordering(612) 00:13:42.078 fused_ordering(613) 00:13:42.078 fused_ordering(614) 00:13:42.078 fused_ordering(615) 00:13:43.011 fused_ordering(616) 00:13:43.011 fused_ordering(617) 00:13:43.011 fused_ordering(618) 00:13:43.012 fused_ordering(619) 00:13:43.012 fused_ordering(620) 00:13:43.012 fused_ordering(621) 00:13:43.012 fused_ordering(622) 00:13:43.012 fused_ordering(623) 00:13:43.012 fused_ordering(624) 00:13:43.012 fused_ordering(625) 00:13:43.012 fused_ordering(626) 00:13:43.012 fused_ordering(627) 00:13:43.012 fused_ordering(628) 00:13:43.012 fused_ordering(629) 00:13:43.012 fused_ordering(630) 00:13:43.012 fused_ordering(631) 00:13:43.012 fused_ordering(632) 00:13:43.012 fused_ordering(633) 00:13:43.012 fused_ordering(634) 00:13:43.012 fused_ordering(635) 00:13:43.012 fused_ordering(636) 00:13:43.012 fused_ordering(637) 00:13:43.012 fused_ordering(638) 00:13:43.012 fused_ordering(639) 00:13:43.012 fused_ordering(640) 00:13:43.012 fused_ordering(641) 00:13:43.012 fused_ordering(642) 00:13:43.012 fused_ordering(643) 00:13:43.012 fused_ordering(644) 00:13:43.012 fused_ordering(645) 00:13:43.012 fused_ordering(646) 00:13:43.012 fused_ordering(647) 00:13:43.012 fused_ordering(648) 00:13:43.012 fused_ordering(649) 00:13:43.012 fused_ordering(650) 00:13:43.012 fused_ordering(651) 00:13:43.012 fused_ordering(652) 00:13:43.012 fused_ordering(653) 00:13:43.012 fused_ordering(654) 00:13:43.012 fused_ordering(655) 00:13:43.012 fused_ordering(656) 00:13:43.012 fused_ordering(657) 00:13:43.012 fused_ordering(658) 00:13:43.012 fused_ordering(659) 00:13:43.012 fused_ordering(660) 00:13:43.012 fused_ordering(661) 00:13:43.012 fused_ordering(662) 00:13:43.012 fused_ordering(663) 00:13:43.012 fused_ordering(664) 00:13:43.012 fused_ordering(665) 00:13:43.012 fused_ordering(666) 00:13:43.012 fused_ordering(667) 00:13:43.012 fused_ordering(668) 00:13:43.012 fused_ordering(669) 00:13:43.012 fused_ordering(670) 00:13:43.012 fused_ordering(671) 00:13:43.012 fused_ordering(672) 00:13:43.012 fused_ordering(673) 00:13:43.012 fused_ordering(674) 00:13:43.012 fused_ordering(675) 00:13:43.012 fused_ordering(676) 00:13:43.012 fused_ordering(677) 00:13:43.012 fused_ordering(678) 00:13:43.012 fused_ordering(679) 00:13:43.012 fused_ordering(680) 00:13:43.012 fused_ordering(681) 00:13:43.012 fused_ordering(682) 00:13:43.012 fused_ordering(683) 00:13:43.012 fused_ordering(684) 00:13:43.012 fused_ordering(685) 00:13:43.012 fused_ordering(686) 00:13:43.012 fused_ordering(687) 00:13:43.012 fused_ordering(688) 00:13:43.012 fused_ordering(689) 00:13:43.012 fused_ordering(690) 00:13:43.012 fused_ordering(691) 00:13:43.012 fused_ordering(692) 00:13:43.012 fused_ordering(693) 00:13:43.012 fused_ordering(694) 00:13:43.012 fused_ordering(695) 00:13:43.012 fused_ordering(696) 00:13:43.012 fused_ordering(697) 00:13:43.012 fused_ordering(698) 00:13:43.012 fused_ordering(699) 00:13:43.012 fused_ordering(700) 00:13:43.012 fused_ordering(701) 00:13:43.012 fused_ordering(702) 00:13:43.012 fused_ordering(703) 00:13:43.012 fused_ordering(704) 00:13:43.012 fused_ordering(705) 00:13:43.012 fused_ordering(706) 00:13:43.012 fused_ordering(707) 00:13:43.012 fused_ordering(708) 00:13:43.012 fused_ordering(709) 00:13:43.012 fused_ordering(710) 00:13:43.012 fused_ordering(711) 00:13:43.012 fused_ordering(712) 00:13:43.012 fused_ordering(713) 00:13:43.012 fused_ordering(714) 00:13:43.012 fused_ordering(715) 00:13:43.012 fused_ordering(716) 00:13:43.012 fused_ordering(717) 00:13:43.012 fused_ordering(718) 00:13:43.012 fused_ordering(719) 00:13:43.012 fused_ordering(720) 00:13:43.012 fused_ordering(721) 00:13:43.012 fused_ordering(722) 00:13:43.012 fused_ordering(723) 00:13:43.012 fused_ordering(724) 00:13:43.012 fused_ordering(725) 00:13:43.012 fused_ordering(726) 00:13:43.012 fused_ordering(727) 00:13:43.012 fused_ordering(728) 00:13:43.012 fused_ordering(729) 00:13:43.012 fused_ordering(730) 00:13:43.012 fused_ordering(731) 00:13:43.012 fused_ordering(732) 00:13:43.012 fused_ordering(733) 00:13:43.012 fused_ordering(734) 00:13:43.012 fused_ordering(735) 00:13:43.012 fused_ordering(736) 00:13:43.012 fused_ordering(737) 00:13:43.012 fused_ordering(738) 00:13:43.012 fused_ordering(739) 00:13:43.012 fused_ordering(740) 00:13:43.012 fused_ordering(741) 00:13:43.012 fused_ordering(742) 00:13:43.012 fused_ordering(743) 00:13:43.012 fused_ordering(744) 00:13:43.012 fused_ordering(745) 00:13:43.012 fused_ordering(746) 00:13:43.012 fused_ordering(747) 00:13:43.012 fused_ordering(748) 00:13:43.012 fused_ordering(749) 00:13:43.012 fused_ordering(750) 00:13:43.012 fused_ordering(751) 00:13:43.012 fused_ordering(752) 00:13:43.012 fused_ordering(753) 00:13:43.012 fused_ordering(754) 00:13:43.012 fused_ordering(755) 00:13:43.012 fused_ordering(756) 00:13:43.012 fused_ordering(757) 00:13:43.012 fused_ordering(758) 00:13:43.012 fused_ordering(759) 00:13:43.012 fused_ordering(760) 00:13:43.012 fused_ordering(761) 00:13:43.012 fused_ordering(762) 00:13:43.012 fused_ordering(763) 00:13:43.012 fused_ordering(764) 00:13:43.012 fused_ordering(765) 00:13:43.012 fused_ordering(766) 00:13:43.012 fused_ordering(767) 00:13:43.012 fused_ordering(768) 00:13:43.012 fused_ordering(769) 00:13:43.012 fused_ordering(770) 00:13:43.012 fused_ordering(771) 00:13:43.012 fused_ordering(772) 00:13:43.012 fused_ordering(773) 00:13:43.012 fused_ordering(774) 00:13:43.012 fused_ordering(775) 00:13:43.012 fused_ordering(776) 00:13:43.012 fused_ordering(777) 00:13:43.012 fused_ordering(778) 00:13:43.012 fused_ordering(779) 00:13:43.012 fused_ordering(780) 00:13:43.012 fused_ordering(781) 00:13:43.012 fused_ordering(782) 00:13:43.012 fused_ordering(783) 00:13:43.012 fused_ordering(784) 00:13:43.012 fused_ordering(785) 00:13:43.012 fused_ordering(786) 00:13:43.012 fused_ordering(787) 00:13:43.012 fused_ordering(788) 00:13:43.012 fused_ordering(789) 00:13:43.012 fused_ordering(790) 00:13:43.012 fused_ordering(791) 00:13:43.012 fused_ordering(792) 00:13:43.012 fused_ordering(793) 00:13:43.012 fused_ordering(794) 00:13:43.012 fused_ordering(795) 00:13:43.012 fused_ordering(796) 00:13:43.012 fused_ordering(797) 00:13:43.012 fused_ordering(798) 00:13:43.012 fused_ordering(799) 00:13:43.012 fused_ordering(800) 00:13:43.012 fused_ordering(801) 00:13:43.012 fused_ordering(802) 00:13:43.012 fused_ordering(803) 00:13:43.012 fused_ordering(804) 00:13:43.012 fused_ordering(805) 00:13:43.012 fused_ordering(806) 00:13:43.012 fused_ordering(807) 00:13:43.012 fused_ordering(808) 00:13:43.012 fused_ordering(809) 00:13:43.012 fused_ordering(810) 00:13:43.012 fused_ordering(811) 00:13:43.012 fused_ordering(812) 00:13:43.012 fused_ordering(813) 00:13:43.012 fused_ordering(814) 00:13:43.012 fused_ordering(815) 00:13:43.012 fused_ordering(816) 00:13:43.012 fused_ordering(817) 00:13:43.012 fused_ordering(818) 00:13:43.012 fused_ordering(819) 00:13:43.012 fused_ordering(820) 00:13:43.578 fused_ordering(821) 00:13:43.578 fused_ordering(822) 00:13:43.578 fused_ordering(823) 00:13:43.578 fused_ordering(824) 00:13:43.578 fused_ordering(825) 00:13:43.578 fused_ordering(826) 00:13:43.578 fused_ordering(827) 00:13:43.578 fused_ordering(828) 00:13:43.578 fused_ordering(829) 00:13:43.578 fused_ordering(830) 00:13:43.578 fused_ordering(831) 00:13:43.578 fused_ordering(832) 00:13:43.578 fused_ordering(833) 00:13:43.578 fused_ordering(834) 00:13:43.578 fused_ordering(835) 00:13:43.578 fused_ordering(836) 00:13:43.578 fused_ordering(837) 00:13:43.578 fused_ordering(838) 00:13:43.578 fused_ordering(839) 00:13:43.578 fused_ordering(840) 00:13:43.578 fused_ordering(841) 00:13:43.578 fused_ordering(842) 00:13:43.578 fused_ordering(843) 00:13:43.578 fused_ordering(844) 00:13:43.578 fused_ordering(845) 00:13:43.578 fused_ordering(846) 00:13:43.578 fused_ordering(847) 00:13:43.578 fused_ordering(848) 00:13:43.578 fused_ordering(849) 00:13:43.579 fused_ordering(850) 00:13:43.579 fused_ordering(851) 00:13:43.579 fused_ordering(852) 00:13:43.579 fused_ordering(853) 00:13:43.579 fused_ordering(854) 00:13:43.579 fused_ordering(855) 00:13:43.579 fused_ordering(856) 00:13:43.579 fused_ordering(857) 00:13:43.579 fused_ordering(858) 00:13:43.579 fused_ordering(859) 00:13:43.579 fused_ordering(860) 00:13:43.579 fused_ordering(861) 00:13:43.579 fused_ordering(862) 00:13:43.579 fused_ordering(863) 00:13:43.579 fused_ordering(864) 00:13:43.579 fused_ordering(865) 00:13:43.579 fused_ordering(866) 00:13:43.579 fused_ordering(867) 00:13:43.579 fused_ordering(868) 00:13:43.579 fused_ordering(869) 00:13:43.579 fused_ordering(870) 00:13:43.579 fused_ordering(871) 00:13:43.579 fused_ordering(872) 00:13:43.579 fused_ordering(873) 00:13:43.579 fused_ordering(874) 00:13:43.579 fused_ordering(875) 00:13:43.579 fused_ordering(876) 00:13:43.579 fused_ordering(877) 00:13:43.579 fused_ordering(878) 00:13:43.579 fused_ordering(879) 00:13:43.579 fused_ordering(880) 00:13:43.579 fused_ordering(881) 00:13:43.579 fused_ordering(882) 00:13:43.579 fused_ordering(883) 00:13:43.579 fused_ordering(884) 00:13:43.579 fused_ordering(885) 00:13:43.579 fused_ordering(886) 00:13:43.579 fused_ordering(887) 00:13:43.579 fused_ordering(888) 00:13:43.579 fused_ordering(889) 00:13:43.579 fused_ordering(890) 00:13:43.579 fused_ordering(891) 00:13:43.579 fused_ordering(892) 00:13:43.579 fused_ordering(893) 00:13:43.579 fused_ordering(894) 00:13:43.579 fused_ordering(895) 00:13:43.579 fused_ordering(896) 00:13:43.579 fused_ordering(897) 00:13:43.579 fused_ordering(898) 00:13:43.579 fused_ordering(899) 00:13:43.579 fused_ordering(900) 00:13:43.579 fused_ordering(901) 00:13:43.579 fused_ordering(902) 00:13:43.579 fused_ordering(903) 00:13:43.579 fused_ordering(904) 00:13:43.579 fused_ordering(905) 00:13:43.579 fused_ordering(906) 00:13:43.579 fused_ordering(907) 00:13:43.579 fused_ordering(908) 00:13:43.579 fused_ordering(909) 00:13:43.579 fused_ordering(910) 00:13:43.579 fused_ordering(911) 00:13:43.579 fused_ordering(912) 00:13:43.579 fused_ordering(913) 00:13:43.579 fused_ordering(914) 00:13:43.579 fused_ordering(915) 00:13:43.579 fused_ordering(916) 00:13:43.579 fused_ordering(917) 00:13:43.579 fused_ordering(918) 00:13:43.579 fused_ordering(919) 00:13:43.579 fused_ordering(920) 00:13:43.579 fused_ordering(921) 00:13:43.579 fused_ordering(922) 00:13:43.579 fused_ordering(923) 00:13:43.579 fused_ordering(924) 00:13:43.579 fused_ordering(925) 00:13:43.579 fused_ordering(926) 00:13:43.579 fused_ordering(927) 00:13:43.579 fused_ordering(928) 00:13:43.579 fused_ordering(929) 00:13:43.579 fused_ordering(930) 00:13:43.579 fused_ordering(931) 00:13:43.579 fused_ordering(932) 00:13:43.579 fused_ordering(933) 00:13:43.579 fused_ordering(934) 00:13:43.579 fused_ordering(935) 00:13:43.579 fused_ordering(936) 00:13:43.579 fused_ordering(937) 00:13:43.579 fused_ordering(938) 00:13:43.579 fused_ordering(939) 00:13:43.579 fused_ordering(940) 00:13:43.579 fused_ordering(941) 00:13:43.579 fused_ordering(942) 00:13:43.579 fused_ordering(943) 00:13:43.579 fused_ordering(944) 00:13:43.579 fused_ordering(945) 00:13:43.579 fused_ordering(946) 00:13:43.579 fused_ordering(947) 00:13:43.579 fused_ordering(948) 00:13:43.579 fused_ordering(949) 00:13:43.579 fused_ordering(950) 00:13:43.579 fused_ordering(951) 00:13:43.579 fused_ordering(952) 00:13:43.579 fused_ordering(953) 00:13:43.579 fused_ordering(954) 00:13:43.579 fused_ordering(955) 00:13:43.579 fused_ordering(956) 00:13:43.579 fused_ordering(957) 00:13:43.579 fused_ordering(958) 00:13:43.579 fused_ordering(959) 00:13:43.579 fused_ordering(960) 00:13:43.579 fused_ordering(961) 00:13:43.579 fused_ordering(962) 00:13:43.579 fused_ordering(963) 00:13:43.579 fused_ordering(964) 00:13:43.579 fused_ordering(965) 00:13:43.579 fused_ordering(966) 00:13:43.579 fused_ordering(967) 00:13:43.579 fused_ordering(968) 00:13:43.579 fused_ordering(969) 00:13:43.579 fused_ordering(970) 00:13:43.579 fused_ordering(971) 00:13:43.579 fused_ordering(972) 00:13:43.579 fused_ordering(973) 00:13:43.579 fused_ordering(974) 00:13:43.579 fused_ordering(975) 00:13:43.579 fused_ordering(976) 00:13:43.579 fused_ordering(977) 00:13:43.579 fused_ordering(978) 00:13:43.579 fused_ordering(979) 00:13:43.579 fused_ordering(980) 00:13:43.579 fused_ordering(981) 00:13:43.579 fused_ordering(982) 00:13:43.579 fused_ordering(983) 00:13:43.579 fused_ordering(984) 00:13:43.579 fused_ordering(985) 00:13:43.579 fused_ordering(986) 00:13:43.579 fused_ordering(987) 00:13:43.579 fused_ordering(988) 00:13:43.579 fused_ordering(989) 00:13:43.579 fused_ordering(990) 00:13:43.579 fused_ordering(991) 00:13:43.579 fused_ordering(992) 00:13:43.579 fused_ordering(993) 00:13:43.579 fused_ordering(994) 00:13:43.579 fused_ordering(995) 00:13:43.579 fused_ordering(996) 00:13:43.579 fused_ordering(997) 00:13:43.579 fused_ordering(998) 00:13:43.579 fused_ordering(999) 00:13:43.579 fused_ordering(1000) 00:13:43.579 fused_ordering(1001) 00:13:43.579 fused_ordering(1002) 00:13:43.579 fused_ordering(1003) 00:13:43.579 fused_ordering(1004) 00:13:43.579 fused_ordering(1005) 00:13:43.579 fused_ordering(1006) 00:13:43.579 fused_ordering(1007) 00:13:43.579 fused_ordering(1008) 00:13:43.579 fused_ordering(1009) 00:13:43.579 fused_ordering(1010) 00:13:43.579 fused_ordering(1011) 00:13:43.579 fused_ordering(1012) 00:13:43.579 fused_ordering(1013) 00:13:43.579 fused_ordering(1014) 00:13:43.579 fused_ordering(1015) 00:13:43.579 fused_ordering(1016) 00:13:43.579 fused_ordering(1017) 00:13:43.579 fused_ordering(1018) 00:13:43.579 fused_ordering(1019) 00:13:43.579 fused_ordering(1020) 00:13:43.579 fused_ordering(1021) 00:13:43.579 fused_ordering(1022) 00:13:43.579 fused_ordering(1023) 00:13:43.579 04:20:20 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:43.579 04:20:20 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:43.579 04:20:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:43.579 04:20:20 -- nvmf/common.sh@116 -- # sync 00:13:43.579 04:20:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:43.579 04:20:20 -- nvmf/common.sh@119 -- # set +e 00:13:43.579 04:20:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:43.579 04:20:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:43.579 rmmod nvme_tcp 00:13:43.579 rmmod nvme_fabrics 00:13:43.579 rmmod nvme_keyring 00:13:43.579 04:20:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:43.579 04:20:20 -- nvmf/common.sh@123 -- # set -e 00:13:43.579 04:20:20 -- nvmf/common.sh@124 -- # return 0 00:13:43.579 04:20:20 -- nvmf/common.sh@477 -- # '[' -n 3863279 ']' 00:13:43.579 04:20:20 -- nvmf/common.sh@478 -- # killprocess 3863279 00:13:43.579 04:20:20 -- common/autotest_common.sh@936 -- # '[' -z 3863279 ']' 00:13:43.579 04:20:20 -- common/autotest_common.sh@940 -- # kill -0 3863279 00:13:43.579 04:20:20 -- common/autotest_common.sh@941 -- # uname 00:13:43.579 04:20:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:43.579 04:20:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3863279 00:13:43.579 04:20:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:43.579 04:20:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:43.579 04:20:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3863279' 00:13:43.579 killing process with pid 3863279 00:13:43.579 04:20:20 -- common/autotest_common.sh@955 -- # kill 3863279 00:13:43.579 04:20:20 -- common/autotest_common.sh@960 -- # wait 3863279 00:13:44.147 04:20:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.147 04:20:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.147 04:20:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.147 04:20:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.147 04:20:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.147 04:20:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.147 04:20:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.147 04:20:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.049 04:20:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:46.049 00:13:46.049 real 0m8.598s 00:13:46.049 user 0m6.329s 00:13:46.049 sys 0m3.592s 00:13:46.049 04:20:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:46.049 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:13:46.049 ************************************ 00:13:46.049 END TEST nvmf_fused_ordering 00:13:46.049 ************************************ 00:13:46.049 04:20:23 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:46.049 04:20:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:46.049 04:20:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:46.049 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:13:46.049 ************************************ 00:13:46.049 START TEST nvmf_delete_subsystem 00:13:46.049 ************************************ 00:13:46.049 04:20:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:46.049 * Looking for test storage... 00:13:46.049 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:46.049 04:20:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:46.049 04:20:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:46.049 04:20:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:46.049 04:20:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:46.049 04:20:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:46.049 04:20:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:46.049 04:20:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:46.049 04:20:23 -- scripts/common.sh@335 -- # IFS=.-: 00:13:46.049 04:20:23 -- scripts/common.sh@335 -- # read -ra ver1 00:13:46.049 04:20:23 -- scripts/common.sh@336 -- # IFS=.-: 00:13:46.049 04:20:23 -- scripts/common.sh@336 -- # read -ra ver2 00:13:46.049 04:20:23 -- scripts/common.sh@337 -- # local 'op=<' 00:13:46.049 04:20:23 -- scripts/common.sh@339 -- # ver1_l=2 00:13:46.049 04:20:23 -- scripts/common.sh@340 -- # ver2_l=1 00:13:46.049 04:20:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:46.049 04:20:23 -- scripts/common.sh@343 -- # case "$op" in 00:13:46.049 04:20:23 -- scripts/common.sh@344 -- # : 1 00:13:46.049 04:20:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:46.049 04:20:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:46.049 04:20:23 -- scripts/common.sh@364 -- # decimal 1 00:13:46.049 04:20:23 -- scripts/common.sh@352 -- # local d=1 00:13:46.049 04:20:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:46.049 04:20:23 -- scripts/common.sh@354 -- # echo 1 00:13:46.049 04:20:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:46.049 04:20:23 -- scripts/common.sh@365 -- # decimal 2 00:13:46.049 04:20:23 -- scripts/common.sh@352 -- # local d=2 00:13:46.049 04:20:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:46.049 04:20:23 -- scripts/common.sh@354 -- # echo 2 00:13:46.049 04:20:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:46.049 04:20:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:46.049 04:20:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:46.049 04:20:23 -- scripts/common.sh@367 -- # return 0 00:13:46.049 04:20:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:46.049 04:20:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:46.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.049 --rc genhtml_branch_coverage=1 00:13:46.049 --rc genhtml_function_coverage=1 00:13:46.049 --rc genhtml_legend=1 00:13:46.049 --rc geninfo_all_blocks=1 00:13:46.049 --rc geninfo_unexecuted_blocks=1 00:13:46.049 00:13:46.049 ' 00:13:46.049 04:20:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:46.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.049 --rc genhtml_branch_coverage=1 00:13:46.049 --rc genhtml_function_coverage=1 00:13:46.049 --rc genhtml_legend=1 00:13:46.049 --rc geninfo_all_blocks=1 00:13:46.049 --rc geninfo_unexecuted_blocks=1 00:13:46.049 00:13:46.049 ' 00:13:46.049 04:20:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:46.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.049 --rc genhtml_branch_coverage=1 00:13:46.049 --rc genhtml_function_coverage=1 00:13:46.049 --rc genhtml_legend=1 00:13:46.049 --rc geninfo_all_blocks=1 00:13:46.049 --rc geninfo_unexecuted_blocks=1 00:13:46.049 00:13:46.049 ' 00:13:46.049 04:20:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:46.049 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.049 --rc genhtml_branch_coverage=1 00:13:46.049 --rc genhtml_function_coverage=1 00:13:46.049 --rc genhtml_legend=1 00:13:46.049 --rc geninfo_all_blocks=1 00:13:46.049 --rc geninfo_unexecuted_blocks=1 00:13:46.049 00:13:46.049 ' 00:13:46.049 04:20:23 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:46.049 04:20:23 -- nvmf/common.sh@7 -- # uname -s 00:13:46.049 04:20:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:46.049 04:20:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:46.049 04:20:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:46.049 04:20:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:46.049 04:20:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:46.049 04:20:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:46.049 04:20:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:46.049 04:20:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:46.049 04:20:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:46.049 04:20:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:46.049 04:20:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.049 04:20:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.050 04:20:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:46.050 04:20:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:46.050 04:20:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:46.308 04:20:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:46.308 04:20:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:46.308 04:20:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:46.308 04:20:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:46.308 04:20:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.308 04:20:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.308 04:20:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.308 04:20:23 -- paths/export.sh@5 -- # export PATH 00:13:46.308 04:20:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.308 04:20:23 -- nvmf/common.sh@46 -- # : 0 00:13:46.308 04:20:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:46.308 04:20:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:46.308 04:20:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:46.308 04:20:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:46.308 04:20:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:46.308 04:20:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:46.308 04:20:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:46.308 04:20:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:46.308 04:20:23 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:46.308 04:20:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:46.308 04:20:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:46.308 04:20:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:46.308 04:20:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:46.308 04:20:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:46.308 04:20:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.308 04:20:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.308 04:20:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.308 04:20:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:46.308 04:20:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:46.308 04:20:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:46.308 04:20:23 -- common/autotest_common.sh@10 -- # set +x 00:13:48.208 04:20:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:48.208 04:20:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:48.208 04:20:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:48.208 04:20:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:48.208 04:20:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:48.208 04:20:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:48.208 04:20:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:48.208 04:20:25 -- nvmf/common.sh@294 -- # net_devs=() 00:13:48.208 04:20:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:48.208 04:20:25 -- nvmf/common.sh@295 -- # e810=() 00:13:48.208 04:20:25 -- nvmf/common.sh@295 -- # local -ga e810 00:13:48.208 04:20:25 -- nvmf/common.sh@296 -- # x722=() 00:13:48.208 04:20:25 -- nvmf/common.sh@296 -- # local -ga x722 00:13:48.208 04:20:25 -- nvmf/common.sh@297 -- # mlx=() 00:13:48.208 04:20:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:48.208 04:20:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:48.208 04:20:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:48.208 04:20:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:48.208 04:20:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:48.208 04:20:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.208 04:20:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:48.208 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:48.208 04:20:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.208 04:20:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:48.208 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:48.208 04:20:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:48.208 04:20:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.208 04:20:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.208 04:20:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.208 04:20:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.208 04:20:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:48.208 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:48.208 04:20:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.208 04:20:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.208 04:20:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.208 04:20:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.208 04:20:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.208 04:20:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:48.208 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:48.208 04:20:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.208 04:20:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:48.208 04:20:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:48.208 04:20:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:48.208 04:20:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:48.208 04:20:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.208 04:20:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:48.208 04:20:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:48.208 04:20:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:48.208 04:20:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:48.208 04:20:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:48.208 04:20:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:48.208 04:20:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:48.208 04:20:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.208 04:20:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:48.208 04:20:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:48.208 04:20:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:48.208 04:20:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:48.208 04:20:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:48.208 04:20:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:48.208 04:20:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:48.208 04:20:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:48.208 04:20:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:48.208 04:20:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:48.208 04:20:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:48.208 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:48.208 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:13:48.208 00:13:48.208 --- 10.0.0.2 ping statistics --- 00:13:48.208 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.208 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:13:48.208 04:20:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:48.208 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:48.208 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:13:48.208 00:13:48.208 --- 10.0.0.1 ping statistics --- 00:13:48.208 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.208 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:13:48.208 04:20:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:48.208 04:20:25 -- nvmf/common.sh@410 -- # return 0 00:13:48.208 04:20:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:48.209 04:20:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:48.209 04:20:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:48.209 04:20:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:48.209 04:20:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:48.209 04:20:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:48.209 04:20:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:48.209 04:20:25 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:48.209 04:20:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:48.209 04:20:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:48.209 04:20:25 -- common/autotest_common.sh@10 -- # set +x 00:13:48.209 04:20:25 -- nvmf/common.sh@469 -- # nvmfpid=3865786 00:13:48.209 04:20:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:48.209 04:20:25 -- nvmf/common.sh@470 -- # waitforlisten 3865786 00:13:48.209 04:20:25 -- common/autotest_common.sh@829 -- # '[' -z 3865786 ']' 00:13:48.209 04:20:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:48.209 04:20:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:48.209 04:20:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:48.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:48.209 04:20:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:48.209 04:20:25 -- common/autotest_common.sh@10 -- # set +x 00:13:48.467 [2024-11-28 04:20:25.536704] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:48.467 [2024-11-28 04:20:25.536781] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:48.467 EAL: No free 2048 kB hugepages reported on node 1 00:13:48.467 [2024-11-28 04:20:25.610395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:48.467 [2024-11-28 04:20:25.731305] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:48.467 [2024-11-28 04:20:25.731470] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:48.467 [2024-11-28 04:20:25.731489] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:48.467 [2024-11-28 04:20:25.731504] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:48.467 [2024-11-28 04:20:25.734550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:48.467 [2024-11-28 04:20:25.734586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:49.400 04:20:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:49.400 04:20:26 -- common/autotest_common.sh@862 -- # return 0 00:13:49.400 04:20:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:49.400 04:20:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:49.400 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.400 04:20:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:49.400 04:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.400 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.400 [2024-11-28 04:20:26.570674] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:49.400 04:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:49.400 04:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.400 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.400 04:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:49.400 04:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.400 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.400 [2024-11-28 04:20:26.587005] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:49.400 04:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:49.400 04:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.400 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.400 NULL1 00:13:49.400 04:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:49.400 04:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.400 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.400 Delay0 00:13:49.400 04:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.400 04:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.400 04:20:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.400 04:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@28 -- # perf_pid=3865946 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:49.400 04:20:26 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:49.400 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.400 [2024-11-28 04:20:26.661602] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:51.927 04:20:28 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:51.927 04:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.927 04:20:28 -- common/autotest_common.sh@10 -- # set +x 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 [2024-11-28 04:20:28.791165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f89f800c350 is same with the state(5) to be set 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.927 starting I/O failed: -6 00:13:51.927 Write completed with error (sct=0, sc=8) 00:13:51.927 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 starting I/O failed: -6 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 starting I/O failed: -6 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 starting I/O failed: -6 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 [2024-11-28 04:20:28.792853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe94c0 is same with the state(5) to be set 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Write completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:51.928 Read completed with error (sct=0, sc=8) 00:13:52.495 [2024-11-28 04:20:29.758195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2002960 is same with the state(5) to be set 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 [2024-11-28 04:20:29.792987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20093d0 is same with the state(5) to be set 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 [2024-11-28 04:20:29.793156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fe9770 is same with the state(5) to be set 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 [2024-11-28 04:20:29.794861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f89f800bf20 is same with the state(5) to be set 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Write completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 Read completed with error (sct=0, sc=8) 00:13:52.495 [2024-11-28 04:20:29.795765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f89f800c600 is same with the state(5) to be set 00:13:52.495 [2024-11-28 04:20:29.796510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2002960 (9): Bad file descriptor 00:13:52.495 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:52.495 04:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:52.495 04:20:29 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:52.495 04:20:29 -- target/delete_subsystem.sh@35 -- # kill -0 3865946 00:13:52.495 04:20:29 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:52.495 Initializing NVMe Controllers 00:13:52.495 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:52.495 Controller IO queue size 128, less than required. 00:13:52.495 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:52.495 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:52.495 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:52.495 Initialization complete. Launching workers. 00:13:52.495 ======================================================== 00:13:52.495 Latency(us) 00:13:52.495 Device Information : IOPS MiB/s Average min max 00:13:52.495 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 157.78 0.08 924280.16 439.13 1012952.04 00:13:52.495 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 162.74 0.08 911152.49 405.42 1011736.27 00:13:52.495 ======================================================== 00:13:52.495 Total : 320.52 0.16 917614.72 405.42 1012952.04 00:13:52.495 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@35 -- # kill -0 3865946 00:13:53.061 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3865946) - No such process 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@45 -- # NOT wait 3865946 00:13:53.061 04:20:30 -- common/autotest_common.sh@650 -- # local es=0 00:13:53.061 04:20:30 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3865946 00:13:53.061 04:20:30 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:53.061 04:20:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:53.061 04:20:30 -- common/autotest_common.sh@642 -- # type -t wait 00:13:53.061 04:20:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:53.061 04:20:30 -- common/autotest_common.sh@653 -- # wait 3865946 00:13:53.061 04:20:30 -- common/autotest_common.sh@653 -- # es=1 00:13:53.061 04:20:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:53.061 04:20:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:53.061 04:20:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:53.061 04:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.061 04:20:30 -- common/autotest_common.sh@10 -- # set +x 00:13:53.061 04:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:53.061 04:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.061 04:20:30 -- common/autotest_common.sh@10 -- # set +x 00:13:53.061 [2024-11-28 04:20:30.319818] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:53.061 04:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.061 04:20:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.061 04:20:30 -- common/autotest_common.sh@10 -- # set +x 00:13:53.061 04:20:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@54 -- # perf_pid=3866365 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:53.061 04:20:30 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:53.061 EAL: No free 2048 kB hugepages reported on node 1 00:13:53.319 [2024-11-28 04:20:30.382863] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:53.577 04:20:30 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:53.577 04:20:30 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:53.577 04:20:30 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:54.142 04:20:31 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:54.142 04:20:31 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:54.142 04:20:31 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:54.706 04:20:31 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:54.706 04:20:31 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:54.706 04:20:31 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:55.271 04:20:32 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:55.271 04:20:32 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:55.271 04:20:32 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:55.837 04:20:32 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:55.837 04:20:32 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:55.837 04:20:32 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:56.095 04:20:33 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:56.095 04:20:33 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:56.095 04:20:33 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:56.353 Initializing NVMe Controllers 00:13:56.353 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:56.353 Controller IO queue size 128, less than required. 00:13:56.353 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:56.353 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:56.353 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:56.353 Initialization complete. Launching workers. 00:13:56.353 ======================================================== 00:13:56.353 Latency(us) 00:13:56.353 Device Information : IOPS MiB/s Average min max 00:13:56.353 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003442.04 1000170.48 1042252.92 00:13:56.353 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004208.33 1000203.39 1012662.49 00:13:56.353 ======================================================== 00:13:56.353 Total : 256.00 0.12 1003825.19 1000170.48 1042252.92 00:13:56.353 00:13:56.611 04:20:33 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:56.611 04:20:33 -- target/delete_subsystem.sh@57 -- # kill -0 3866365 00:13:56.611 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3866365) - No such process 00:13:56.611 04:20:33 -- target/delete_subsystem.sh@67 -- # wait 3866365 00:13:56.611 04:20:33 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:56.611 04:20:33 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:56.611 04:20:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:56.611 04:20:33 -- nvmf/common.sh@116 -- # sync 00:13:56.611 04:20:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:56.611 04:20:33 -- nvmf/common.sh@119 -- # set +e 00:13:56.612 04:20:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:56.612 04:20:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:56.612 rmmod nvme_tcp 00:13:56.612 rmmod nvme_fabrics 00:13:56.612 rmmod nvme_keyring 00:13:56.612 04:20:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:56.612 04:20:33 -- nvmf/common.sh@123 -- # set -e 00:13:56.612 04:20:33 -- nvmf/common.sh@124 -- # return 0 00:13:56.612 04:20:33 -- nvmf/common.sh@477 -- # '[' -n 3865786 ']' 00:13:56.612 04:20:33 -- nvmf/common.sh@478 -- # killprocess 3865786 00:13:56.612 04:20:33 -- common/autotest_common.sh@936 -- # '[' -z 3865786 ']' 00:13:56.612 04:20:33 -- common/autotest_common.sh@940 -- # kill -0 3865786 00:13:56.612 04:20:33 -- common/autotest_common.sh@941 -- # uname 00:13:56.870 04:20:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:56.870 04:20:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3865786 00:13:56.870 04:20:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:56.870 04:20:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:56.870 04:20:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3865786' 00:13:56.870 killing process with pid 3865786 00:13:56.870 04:20:33 -- common/autotest_common.sh@955 -- # kill 3865786 00:13:56.870 04:20:33 -- common/autotest_common.sh@960 -- # wait 3865786 00:13:57.130 04:20:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:57.130 04:20:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:57.130 04:20:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:57.130 04:20:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:57.130 04:20:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:57.130 04:20:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:57.130 04:20:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:57.130 04:20:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:59.127 04:20:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:59.127 00:13:59.127 real 0m13.045s 00:13:59.127 user 0m29.512s 00:13:59.127 sys 0m2.969s 00:13:59.127 04:20:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:59.127 04:20:36 -- common/autotest_common.sh@10 -- # set +x 00:13:59.127 ************************************ 00:13:59.127 END TEST nvmf_delete_subsystem 00:13:59.127 ************************************ 00:13:59.127 04:20:36 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:59.127 04:20:36 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:59.127 04:20:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:59.127 04:20:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:59.127 04:20:36 -- common/autotest_common.sh@10 -- # set +x 00:13:59.127 ************************************ 00:13:59.127 START TEST nvmf_nvme_cli 00:13:59.127 ************************************ 00:13:59.127 04:20:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:59.127 * Looking for test storage... 00:13:59.127 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:59.127 04:20:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:59.127 04:20:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:59.127 04:20:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:59.127 04:20:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:59.127 04:20:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:59.127 04:20:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:59.127 04:20:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:59.127 04:20:36 -- scripts/common.sh@335 -- # IFS=.-: 00:13:59.127 04:20:36 -- scripts/common.sh@335 -- # read -ra ver1 00:13:59.127 04:20:36 -- scripts/common.sh@336 -- # IFS=.-: 00:13:59.127 04:20:36 -- scripts/common.sh@336 -- # read -ra ver2 00:13:59.127 04:20:36 -- scripts/common.sh@337 -- # local 'op=<' 00:13:59.127 04:20:36 -- scripts/common.sh@339 -- # ver1_l=2 00:13:59.127 04:20:36 -- scripts/common.sh@340 -- # ver2_l=1 00:13:59.127 04:20:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:59.127 04:20:36 -- scripts/common.sh@343 -- # case "$op" in 00:13:59.127 04:20:36 -- scripts/common.sh@344 -- # : 1 00:13:59.127 04:20:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:59.127 04:20:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:59.127 04:20:36 -- scripts/common.sh@364 -- # decimal 1 00:13:59.127 04:20:36 -- scripts/common.sh@352 -- # local d=1 00:13:59.127 04:20:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:59.127 04:20:36 -- scripts/common.sh@354 -- # echo 1 00:13:59.127 04:20:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:59.127 04:20:36 -- scripts/common.sh@365 -- # decimal 2 00:13:59.127 04:20:36 -- scripts/common.sh@352 -- # local d=2 00:13:59.127 04:20:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:59.127 04:20:36 -- scripts/common.sh@354 -- # echo 2 00:13:59.127 04:20:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:59.127 04:20:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:59.127 04:20:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:59.127 04:20:36 -- scripts/common.sh@367 -- # return 0 00:13:59.127 04:20:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:59.127 04:20:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:59.127 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.127 --rc genhtml_branch_coverage=1 00:13:59.127 --rc genhtml_function_coverage=1 00:13:59.127 --rc genhtml_legend=1 00:13:59.127 --rc geninfo_all_blocks=1 00:13:59.127 --rc geninfo_unexecuted_blocks=1 00:13:59.127 00:13:59.127 ' 00:13:59.127 04:20:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:59.127 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.127 --rc genhtml_branch_coverage=1 00:13:59.127 --rc genhtml_function_coverage=1 00:13:59.127 --rc genhtml_legend=1 00:13:59.127 --rc geninfo_all_blocks=1 00:13:59.127 --rc geninfo_unexecuted_blocks=1 00:13:59.127 00:13:59.127 ' 00:13:59.128 04:20:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:59.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.128 --rc genhtml_branch_coverage=1 00:13:59.128 --rc genhtml_function_coverage=1 00:13:59.128 --rc genhtml_legend=1 00:13:59.128 --rc geninfo_all_blocks=1 00:13:59.128 --rc geninfo_unexecuted_blocks=1 00:13:59.128 00:13:59.128 ' 00:13:59.128 04:20:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:59.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:59.128 --rc genhtml_branch_coverage=1 00:13:59.128 --rc genhtml_function_coverage=1 00:13:59.128 --rc genhtml_legend=1 00:13:59.128 --rc geninfo_all_blocks=1 00:13:59.128 --rc geninfo_unexecuted_blocks=1 00:13:59.128 00:13:59.128 ' 00:13:59.128 04:20:36 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:59.128 04:20:36 -- nvmf/common.sh@7 -- # uname -s 00:13:59.386 04:20:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:59.386 04:20:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:59.386 04:20:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:59.386 04:20:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:59.386 04:20:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:59.386 04:20:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:59.386 04:20:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:59.386 04:20:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:59.386 04:20:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:59.387 04:20:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:59.387 04:20:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:59.387 04:20:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:59.387 04:20:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:59.387 04:20:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:59.387 04:20:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:59.387 04:20:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:59.387 04:20:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:59.387 04:20:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:59.387 04:20:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:59.387 04:20:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.387 04:20:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.387 04:20:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.387 04:20:36 -- paths/export.sh@5 -- # export PATH 00:13:59.387 04:20:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:59.387 04:20:36 -- nvmf/common.sh@46 -- # : 0 00:13:59.387 04:20:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:59.387 04:20:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:59.387 04:20:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:59.387 04:20:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:59.387 04:20:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:59.387 04:20:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:59.387 04:20:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:59.387 04:20:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:59.387 04:20:36 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:59.387 04:20:36 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:59.387 04:20:36 -- target/nvme_cli.sh@14 -- # devs=() 00:13:59.387 04:20:36 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:59.387 04:20:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:59.387 04:20:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:59.387 04:20:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:59.387 04:20:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:59.387 04:20:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:59.387 04:20:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.387 04:20:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.387 04:20:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:59.387 04:20:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:59.387 04:20:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:59.387 04:20:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:59.387 04:20:36 -- common/autotest_common.sh@10 -- # set +x 00:14:01.290 04:20:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:01.290 04:20:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:01.290 04:20:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:01.290 04:20:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:01.290 04:20:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:01.290 04:20:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:01.290 04:20:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:01.290 04:20:38 -- nvmf/common.sh@294 -- # net_devs=() 00:14:01.290 04:20:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:01.290 04:20:38 -- nvmf/common.sh@295 -- # e810=() 00:14:01.290 04:20:38 -- nvmf/common.sh@295 -- # local -ga e810 00:14:01.290 04:20:38 -- nvmf/common.sh@296 -- # x722=() 00:14:01.290 04:20:38 -- nvmf/common.sh@296 -- # local -ga x722 00:14:01.290 04:20:38 -- nvmf/common.sh@297 -- # mlx=() 00:14:01.290 04:20:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:01.290 04:20:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:01.290 04:20:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:01.290 04:20:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:01.290 04:20:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:01.290 04:20:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:01.290 04:20:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:01.290 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:01.290 04:20:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:01.290 04:20:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:01.290 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:01.290 04:20:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:01.290 04:20:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:01.290 04:20:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:01.290 04:20:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.290 04:20:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:01.290 04:20:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.290 04:20:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:01.290 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:01.290 04:20:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.290 04:20:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:01.290 04:20:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.290 04:20:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:01.290 04:20:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.290 04:20:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:01.290 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:01.290 04:20:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.290 04:20:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:01.548 04:20:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:01.548 04:20:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:01.548 04:20:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:01.548 04:20:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:01.549 04:20:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:01.549 04:20:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:01.549 04:20:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:01.549 04:20:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:01.549 04:20:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:01.549 04:20:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:01.549 04:20:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:01.549 04:20:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:01.549 04:20:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:01.549 04:20:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:01.549 04:20:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:01.549 04:20:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:01.549 04:20:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:01.549 04:20:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:01.549 04:20:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:01.549 04:20:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:01.549 04:20:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:01.549 04:20:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:01.549 04:20:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:01.549 04:20:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:01.549 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:01.549 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:14:01.549 00:14:01.549 --- 10.0.0.2 ping statistics --- 00:14:01.549 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.549 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:14:01.549 04:20:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:01.549 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:01.549 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:14:01.549 00:14:01.549 --- 10.0.0.1 ping statistics --- 00:14:01.549 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.549 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:14:01.549 04:20:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:01.549 04:20:38 -- nvmf/common.sh@410 -- # return 0 00:14:01.549 04:20:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:01.549 04:20:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:01.549 04:20:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:01.549 04:20:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:01.549 04:20:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:01.549 04:20:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:01.549 04:20:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:01.549 04:20:38 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:01.549 04:20:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:01.549 04:20:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:01.549 04:20:38 -- common/autotest_common.sh@10 -- # set +x 00:14:01.549 04:20:38 -- nvmf/common.sh@469 -- # nvmfpid=3868856 00:14:01.549 04:20:38 -- nvmf/common.sh@470 -- # waitforlisten 3868856 00:14:01.549 04:20:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:01.549 04:20:38 -- common/autotest_common.sh@829 -- # '[' -z 3868856 ']' 00:14:01.549 04:20:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:01.549 04:20:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:01.549 04:20:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:01.549 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:01.549 04:20:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:01.549 04:20:38 -- common/autotest_common.sh@10 -- # set +x 00:14:01.549 [2024-11-28 04:20:38.834351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:01.549 [2024-11-28 04:20:38.834428] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:01.807 EAL: No free 2048 kB hugepages reported on node 1 00:14:01.807 [2024-11-28 04:20:38.899234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:01.807 [2024-11-28 04:20:39.010064] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:01.807 [2024-11-28 04:20:39.010224] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:01.807 [2024-11-28 04:20:39.010240] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:01.807 [2024-11-28 04:20:39.010251] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:01.807 [2024-11-28 04:20:39.010302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:01.807 [2024-11-28 04:20:39.010372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:01.807 [2024-11-28 04:20:39.010430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:01.807 [2024-11-28 04:20:39.010433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:02.738 04:20:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:02.738 04:20:39 -- common/autotest_common.sh@862 -- # return 0 00:14:02.738 04:20:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:02.738 04:20:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 04:20:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:02.738 04:20:39 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 [2024-11-28 04:20:39.889287] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 Malloc0 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 Malloc1 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 [2024-11-28 04:20:39.973462] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:02.738 04:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.738 04:20:39 -- common/autotest_common.sh@10 -- # set +x 00:14:02.738 04:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.738 04:20:39 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:02.994 00:14:02.994 Discovery Log Number of Records 2, Generation counter 2 00:14:02.994 =====Discovery Log Entry 0====== 00:14:02.994 trtype: tcp 00:14:02.994 adrfam: ipv4 00:14:02.994 subtype: current discovery subsystem 00:14:02.994 treq: not required 00:14:02.994 portid: 0 00:14:02.994 trsvcid: 4420 00:14:02.994 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:02.994 traddr: 10.0.0.2 00:14:02.994 eflags: explicit discovery connections, duplicate discovery information 00:14:02.994 sectype: none 00:14:02.994 =====Discovery Log Entry 1====== 00:14:02.994 trtype: tcp 00:14:02.994 adrfam: ipv4 00:14:02.994 subtype: nvme subsystem 00:14:02.994 treq: not required 00:14:02.994 portid: 0 00:14:02.994 trsvcid: 4420 00:14:02.994 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:02.994 traddr: 10.0.0.2 00:14:02.994 eflags: none 00:14:02.994 sectype: none 00:14:02.994 04:20:40 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:02.994 04:20:40 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:02.994 04:20:40 -- nvmf/common.sh@510 -- # local dev _ 00:14:02.994 04:20:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.994 04:20:40 -- nvmf/common.sh@509 -- # nvme list 00:14:02.994 04:20:40 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:02.994 04:20:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.994 04:20:40 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:02.994 04:20:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.994 04:20:40 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:02.994 04:20:40 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:03.558 04:20:40 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:03.558 04:20:40 -- common/autotest_common.sh@1187 -- # local i=0 00:14:03.558 04:20:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:03.558 04:20:40 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:03.558 04:20:40 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:03.558 04:20:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:06.083 04:20:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:06.083 04:20:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:06.083 04:20:42 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:06.083 04:20:42 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:06.083 04:20:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:06.083 04:20:42 -- common/autotest_common.sh@1197 -- # return 0 00:14:06.083 04:20:42 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:06.083 04:20:42 -- nvmf/common.sh@510 -- # local dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@509 -- # nvme list 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:06.083 /dev/nvme0n2 ]] 00:14:06.083 04:20:42 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:06.083 04:20:42 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:06.083 04:20:42 -- nvmf/common.sh@510 -- # local dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@509 -- # nvme list 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:06.083 04:20:42 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:06.083 04:20:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:06.083 04:20:42 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:06.083 04:20:42 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:06.083 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:06.083 04:20:42 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:06.083 04:20:42 -- common/autotest_common.sh@1208 -- # local i=0 00:14:06.083 04:20:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:06.084 04:20:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:06.084 04:20:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:06.084 04:20:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:06.084 04:20:42 -- common/autotest_common.sh@1220 -- # return 0 00:14:06.084 04:20:42 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:06.084 04:20:42 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:06.084 04:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.084 04:20:42 -- common/autotest_common.sh@10 -- # set +x 00:14:06.084 04:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.084 04:20:42 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:06.084 04:20:42 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:06.084 04:20:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:06.084 04:20:42 -- nvmf/common.sh@116 -- # sync 00:14:06.084 04:20:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:06.084 04:20:42 -- nvmf/common.sh@119 -- # set +e 00:14:06.084 04:20:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:06.084 04:20:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:06.084 rmmod nvme_tcp 00:14:06.084 rmmod nvme_fabrics 00:14:06.084 rmmod nvme_keyring 00:14:06.084 04:20:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:06.084 04:20:43 -- nvmf/common.sh@123 -- # set -e 00:14:06.084 04:20:43 -- nvmf/common.sh@124 -- # return 0 00:14:06.084 04:20:43 -- nvmf/common.sh@477 -- # '[' -n 3868856 ']' 00:14:06.084 04:20:43 -- nvmf/common.sh@478 -- # killprocess 3868856 00:14:06.084 04:20:43 -- common/autotest_common.sh@936 -- # '[' -z 3868856 ']' 00:14:06.084 04:20:43 -- common/autotest_common.sh@940 -- # kill -0 3868856 00:14:06.084 04:20:43 -- common/autotest_common.sh@941 -- # uname 00:14:06.084 04:20:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:06.084 04:20:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3868856 00:14:06.084 04:20:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:06.084 04:20:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:06.084 04:20:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3868856' 00:14:06.084 killing process with pid 3868856 00:14:06.084 04:20:43 -- common/autotest_common.sh@955 -- # kill 3868856 00:14:06.084 04:20:43 -- common/autotest_common.sh@960 -- # wait 3868856 00:14:06.084 04:20:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:06.084 04:20:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:06.084 04:20:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:06.084 04:20:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:06.084 04:20:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:06.084 04:20:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:06.084 04:20:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:06.084 04:20:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.615 04:20:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:08.615 00:14:08.615 real 0m9.111s 00:14:08.615 user 0m18.078s 00:14:08.615 sys 0m2.373s 00:14:08.615 04:20:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:08.615 04:20:45 -- common/autotest_common.sh@10 -- # set +x 00:14:08.615 ************************************ 00:14:08.615 END TEST nvmf_nvme_cli 00:14:08.615 ************************************ 00:14:08.615 04:20:45 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:08.615 04:20:45 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:08.615 04:20:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:08.615 04:20:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:08.615 04:20:45 -- common/autotest_common.sh@10 -- # set +x 00:14:08.615 ************************************ 00:14:08.615 START TEST nvmf_host_management 00:14:08.615 ************************************ 00:14:08.615 04:20:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:08.615 * Looking for test storage... 00:14:08.615 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:08.615 04:20:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:08.615 04:20:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:08.615 04:20:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:08.615 04:20:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:08.615 04:20:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:08.615 04:20:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:08.615 04:20:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:08.615 04:20:45 -- scripts/common.sh@335 -- # IFS=.-: 00:14:08.615 04:20:45 -- scripts/common.sh@335 -- # read -ra ver1 00:14:08.615 04:20:45 -- scripts/common.sh@336 -- # IFS=.-: 00:14:08.615 04:20:45 -- scripts/common.sh@336 -- # read -ra ver2 00:14:08.615 04:20:45 -- scripts/common.sh@337 -- # local 'op=<' 00:14:08.615 04:20:45 -- scripts/common.sh@339 -- # ver1_l=2 00:14:08.615 04:20:45 -- scripts/common.sh@340 -- # ver2_l=1 00:14:08.615 04:20:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:08.615 04:20:45 -- scripts/common.sh@343 -- # case "$op" in 00:14:08.615 04:20:45 -- scripts/common.sh@344 -- # : 1 00:14:08.615 04:20:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:08.615 04:20:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:08.615 04:20:45 -- scripts/common.sh@364 -- # decimal 1 00:14:08.615 04:20:45 -- scripts/common.sh@352 -- # local d=1 00:14:08.615 04:20:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:08.615 04:20:45 -- scripts/common.sh@354 -- # echo 1 00:14:08.615 04:20:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:08.615 04:20:45 -- scripts/common.sh@365 -- # decimal 2 00:14:08.615 04:20:45 -- scripts/common.sh@352 -- # local d=2 00:14:08.615 04:20:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:08.615 04:20:45 -- scripts/common.sh@354 -- # echo 2 00:14:08.615 04:20:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:08.615 04:20:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:08.615 04:20:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:08.615 04:20:45 -- scripts/common.sh@367 -- # return 0 00:14:08.615 04:20:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:08.615 04:20:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.615 --rc genhtml_branch_coverage=1 00:14:08.615 --rc genhtml_function_coverage=1 00:14:08.615 --rc genhtml_legend=1 00:14:08.615 --rc geninfo_all_blocks=1 00:14:08.615 --rc geninfo_unexecuted_blocks=1 00:14:08.615 00:14:08.615 ' 00:14:08.615 04:20:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.615 --rc genhtml_branch_coverage=1 00:14:08.615 --rc genhtml_function_coverage=1 00:14:08.615 --rc genhtml_legend=1 00:14:08.615 --rc geninfo_all_blocks=1 00:14:08.615 --rc geninfo_unexecuted_blocks=1 00:14:08.615 00:14:08.615 ' 00:14:08.615 04:20:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.615 --rc genhtml_branch_coverage=1 00:14:08.615 --rc genhtml_function_coverage=1 00:14:08.615 --rc genhtml_legend=1 00:14:08.615 --rc geninfo_all_blocks=1 00:14:08.615 --rc geninfo_unexecuted_blocks=1 00:14:08.615 00:14:08.615 ' 00:14:08.615 04:20:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:08.615 --rc genhtml_branch_coverage=1 00:14:08.615 --rc genhtml_function_coverage=1 00:14:08.615 --rc genhtml_legend=1 00:14:08.615 --rc geninfo_all_blocks=1 00:14:08.615 --rc geninfo_unexecuted_blocks=1 00:14:08.615 00:14:08.615 ' 00:14:08.615 04:20:45 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:08.615 04:20:45 -- nvmf/common.sh@7 -- # uname -s 00:14:08.615 04:20:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:08.615 04:20:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:08.615 04:20:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:08.615 04:20:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:08.615 04:20:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:08.615 04:20:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:08.615 04:20:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:08.615 04:20:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:08.615 04:20:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:08.615 04:20:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:08.615 04:20:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.615 04:20:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:08.615 04:20:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:08.615 04:20:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:08.615 04:20:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:08.615 04:20:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:08.615 04:20:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:08.615 04:20:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:08.615 04:20:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:08.616 04:20:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.616 04:20:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.616 04:20:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.616 04:20:45 -- paths/export.sh@5 -- # export PATH 00:14:08.616 04:20:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:08.616 04:20:45 -- nvmf/common.sh@46 -- # : 0 00:14:08.616 04:20:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:08.616 04:20:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:08.616 04:20:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:08.616 04:20:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:08.616 04:20:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:08.616 04:20:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:08.616 04:20:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:08.616 04:20:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:08.616 04:20:45 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:08.616 04:20:45 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:08.616 04:20:45 -- target/host_management.sh@104 -- # nvmftestinit 00:14:08.616 04:20:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:08.616 04:20:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:08.616 04:20:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:08.616 04:20:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:08.616 04:20:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:08.616 04:20:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.616 04:20:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.616 04:20:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:08.616 04:20:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:08.616 04:20:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:08.616 04:20:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:08.616 04:20:45 -- common/autotest_common.sh@10 -- # set +x 00:14:10.521 04:20:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:10.521 04:20:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:10.521 04:20:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:10.521 04:20:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:10.521 04:20:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:10.521 04:20:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:10.521 04:20:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:10.521 04:20:47 -- nvmf/common.sh@294 -- # net_devs=() 00:14:10.521 04:20:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:10.521 04:20:47 -- nvmf/common.sh@295 -- # e810=() 00:14:10.521 04:20:47 -- nvmf/common.sh@295 -- # local -ga e810 00:14:10.521 04:20:47 -- nvmf/common.sh@296 -- # x722=() 00:14:10.521 04:20:47 -- nvmf/common.sh@296 -- # local -ga x722 00:14:10.521 04:20:47 -- nvmf/common.sh@297 -- # mlx=() 00:14:10.521 04:20:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:10.521 04:20:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:10.521 04:20:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:10.521 04:20:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:10.521 04:20:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:10.521 04:20:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:10.521 04:20:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:10.521 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:10.521 04:20:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:10.521 04:20:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:10.521 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:10.521 04:20:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:10.521 04:20:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:10.521 04:20:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:10.521 04:20:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:10.521 04:20:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:10.521 04:20:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:10.521 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:10.521 04:20:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:10.521 04:20:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:10.521 04:20:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:10.521 04:20:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:10.521 04:20:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:10.521 04:20:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:10.521 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:10.521 04:20:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:10.521 04:20:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:10.521 04:20:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:10.521 04:20:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:10.521 04:20:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:10.521 04:20:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:10.521 04:20:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:10.521 04:20:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:10.521 04:20:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:10.521 04:20:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:10.521 04:20:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:10.522 04:20:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:10.522 04:20:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:10.522 04:20:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:10.522 04:20:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:10.522 04:20:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:10.522 04:20:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:10.522 04:20:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:10.522 04:20:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:10.522 04:20:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:10.522 04:20:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:10.522 04:20:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:10.780 04:20:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:10.780 04:20:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:10.780 04:20:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:10.780 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:10.780 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:14:10.780 00:14:10.780 --- 10.0.0.2 ping statistics --- 00:14:10.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.780 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:14:10.780 04:20:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:10.780 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:10.780 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:14:10.780 00:14:10.780 --- 10.0.0.1 ping statistics --- 00:14:10.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.780 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:14:10.780 04:20:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:10.780 04:20:47 -- nvmf/common.sh@410 -- # return 0 00:14:10.780 04:20:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:10.780 04:20:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:10.780 04:20:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:10.780 04:20:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:10.780 04:20:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:10.780 04:20:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:10.780 04:20:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:10.780 04:20:47 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:10.780 04:20:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:10.780 04:20:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:10.780 04:20:47 -- common/autotest_common.sh@10 -- # set +x 00:14:10.780 ************************************ 00:14:10.780 START TEST nvmf_host_management 00:14:10.780 ************************************ 00:14:10.780 04:20:47 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:10.780 04:20:47 -- target/host_management.sh@69 -- # starttarget 00:14:10.780 04:20:47 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:10.780 04:20:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:10.780 04:20:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:10.780 04:20:47 -- common/autotest_common.sh@10 -- # set +x 00:14:10.780 04:20:47 -- nvmf/common.sh@469 -- # nvmfpid=3871403 00:14:10.780 04:20:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:10.780 04:20:47 -- nvmf/common.sh@470 -- # waitforlisten 3871403 00:14:10.780 04:20:47 -- common/autotest_common.sh@829 -- # '[' -z 3871403 ']' 00:14:10.780 04:20:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:10.780 04:20:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:10.780 04:20:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:10.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:10.780 04:20:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:10.780 04:20:47 -- common/autotest_common.sh@10 -- # set +x 00:14:10.780 [2024-11-28 04:20:47.922137] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:10.780 [2024-11-28 04:20:47.922203] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:10.780 EAL: No free 2048 kB hugepages reported on node 1 00:14:10.780 [2024-11-28 04:20:47.985815] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:11.038 [2024-11-28 04:20:48.100773] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:11.038 [2024-11-28 04:20:48.100936] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:11.038 [2024-11-28 04:20:48.100955] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:11.038 [2024-11-28 04:20:48.100979] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:11.038 [2024-11-28 04:20:48.101077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:11.038 [2024-11-28 04:20:48.101168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:11.038 [2024-11-28 04:20:48.101244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:11.038 [2024-11-28 04:20:48.101248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:11.972 04:20:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:11.972 04:20:48 -- common/autotest_common.sh@862 -- # return 0 00:14:11.972 04:20:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:11.972 04:20:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:11.972 04:20:48 -- common/autotest_common.sh@10 -- # set +x 00:14:11.972 04:20:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:11.972 04:20:48 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:11.972 04:20:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.972 04:20:48 -- common/autotest_common.sh@10 -- # set +x 00:14:11.972 [2024-11-28 04:20:48.966325] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:11.972 04:20:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.972 04:20:48 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:11.972 04:20:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:11.972 04:20:48 -- common/autotest_common.sh@10 -- # set +x 00:14:11.972 04:20:48 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:11.972 04:20:48 -- target/host_management.sh@23 -- # cat 00:14:11.972 04:20:48 -- target/host_management.sh@30 -- # rpc_cmd 00:14:11.972 04:20:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.972 04:20:48 -- common/autotest_common.sh@10 -- # set +x 00:14:11.972 Malloc0 00:14:11.972 [2024-11-28 04:20:49.027424] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:11.972 04:20:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.972 04:20:49 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:11.972 04:20:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:11.972 04:20:49 -- common/autotest_common.sh@10 -- # set +x 00:14:11.972 04:20:49 -- target/host_management.sh@73 -- # perfpid=3871584 00:14:11.972 04:20:49 -- target/host_management.sh@74 -- # waitforlisten 3871584 /var/tmp/bdevperf.sock 00:14:11.972 04:20:49 -- common/autotest_common.sh@829 -- # '[' -z 3871584 ']' 00:14:11.972 04:20:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:11.972 04:20:49 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:11.972 04:20:49 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:11.972 04:20:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:11.972 04:20:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:11.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:11.972 04:20:49 -- nvmf/common.sh@520 -- # config=() 00:14:11.972 04:20:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:11.972 04:20:49 -- nvmf/common.sh@520 -- # local subsystem config 00:14:11.972 04:20:49 -- common/autotest_common.sh@10 -- # set +x 00:14:11.972 04:20:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:11.972 04:20:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:11.972 { 00:14:11.972 "params": { 00:14:11.972 "name": "Nvme$subsystem", 00:14:11.972 "trtype": "$TEST_TRANSPORT", 00:14:11.972 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:11.972 "adrfam": "ipv4", 00:14:11.972 "trsvcid": "$NVMF_PORT", 00:14:11.972 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:11.972 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:11.972 "hdgst": ${hdgst:-false}, 00:14:11.972 "ddgst": ${ddgst:-false} 00:14:11.972 }, 00:14:11.972 "method": "bdev_nvme_attach_controller" 00:14:11.972 } 00:14:11.972 EOF 00:14:11.972 )") 00:14:11.972 04:20:49 -- nvmf/common.sh@542 -- # cat 00:14:11.972 04:20:49 -- nvmf/common.sh@544 -- # jq . 00:14:11.972 04:20:49 -- nvmf/common.sh@545 -- # IFS=, 00:14:11.972 04:20:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:11.972 "params": { 00:14:11.972 "name": "Nvme0", 00:14:11.972 "trtype": "tcp", 00:14:11.972 "traddr": "10.0.0.2", 00:14:11.972 "adrfam": "ipv4", 00:14:11.972 "trsvcid": "4420", 00:14:11.972 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:11.972 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:11.972 "hdgst": false, 00:14:11.972 "ddgst": false 00:14:11.972 }, 00:14:11.972 "method": "bdev_nvme_attach_controller" 00:14:11.972 }' 00:14:11.972 [2024-11-28 04:20:49.101493] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:11.972 [2024-11-28 04:20:49.101595] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3871584 ] 00:14:11.972 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.972 [2024-11-28 04:20:49.163029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:11.972 [2024-11-28 04:20:49.271908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:12.230 Running I/O for 10 seconds... 00:14:13.165 04:20:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:13.165 04:20:50 -- common/autotest_common.sh@862 -- # return 0 00:14:13.165 04:20:50 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:13.165 04:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.165 04:20:50 -- common/autotest_common.sh@10 -- # set +x 00:14:13.165 04:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.165 04:20:50 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:13.165 04:20:50 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:13.165 04:20:50 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:13.165 04:20:50 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:13.165 04:20:50 -- target/host_management.sh@52 -- # local ret=1 00:14:13.165 04:20:50 -- target/host_management.sh@53 -- # local i 00:14:13.165 04:20:50 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:13.165 04:20:50 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:13.165 04:20:50 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:13.165 04:20:50 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:13.165 04:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.165 04:20:50 -- common/autotest_common.sh@10 -- # set +x 00:14:13.165 04:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.165 04:20:50 -- target/host_management.sh@55 -- # read_io_count=2450 00:14:13.165 04:20:50 -- target/host_management.sh@58 -- # '[' 2450 -ge 100 ']' 00:14:13.165 04:20:50 -- target/host_management.sh@59 -- # ret=0 00:14:13.165 04:20:50 -- target/host_management.sh@60 -- # break 00:14:13.165 04:20:50 -- target/host_management.sh@64 -- # return 0 00:14:13.165 04:20:50 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:13.165 04:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.165 04:20:50 -- common/autotest_common.sh@10 -- # set +x 00:14:13.165 [2024-11-28 04:20:50.163175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.165 [2024-11-28 04:20:50.163452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.166 [2024-11-28 04:20:50.163464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.166 [2024-11-28 04:20:50.163477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.166 [2024-11-28 04:20:50.163488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1602e60 is same with the state(5) to be set 00:14:13.166 [2024-11-28 04:20:50.164216] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:13.166 [2024-11-28 04:20:50.164261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.164279] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:13.166 [2024-11-28 04:20:50.164293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.164306] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:13.166 [2024-11-28 04:20:50.164319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.164333] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:13.166 [2024-11-28 04:20:50.164346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.164359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5e2160 is same with the state(5) to be set 00:14:13.166 04:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.166 [2024-11-28 04:20:50.167694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 04:20:50 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:13.166 [2024-11-28 04:20:50.167834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:72192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:72320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c 04:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.166 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.167985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:72576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.167998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 04:20:50 -- common/autotest_common.sh@10 -- # set +x 00:14:13.166 [2024-11-28 04:20:50.168086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:72832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:73600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.166 [2024-11-28 04:20:50.168467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.166 [2024-11-28 04:20:50.168482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.168975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.168988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.167 [2024-11-28 04:20:50.169381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.167 [2024-11-28 04:20:50.169394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:13.168 [2024-11-28 04:20:50.169631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:13.168 [2024-11-28 04:20:50.169723] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x5e0030 was disconnected and freed. reset controller. 00:14:13.168 [2024-11-28 04:20:50.170909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:13.168 task offset: 71808 on job bdev=Nvme0n1 fails 00:14:13.168 00:14:13.168 Latency(us) 00:14:13.168 [2024-11-28T03:20:50.479Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:13.168 [2024-11-28T03:20:50.479Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:13.168 [2024-11-28T03:20:50.479Z] Job: Nvme0n1 ended in about 0.73 seconds with error 00:14:13.168 Verification LBA range: start 0x0 length 0x400 00:14:13.168 Nvme0n1 : 0.73 3567.48 222.97 88.15 0.00 17260.64 2415.12 23107.51 00:14:13.168 [2024-11-28T03:20:50.479Z] =================================================================================================================== 00:14:13.168 [2024-11-28T03:20:50.479Z] Total : 3567.48 222.97 88.15 0.00 17260.64 2415.12 23107.51 00:14:13.168 [2024-11-28 04:20:50.172794] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:13.168 [2024-11-28 04:20:50.172847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5e2160 (9): Bad file descriptor 00:14:13.168 04:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.168 04:20:50 -- target/host_management.sh@87 -- # sleep 1 00:14:13.168 [2024-11-28 04:20:50.183793] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:14.101 04:20:51 -- target/host_management.sh@91 -- # kill -9 3871584 00:14:14.101 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3871584) - No such process 00:14:14.101 04:20:51 -- target/host_management.sh@91 -- # true 00:14:14.101 04:20:51 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:14.101 04:20:51 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:14.101 04:20:51 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:14.101 04:20:51 -- nvmf/common.sh@520 -- # config=() 00:14:14.101 04:20:51 -- nvmf/common.sh@520 -- # local subsystem config 00:14:14.101 04:20:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:14.101 04:20:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:14.101 { 00:14:14.101 "params": { 00:14:14.101 "name": "Nvme$subsystem", 00:14:14.101 "trtype": "$TEST_TRANSPORT", 00:14:14.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:14.101 "adrfam": "ipv4", 00:14:14.101 "trsvcid": "$NVMF_PORT", 00:14:14.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:14.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:14.101 "hdgst": ${hdgst:-false}, 00:14:14.101 "ddgst": ${ddgst:-false} 00:14:14.101 }, 00:14:14.101 "method": "bdev_nvme_attach_controller" 00:14:14.101 } 00:14:14.101 EOF 00:14:14.101 )") 00:14:14.101 04:20:51 -- nvmf/common.sh@542 -- # cat 00:14:14.101 04:20:51 -- nvmf/common.sh@544 -- # jq . 00:14:14.102 04:20:51 -- nvmf/common.sh@545 -- # IFS=, 00:14:14.102 04:20:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:14.102 "params": { 00:14:14.102 "name": "Nvme0", 00:14:14.102 "trtype": "tcp", 00:14:14.102 "traddr": "10.0.0.2", 00:14:14.102 "adrfam": "ipv4", 00:14:14.102 "trsvcid": "4420", 00:14:14.102 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:14.102 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:14.102 "hdgst": false, 00:14:14.102 "ddgst": false 00:14:14.102 }, 00:14:14.102 "method": "bdev_nvme_attach_controller" 00:14:14.102 }' 00:14:14.102 [2024-11-28 04:20:51.221668] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:14.102 [2024-11-28 04:20:51.221758] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3871872 ] 00:14:14.102 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.102 [2024-11-28 04:20:51.280997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:14.102 [2024-11-28 04:20:51.391644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:14.359 Running I/O for 1 seconds... 00:14:15.292 00:14:15.292 Latency(us) 00:14:15.292 [2024-11-28T03:20:52.603Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:15.292 [2024-11-28T03:20:52.603Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:15.292 Verification LBA range: start 0x0 length 0x400 00:14:15.292 Nvme0n1 : 1.01 3980.90 248.81 0.00 0.00 15828.13 1304.65 21942.42 00:14:15.292 [2024-11-28T03:20:52.603Z] =================================================================================================================== 00:14:15.292 [2024-11-28T03:20:52.603Z] Total : 3980.90 248.81 0.00 0.00 15828.13 1304.65 21942.42 00:14:15.549 04:20:52 -- target/host_management.sh@101 -- # stoptarget 00:14:15.549 04:20:52 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:15.549 04:20:52 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:15.549 04:20:52 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:15.549 04:20:52 -- target/host_management.sh@40 -- # nvmftestfini 00:14:15.549 04:20:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:15.549 04:20:52 -- nvmf/common.sh@116 -- # sync 00:14:15.549 04:20:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:15.549 04:20:52 -- nvmf/common.sh@119 -- # set +e 00:14:15.549 04:20:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:15.549 04:20:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:15.549 rmmod nvme_tcp 00:14:15.807 rmmod nvme_fabrics 00:14:15.807 rmmod nvme_keyring 00:14:15.807 04:20:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:15.807 04:20:52 -- nvmf/common.sh@123 -- # set -e 00:14:15.807 04:20:52 -- nvmf/common.sh@124 -- # return 0 00:14:15.807 04:20:52 -- nvmf/common.sh@477 -- # '[' -n 3871403 ']' 00:14:15.807 04:20:52 -- nvmf/common.sh@478 -- # killprocess 3871403 00:14:15.807 04:20:52 -- common/autotest_common.sh@936 -- # '[' -z 3871403 ']' 00:14:15.807 04:20:52 -- common/autotest_common.sh@940 -- # kill -0 3871403 00:14:15.807 04:20:52 -- common/autotest_common.sh@941 -- # uname 00:14:15.807 04:20:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:15.807 04:20:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3871403 00:14:15.807 04:20:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:15.807 04:20:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:15.807 04:20:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3871403' 00:14:15.807 killing process with pid 3871403 00:14:15.807 04:20:52 -- common/autotest_common.sh@955 -- # kill 3871403 00:14:15.807 04:20:52 -- common/autotest_common.sh@960 -- # wait 3871403 00:14:16.065 [2024-11-28 04:20:53.244013] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:16.065 04:20:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:16.065 04:20:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:16.065 04:20:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:16.065 04:20:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:16.065 04:20:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:16.065 04:20:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:16.065 04:20:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:16.065 04:20:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:18.600 04:20:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:18.600 00:14:18.600 real 0m7.437s 00:14:18.600 user 0m23.301s 00:14:18.600 sys 0m1.355s 00:14:18.600 04:20:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:18.600 04:20:55 -- common/autotest_common.sh@10 -- # set +x 00:14:18.600 ************************************ 00:14:18.600 END TEST nvmf_host_management 00:14:18.600 ************************************ 00:14:18.600 04:20:55 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:18.600 00:14:18.600 real 0m9.905s 00:14:18.600 user 0m24.204s 00:14:18.600 sys 0m2.953s 00:14:18.600 04:20:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:18.600 04:20:55 -- common/autotest_common.sh@10 -- # set +x 00:14:18.600 ************************************ 00:14:18.600 END TEST nvmf_host_management 00:14:18.600 ************************************ 00:14:18.600 04:20:55 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:18.600 04:20:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:18.600 04:20:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:18.600 04:20:55 -- common/autotest_common.sh@10 -- # set +x 00:14:18.600 ************************************ 00:14:18.600 START TEST nvmf_lvol 00:14:18.600 ************************************ 00:14:18.600 04:20:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:18.600 * Looking for test storage... 00:14:18.600 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:18.600 04:20:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:18.600 04:20:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:18.600 04:20:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:18.600 04:20:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:18.600 04:20:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:18.600 04:20:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:18.600 04:20:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:18.600 04:20:55 -- scripts/common.sh@335 -- # IFS=.-: 00:14:18.600 04:20:55 -- scripts/common.sh@335 -- # read -ra ver1 00:14:18.600 04:20:55 -- scripts/common.sh@336 -- # IFS=.-: 00:14:18.600 04:20:55 -- scripts/common.sh@336 -- # read -ra ver2 00:14:18.600 04:20:55 -- scripts/common.sh@337 -- # local 'op=<' 00:14:18.600 04:20:55 -- scripts/common.sh@339 -- # ver1_l=2 00:14:18.600 04:20:55 -- scripts/common.sh@340 -- # ver2_l=1 00:14:18.600 04:20:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:18.600 04:20:55 -- scripts/common.sh@343 -- # case "$op" in 00:14:18.600 04:20:55 -- scripts/common.sh@344 -- # : 1 00:14:18.600 04:20:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:18.600 04:20:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:18.600 04:20:55 -- scripts/common.sh@364 -- # decimal 1 00:14:18.600 04:20:55 -- scripts/common.sh@352 -- # local d=1 00:14:18.600 04:20:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:18.600 04:20:55 -- scripts/common.sh@354 -- # echo 1 00:14:18.600 04:20:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:18.600 04:20:55 -- scripts/common.sh@365 -- # decimal 2 00:14:18.600 04:20:55 -- scripts/common.sh@352 -- # local d=2 00:14:18.600 04:20:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:18.600 04:20:55 -- scripts/common.sh@354 -- # echo 2 00:14:18.600 04:20:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:18.600 04:20:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:18.600 04:20:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:18.600 04:20:55 -- scripts/common.sh@367 -- # return 0 00:14:18.600 04:20:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:18.600 04:20:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:18.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:18.600 --rc genhtml_branch_coverage=1 00:14:18.600 --rc genhtml_function_coverage=1 00:14:18.600 --rc genhtml_legend=1 00:14:18.600 --rc geninfo_all_blocks=1 00:14:18.600 --rc geninfo_unexecuted_blocks=1 00:14:18.600 00:14:18.600 ' 00:14:18.600 04:20:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:18.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:18.600 --rc genhtml_branch_coverage=1 00:14:18.600 --rc genhtml_function_coverage=1 00:14:18.600 --rc genhtml_legend=1 00:14:18.600 --rc geninfo_all_blocks=1 00:14:18.600 --rc geninfo_unexecuted_blocks=1 00:14:18.600 00:14:18.600 ' 00:14:18.600 04:20:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:18.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:18.600 --rc genhtml_branch_coverage=1 00:14:18.600 --rc genhtml_function_coverage=1 00:14:18.600 --rc genhtml_legend=1 00:14:18.600 --rc geninfo_all_blocks=1 00:14:18.600 --rc geninfo_unexecuted_blocks=1 00:14:18.600 00:14:18.600 ' 00:14:18.600 04:20:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:18.600 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:18.600 --rc genhtml_branch_coverage=1 00:14:18.600 --rc genhtml_function_coverage=1 00:14:18.600 --rc genhtml_legend=1 00:14:18.600 --rc geninfo_all_blocks=1 00:14:18.600 --rc geninfo_unexecuted_blocks=1 00:14:18.600 00:14:18.600 ' 00:14:18.600 04:20:55 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:18.600 04:20:55 -- nvmf/common.sh@7 -- # uname -s 00:14:18.600 04:20:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:18.601 04:20:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:18.601 04:20:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:18.601 04:20:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:18.601 04:20:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:18.601 04:20:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:18.601 04:20:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:18.601 04:20:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:18.601 04:20:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:18.601 04:20:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:18.601 04:20:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:18.601 04:20:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:18.601 04:20:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:18.601 04:20:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:18.601 04:20:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:18.601 04:20:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:18.601 04:20:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:18.601 04:20:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:18.601 04:20:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:18.601 04:20:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.601 04:20:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.601 04:20:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.601 04:20:55 -- paths/export.sh@5 -- # export PATH 00:14:18.601 04:20:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:18.601 04:20:55 -- nvmf/common.sh@46 -- # : 0 00:14:18.601 04:20:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:18.601 04:20:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:18.601 04:20:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:18.601 04:20:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:18.601 04:20:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:18.601 04:20:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:18.601 04:20:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:18.601 04:20:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:18.601 04:20:55 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:18.601 04:20:55 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:18.601 04:20:55 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:18.601 04:20:55 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:18.601 04:20:55 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:18.601 04:20:55 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:18.601 04:20:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:18.601 04:20:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:18.601 04:20:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:18.601 04:20:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:18.601 04:20:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:18.601 04:20:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:18.601 04:20:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:18.601 04:20:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:18.601 04:20:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:18.601 04:20:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:18.601 04:20:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:18.601 04:20:55 -- common/autotest_common.sh@10 -- # set +x 00:14:20.503 04:20:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:20.503 04:20:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:20.503 04:20:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:20.503 04:20:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:20.503 04:20:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:20.503 04:20:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:20.503 04:20:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:20.503 04:20:57 -- nvmf/common.sh@294 -- # net_devs=() 00:14:20.503 04:20:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:20.503 04:20:57 -- nvmf/common.sh@295 -- # e810=() 00:14:20.503 04:20:57 -- nvmf/common.sh@295 -- # local -ga e810 00:14:20.503 04:20:57 -- nvmf/common.sh@296 -- # x722=() 00:14:20.503 04:20:57 -- nvmf/common.sh@296 -- # local -ga x722 00:14:20.503 04:20:57 -- nvmf/common.sh@297 -- # mlx=() 00:14:20.503 04:20:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:20.503 04:20:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:20.503 04:20:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:20.503 04:20:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:20.503 04:20:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:20.503 04:20:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:20.503 04:20:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:20.503 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:20.503 04:20:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:20.503 04:20:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:20.503 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:20.503 04:20:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:20.503 04:20:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:20.504 04:20:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:20.504 04:20:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:20.504 04:20:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:20.504 04:20:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:20.504 04:20:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:20.504 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:20.504 04:20:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:20.504 04:20:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:20.504 04:20:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:20.504 04:20:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:20.504 04:20:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:20.504 04:20:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:20.504 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:20.504 04:20:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:20.504 04:20:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:20.504 04:20:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:20.504 04:20:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:20.504 04:20:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:20.504 04:20:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:20.504 04:20:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:20.504 04:20:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:20.504 04:20:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:20.504 04:20:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:20.504 04:20:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:20.504 04:20:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:20.504 04:20:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:20.504 04:20:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:20.504 04:20:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:20.504 04:20:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:20.504 04:20:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:20.504 04:20:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:20.504 04:20:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:20.504 04:20:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:20.504 04:20:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:20.504 04:20:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:20.504 04:20:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:20.504 04:20:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:20.504 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:20.504 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:14:20.504 00:14:20.504 --- 10.0.0.2 ping statistics --- 00:14:20.504 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:20.504 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:14:20.504 04:20:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:20.504 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:20.504 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:14:20.504 00:14:20.504 --- 10.0.0.1 ping statistics --- 00:14:20.504 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:20.504 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:14:20.504 04:20:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:20.504 04:20:57 -- nvmf/common.sh@410 -- # return 0 00:14:20.504 04:20:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:20.504 04:20:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:20.504 04:20:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:20.504 04:20:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:20.504 04:20:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:20.504 04:20:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:20.504 04:20:57 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:20.504 04:20:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:20.504 04:20:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:20.504 04:20:57 -- common/autotest_common.sh@10 -- # set +x 00:14:20.504 04:20:57 -- nvmf/common.sh@469 -- # nvmfpid=3873991 00:14:20.504 04:20:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:20.504 04:20:57 -- nvmf/common.sh@470 -- # waitforlisten 3873991 00:14:20.504 04:20:57 -- common/autotest_common.sh@829 -- # '[' -z 3873991 ']' 00:14:20.504 04:20:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:20.504 04:20:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:20.504 04:20:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:20.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:20.504 04:20:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:20.504 04:20:57 -- common/autotest_common.sh@10 -- # set +x 00:14:20.762 [2024-11-28 04:20:57.842102] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:20.762 [2024-11-28 04:20:57.842176] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:20.762 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.762 [2024-11-28 04:20:57.909668] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:20.762 [2024-11-28 04:20:58.017330] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:20.762 [2024-11-28 04:20:58.017482] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:20.762 [2024-11-28 04:20:58.017499] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:20.762 [2024-11-28 04:20:58.017510] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:20.762 [2024-11-28 04:20:58.017579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:20.762 [2024-11-28 04:20:58.017649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:20.762 [2024-11-28 04:20:58.017653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:21.696 04:20:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:21.696 04:20:58 -- common/autotest_common.sh@862 -- # return 0 00:14:21.696 04:20:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:21.696 04:20:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:21.696 04:20:58 -- common/autotest_common.sh@10 -- # set +x 00:14:21.696 04:20:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:21.696 04:20:58 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:21.954 [2024-11-28 04:20:59.171485] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:21.954 04:20:59 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:22.212 04:20:59 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:22.212 04:20:59 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:22.470 04:20:59 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:22.470 04:20:59 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:22.728 04:20:59 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:23.294 04:21:00 -- target/nvmf_lvol.sh@29 -- # lvs=e4961c2a-cf35-4d94-ae84-c7f136a36840 00:14:23.294 04:21:00 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e4961c2a-cf35-4d94-ae84-c7f136a36840 lvol 20 00:14:23.294 04:21:00 -- target/nvmf_lvol.sh@32 -- # lvol=791c3b97-332a-4fc7-9a83-2238d4a599fe 00:14:23.294 04:21:00 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:23.552 04:21:00 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 791c3b97-332a-4fc7-9a83-2238d4a599fe 00:14:23.810 04:21:01 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:24.066 [2024-11-28 04:21:01.355162] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:24.066 04:21:01 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:24.323 04:21:01 -- target/nvmf_lvol.sh@42 -- # perf_pid=3874656 00:14:24.323 04:21:01 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:24.323 04:21:01 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:24.581 EAL: No free 2048 kB hugepages reported on node 1 00:14:25.516 04:21:02 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 791c3b97-332a-4fc7-9a83-2238d4a599fe MY_SNAPSHOT 00:14:25.775 04:21:02 -- target/nvmf_lvol.sh@47 -- # snapshot=4eb63ac7-26dc-4b9d-b776-7722a307f9be 00:14:25.775 04:21:02 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 791c3b97-332a-4fc7-9a83-2238d4a599fe 30 00:14:26.033 04:21:03 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 4eb63ac7-26dc-4b9d-b776-7722a307f9be MY_CLONE 00:14:26.291 04:21:03 -- target/nvmf_lvol.sh@49 -- # clone=30e3863d-77e8-4823-8700-1f3b76301071 00:14:26.291 04:21:03 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 30e3863d-77e8-4823-8700-1f3b76301071 00:14:27.227 04:21:04 -- target/nvmf_lvol.sh@53 -- # wait 3874656 00:14:35.338 Initializing NVMe Controllers 00:14:35.338 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:35.338 Controller IO queue size 128, less than required. 00:14:35.338 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:35.338 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:35.338 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:35.338 Initialization complete. Launching workers. 00:14:35.338 ======================================================== 00:14:35.339 Latency(us) 00:14:35.339 Device Information : IOPS MiB/s Average min max 00:14:35.339 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10741.19 41.96 11926.51 2091.95 106553.87 00:14:35.339 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10750.19 41.99 11915.75 1698.98 51642.31 00:14:35.339 ======================================================== 00:14:35.339 Total : 21491.39 83.95 11921.13 1698.98 106553.87 00:14:35.339 00:14:35.339 04:21:11 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:35.339 04:21:12 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 791c3b97-332a-4fc7-9a83-2238d4a599fe 00:14:35.339 04:21:12 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e4961c2a-cf35-4d94-ae84-c7f136a36840 00:14:35.597 04:21:12 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:35.597 04:21:12 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:35.597 04:21:12 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:35.597 04:21:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:35.597 04:21:12 -- nvmf/common.sh@116 -- # sync 00:14:35.597 04:21:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:35.597 04:21:12 -- nvmf/common.sh@119 -- # set +e 00:14:35.597 04:21:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:35.597 04:21:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:35.597 rmmod nvme_tcp 00:14:35.597 rmmod nvme_fabrics 00:14:35.597 rmmod nvme_keyring 00:14:35.597 04:21:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:35.597 04:21:12 -- nvmf/common.sh@123 -- # set -e 00:14:35.597 04:21:12 -- nvmf/common.sh@124 -- # return 0 00:14:35.597 04:21:12 -- nvmf/common.sh@477 -- # '[' -n 3873991 ']' 00:14:35.597 04:21:12 -- nvmf/common.sh@478 -- # killprocess 3873991 00:14:35.597 04:21:12 -- common/autotest_common.sh@936 -- # '[' -z 3873991 ']' 00:14:35.597 04:21:12 -- common/autotest_common.sh@940 -- # kill -0 3873991 00:14:35.597 04:21:12 -- common/autotest_common.sh@941 -- # uname 00:14:35.597 04:21:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:35.597 04:21:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3873991 00:14:35.597 04:21:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:35.597 04:21:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:35.597 04:21:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3873991' 00:14:35.597 killing process with pid 3873991 00:14:35.597 04:21:12 -- common/autotest_common.sh@955 -- # kill 3873991 00:14:35.597 04:21:12 -- common/autotest_common.sh@960 -- # wait 3873991 00:14:36.164 04:21:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:36.164 04:21:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:36.164 04:21:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:36.164 04:21:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:36.164 04:21:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:36.164 04:21:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:36.164 04:21:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:36.164 04:21:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.118 04:21:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:38.118 00:14:38.118 real 0m19.891s 00:14:38.118 user 1m5.918s 00:14:38.118 sys 0m5.978s 00:14:38.118 04:21:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:38.118 04:21:15 -- common/autotest_common.sh@10 -- # set +x 00:14:38.118 ************************************ 00:14:38.118 END TEST nvmf_lvol 00:14:38.118 ************************************ 00:14:38.118 04:21:15 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:38.118 04:21:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:38.118 04:21:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:38.118 04:21:15 -- common/autotest_common.sh@10 -- # set +x 00:14:38.118 ************************************ 00:14:38.118 START TEST nvmf_lvs_grow 00:14:38.118 ************************************ 00:14:38.118 04:21:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:38.118 * Looking for test storage... 00:14:38.118 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:38.118 04:21:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:38.118 04:21:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:38.118 04:21:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:38.118 04:21:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:38.118 04:21:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:38.118 04:21:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:38.118 04:21:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:38.118 04:21:15 -- scripts/common.sh@335 -- # IFS=.-: 00:14:38.118 04:21:15 -- scripts/common.sh@335 -- # read -ra ver1 00:14:38.118 04:21:15 -- scripts/common.sh@336 -- # IFS=.-: 00:14:38.118 04:21:15 -- scripts/common.sh@336 -- # read -ra ver2 00:14:38.118 04:21:15 -- scripts/common.sh@337 -- # local 'op=<' 00:14:38.118 04:21:15 -- scripts/common.sh@339 -- # ver1_l=2 00:14:38.118 04:21:15 -- scripts/common.sh@340 -- # ver2_l=1 00:14:38.118 04:21:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:38.118 04:21:15 -- scripts/common.sh@343 -- # case "$op" in 00:14:38.118 04:21:15 -- scripts/common.sh@344 -- # : 1 00:14:38.118 04:21:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:38.118 04:21:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:38.118 04:21:15 -- scripts/common.sh@364 -- # decimal 1 00:14:38.118 04:21:15 -- scripts/common.sh@352 -- # local d=1 00:14:38.118 04:21:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:38.118 04:21:15 -- scripts/common.sh@354 -- # echo 1 00:14:38.118 04:21:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:38.118 04:21:15 -- scripts/common.sh@365 -- # decimal 2 00:14:38.118 04:21:15 -- scripts/common.sh@352 -- # local d=2 00:14:38.118 04:21:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:38.118 04:21:15 -- scripts/common.sh@354 -- # echo 2 00:14:38.118 04:21:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:38.118 04:21:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:38.118 04:21:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:38.118 04:21:15 -- scripts/common.sh@367 -- # return 0 00:14:38.118 04:21:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:38.118 04:21:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:38.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.118 --rc genhtml_branch_coverage=1 00:14:38.118 --rc genhtml_function_coverage=1 00:14:38.118 --rc genhtml_legend=1 00:14:38.118 --rc geninfo_all_blocks=1 00:14:38.118 --rc geninfo_unexecuted_blocks=1 00:14:38.118 00:14:38.118 ' 00:14:38.118 04:21:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:38.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.118 --rc genhtml_branch_coverage=1 00:14:38.118 --rc genhtml_function_coverage=1 00:14:38.118 --rc genhtml_legend=1 00:14:38.118 --rc geninfo_all_blocks=1 00:14:38.118 --rc geninfo_unexecuted_blocks=1 00:14:38.118 00:14:38.118 ' 00:14:38.118 04:21:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:38.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.118 --rc genhtml_branch_coverage=1 00:14:38.118 --rc genhtml_function_coverage=1 00:14:38.118 --rc genhtml_legend=1 00:14:38.118 --rc geninfo_all_blocks=1 00:14:38.118 --rc geninfo_unexecuted_blocks=1 00:14:38.118 00:14:38.118 ' 00:14:38.118 04:21:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:38.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.118 --rc genhtml_branch_coverage=1 00:14:38.118 --rc genhtml_function_coverage=1 00:14:38.118 --rc genhtml_legend=1 00:14:38.118 --rc geninfo_all_blocks=1 00:14:38.118 --rc geninfo_unexecuted_blocks=1 00:14:38.118 00:14:38.118 ' 00:14:38.118 04:21:15 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:38.118 04:21:15 -- nvmf/common.sh@7 -- # uname -s 00:14:38.376 04:21:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:38.376 04:21:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:38.376 04:21:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:38.376 04:21:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:38.376 04:21:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:38.376 04:21:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:38.376 04:21:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:38.376 04:21:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:38.376 04:21:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:38.376 04:21:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:38.376 04:21:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:38.376 04:21:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:38.376 04:21:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:38.376 04:21:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:38.376 04:21:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:38.376 04:21:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:38.376 04:21:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:38.376 04:21:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:38.376 04:21:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:38.376 04:21:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.376 04:21:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.376 04:21:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.376 04:21:15 -- paths/export.sh@5 -- # export PATH 00:14:38.376 04:21:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.376 04:21:15 -- nvmf/common.sh@46 -- # : 0 00:14:38.376 04:21:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:38.376 04:21:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:38.376 04:21:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:38.376 04:21:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:38.376 04:21:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:38.376 04:21:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:38.376 04:21:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:38.376 04:21:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:38.376 04:21:15 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:38.376 04:21:15 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:38.377 04:21:15 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:38.377 04:21:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:38.377 04:21:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:38.377 04:21:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:38.377 04:21:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:38.377 04:21:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:38.377 04:21:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:38.377 04:21:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:38.377 04:21:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.377 04:21:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:38.377 04:21:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:38.377 04:21:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:38.377 04:21:15 -- common/autotest_common.sh@10 -- # set +x 00:14:40.279 04:21:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:40.279 04:21:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:40.279 04:21:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:40.279 04:21:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:40.279 04:21:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:40.279 04:21:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:40.279 04:21:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:40.279 04:21:17 -- nvmf/common.sh@294 -- # net_devs=() 00:14:40.279 04:21:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:40.279 04:21:17 -- nvmf/common.sh@295 -- # e810=() 00:14:40.279 04:21:17 -- nvmf/common.sh@295 -- # local -ga e810 00:14:40.279 04:21:17 -- nvmf/common.sh@296 -- # x722=() 00:14:40.279 04:21:17 -- nvmf/common.sh@296 -- # local -ga x722 00:14:40.279 04:21:17 -- nvmf/common.sh@297 -- # mlx=() 00:14:40.279 04:21:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:40.279 04:21:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:40.279 04:21:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:40.279 04:21:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:40.279 04:21:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:40.279 04:21:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:40.279 04:21:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:40.279 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:40.279 04:21:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:40.279 04:21:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:40.279 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:40.279 04:21:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:40.279 04:21:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:40.279 04:21:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:40.279 04:21:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:40.279 04:21:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:40.279 04:21:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:40.279 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:40.279 04:21:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:40.279 04:21:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:40.279 04:21:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:40.279 04:21:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:40.279 04:21:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:40.279 04:21:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:40.279 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:40.279 04:21:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:40.279 04:21:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:40.279 04:21:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:40.279 04:21:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:40.279 04:21:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:40.279 04:21:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:40.279 04:21:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:40.279 04:21:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:40.279 04:21:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:40.279 04:21:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:40.279 04:21:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:40.279 04:21:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:40.279 04:21:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:40.279 04:21:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:40.279 04:21:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:40.279 04:21:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:40.279 04:21:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:40.279 04:21:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:40.279 04:21:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:40.279 04:21:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:40.279 04:21:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:40.279 04:21:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:40.279 04:21:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:40.279 04:21:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:40.279 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:40.279 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:14:40.279 00:14:40.279 --- 10.0.0.2 ping statistics --- 00:14:40.279 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:40.279 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:14:40.279 04:21:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:40.279 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:40.279 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:14:40.279 00:14:40.279 --- 10.0.0.1 ping statistics --- 00:14:40.279 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:40.279 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:14:40.279 04:21:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:40.279 04:21:17 -- nvmf/common.sh@410 -- # return 0 00:14:40.279 04:21:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:40.279 04:21:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:40.279 04:21:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:40.279 04:21:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:40.279 04:21:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:40.279 04:21:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:40.279 04:21:17 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:40.279 04:21:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:40.279 04:21:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:40.279 04:21:17 -- common/autotest_common.sh@10 -- # set +x 00:14:40.279 04:21:17 -- nvmf/common.sh@469 -- # nvmfpid=3878497 00:14:40.279 04:21:17 -- nvmf/common.sh@470 -- # waitforlisten 3878497 00:14:40.279 04:21:17 -- common/autotest_common.sh@829 -- # '[' -z 3878497 ']' 00:14:40.279 04:21:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:40.279 04:21:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:40.279 04:21:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:40.279 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:40.279 04:21:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:40.279 04:21:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:40.279 04:21:17 -- common/autotest_common.sh@10 -- # set +x 00:14:40.538 [2024-11-28 04:21:17.621847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:40.538 [2024-11-28 04:21:17.621950] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:40.538 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.538 [2024-11-28 04:21:17.690776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:40.538 [2024-11-28 04:21:17.804267] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:40.538 [2024-11-28 04:21:17.804437] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:40.538 [2024-11-28 04:21:17.804458] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:40.538 [2024-11-28 04:21:17.804474] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:40.538 [2024-11-28 04:21:17.804505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:41.472 04:21:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:41.472 04:21:18 -- common/autotest_common.sh@862 -- # return 0 00:14:41.472 04:21:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:41.472 04:21:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:41.472 04:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:41.472 04:21:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:41.472 04:21:18 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:41.730 [2024-11-28 04:21:18.931622] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:41.730 04:21:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:41.730 04:21:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:41.730 04:21:18 -- common/autotest_common.sh@10 -- # set +x 00:14:41.730 ************************************ 00:14:41.730 START TEST lvs_grow_clean 00:14:41.730 ************************************ 00:14:41.730 04:21:18 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:41.730 04:21:18 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:42.297 04:21:19 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:42.297 04:21:19 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:42.297 04:21:19 -- target/nvmf_lvs_grow.sh@28 -- # lvs=b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:42.297 04:21:19 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:42.297 04:21:19 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:42.555 04:21:19 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:42.555 04:21:19 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:42.555 04:21:19 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b65ac906-842a-401d-90d3-15bcfb1a2190 lvol 150 00:14:42.813 04:21:20 -- target/nvmf_lvs_grow.sh@33 -- # lvol=ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b 00:14:42.813 04:21:20 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:42.813 04:21:20 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:43.377 [2024-11-28 04:21:20.402075] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:43.377 [2024-11-28 04:21:20.402160] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:43.377 true 00:14:43.377 04:21:20 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:43.377 04:21:20 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:43.635 04:21:20 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:43.635 04:21:20 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:43.892 04:21:20 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b 00:14:44.150 04:21:21 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:44.150 [2024-11-28 04:21:21.457458] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:44.408 04:21:21 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:44.667 04:21:21 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3879081 00:14:44.667 04:21:21 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:44.667 04:21:21 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:44.667 04:21:21 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3879081 /var/tmp/bdevperf.sock 00:14:44.667 04:21:21 -- common/autotest_common.sh@829 -- # '[' -z 3879081 ']' 00:14:44.667 04:21:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:44.667 04:21:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:44.667 04:21:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:44.667 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:44.667 04:21:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:44.667 04:21:21 -- common/autotest_common.sh@10 -- # set +x 00:14:44.667 [2024-11-28 04:21:21.775155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:44.667 [2024-11-28 04:21:21.775224] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3879081 ] 00:14:44.667 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.667 [2024-11-28 04:21:21.836464] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:44.667 [2024-11-28 04:21:21.950482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:45.600 04:21:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:45.600 04:21:22 -- common/autotest_common.sh@862 -- # return 0 00:14:45.600 04:21:22 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:45.858 Nvme0n1 00:14:45.858 04:21:23 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:46.117 [ 00:14:46.117 { 00:14:46.117 "name": "Nvme0n1", 00:14:46.117 "aliases": [ 00:14:46.117 "ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b" 00:14:46.117 ], 00:14:46.117 "product_name": "NVMe disk", 00:14:46.117 "block_size": 4096, 00:14:46.117 "num_blocks": 38912, 00:14:46.117 "uuid": "ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b", 00:14:46.117 "assigned_rate_limits": { 00:14:46.117 "rw_ios_per_sec": 0, 00:14:46.117 "rw_mbytes_per_sec": 0, 00:14:46.117 "r_mbytes_per_sec": 0, 00:14:46.117 "w_mbytes_per_sec": 0 00:14:46.117 }, 00:14:46.117 "claimed": false, 00:14:46.117 "zoned": false, 00:14:46.117 "supported_io_types": { 00:14:46.117 "read": true, 00:14:46.117 "write": true, 00:14:46.117 "unmap": true, 00:14:46.117 "write_zeroes": true, 00:14:46.117 "flush": true, 00:14:46.117 "reset": true, 00:14:46.117 "compare": true, 00:14:46.117 "compare_and_write": true, 00:14:46.117 "abort": true, 00:14:46.117 "nvme_admin": true, 00:14:46.117 "nvme_io": true 00:14:46.117 }, 00:14:46.117 "driver_specific": { 00:14:46.117 "nvme": [ 00:14:46.117 { 00:14:46.117 "trid": { 00:14:46.117 "trtype": "TCP", 00:14:46.117 "adrfam": "IPv4", 00:14:46.117 "traddr": "10.0.0.2", 00:14:46.117 "trsvcid": "4420", 00:14:46.117 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:46.117 }, 00:14:46.117 "ctrlr_data": { 00:14:46.117 "cntlid": 1, 00:14:46.117 "vendor_id": "0x8086", 00:14:46.117 "model_number": "SPDK bdev Controller", 00:14:46.117 "serial_number": "SPDK0", 00:14:46.117 "firmware_revision": "24.01.1", 00:14:46.117 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:46.117 "oacs": { 00:14:46.117 "security": 0, 00:14:46.117 "format": 0, 00:14:46.117 "firmware": 0, 00:14:46.117 "ns_manage": 0 00:14:46.117 }, 00:14:46.117 "multi_ctrlr": true, 00:14:46.117 "ana_reporting": false 00:14:46.117 }, 00:14:46.117 "vs": { 00:14:46.117 "nvme_version": "1.3" 00:14:46.117 }, 00:14:46.117 "ns_data": { 00:14:46.117 "id": 1, 00:14:46.117 "can_share": true 00:14:46.117 } 00:14:46.117 } 00:14:46.117 ], 00:14:46.117 "mp_policy": "active_passive" 00:14:46.117 } 00:14:46.117 } 00:14:46.117 ] 00:14:46.117 04:21:23 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3879225 00:14:46.117 04:21:23 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:46.117 04:21:23 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:46.375 Running I/O for 10 seconds... 00:14:47.310 Latency(us) 00:14:47.310 [2024-11-28T03:21:24.621Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:47.310 [2024-11-28T03:21:24.621Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.310 Nvme0n1 : 1.00 14488.00 56.59 0.00 0.00 0.00 0.00 0.00 00:14:47.310 [2024-11-28T03:21:24.621Z] =================================================================================================================== 00:14:47.310 [2024-11-28T03:21:24.621Z] Total : 14488.00 56.59 0.00 0.00 0.00 0.00 0.00 00:14:47.310 00:14:48.244 04:21:25 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:48.244 [2024-11-28T03:21:25.555Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.244 Nvme0n1 : 2.00 14724.00 57.52 0.00 0.00 0.00 0.00 0.00 00:14:48.244 [2024-11-28T03:21:25.555Z] =================================================================================================================== 00:14:48.244 [2024-11-28T03:21:25.555Z] Total : 14724.00 57.52 0.00 0.00 0.00 0.00 0.00 00:14:48.244 00:14:48.502 true 00:14:48.502 04:21:25 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:48.502 04:21:25 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:48.760 04:21:25 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:48.760 04:21:25 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:48.760 04:21:25 -- target/nvmf_lvs_grow.sh@65 -- # wait 3879225 00:14:49.326 [2024-11-28T03:21:26.637Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.326 Nvme0n1 : 3.00 14857.33 58.04 0.00 0.00 0.00 0.00 0.00 00:14:49.326 [2024-11-28T03:21:26.637Z] =================================================================================================================== 00:14:49.326 [2024-11-28T03:21:26.637Z] Total : 14857.33 58.04 0.00 0.00 0.00 0.00 0.00 00:14:49.326 00:14:50.261 [2024-11-28T03:21:27.572Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:50.261 Nvme0n1 : 4.00 14944.25 58.38 0.00 0.00 0.00 0.00 0.00 00:14:50.261 [2024-11-28T03:21:27.572Z] =================================================================================================================== 00:14:50.261 [2024-11-28T03:21:27.572Z] Total : 14944.25 58.38 0.00 0.00 0.00 0.00 0.00 00:14:50.261 00:14:51.196 [2024-11-28T03:21:28.507Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:51.196 Nvme0n1 : 5.00 15009.20 58.63 0.00 0.00 0.00 0.00 0.00 00:14:51.196 [2024-11-28T03:21:28.507Z] =================================================================================================================== 00:14:51.196 [2024-11-28T03:21:28.507Z] Total : 15009.20 58.63 0.00 0.00 0.00 0.00 0.00 00:14:51.196 00:14:52.570 [2024-11-28T03:21:29.881Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:52.570 Nvme0n1 : 6.00 15050.83 58.79 0.00 0.00 0.00 0.00 0.00 00:14:52.570 [2024-11-28T03:21:29.881Z] =================================================================================================================== 00:14:52.570 [2024-11-28T03:21:29.881Z] Total : 15050.83 58.79 0.00 0.00 0.00 0.00 0.00 00:14:52.570 00:14:53.504 [2024-11-28T03:21:30.815Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.504 Nvme0n1 : 7.00 15132.86 59.11 0.00 0.00 0.00 0.00 0.00 00:14:53.504 [2024-11-28T03:21:30.815Z] =================================================================================================================== 00:14:53.504 [2024-11-28T03:21:30.815Z] Total : 15132.86 59.11 0.00 0.00 0.00 0.00 0.00 00:14:53.504 00:14:54.439 [2024-11-28T03:21:31.750Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:54.439 Nvme0n1 : 8.00 15172.50 59.27 0.00 0.00 0.00 0.00 0.00 00:14:54.439 [2024-11-28T03:21:31.750Z] =================================================================================================================== 00:14:54.439 [2024-11-28T03:21:31.750Z] Total : 15172.50 59.27 0.00 0.00 0.00 0.00 0.00 00:14:54.439 00:14:55.373 [2024-11-28T03:21:32.685Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.374 Nvme0n1 : 9.00 15211.56 59.42 0.00 0.00 0.00 0.00 0.00 00:14:55.374 [2024-11-28T03:21:32.685Z] =================================================================================================================== 00:14:55.374 [2024-11-28T03:21:32.685Z] Total : 15211.56 59.42 0.00 0.00 0.00 0.00 0.00 00:14:55.374 00:14:56.308 [2024-11-28T03:21:33.619Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.308 Nvme0n1 : 10.00 15237.80 59.52 0.00 0.00 0.00 0.00 0.00 00:14:56.308 [2024-11-28T03:21:33.619Z] =================================================================================================================== 00:14:56.308 [2024-11-28T03:21:33.619Z] Total : 15237.80 59.52 0.00 0.00 0.00 0.00 0.00 00:14:56.308 00:14:56.308 00:14:56.308 Latency(us) 00:14:56.308 [2024-11-28T03:21:33.619Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:56.308 [2024-11-28T03:21:33.619Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.308 Nvme0n1 : 10.01 15234.80 59.51 0.00 0.00 8395.75 4684.61 18447.17 00:14:56.308 [2024-11-28T03:21:33.619Z] =================================================================================================================== 00:14:56.308 [2024-11-28T03:21:33.619Z] Total : 15234.80 59.51 0.00 0.00 8395.75 4684.61 18447.17 00:14:56.308 0 00:14:56.308 04:21:33 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3879081 00:14:56.308 04:21:33 -- common/autotest_common.sh@936 -- # '[' -z 3879081 ']' 00:14:56.308 04:21:33 -- common/autotest_common.sh@940 -- # kill -0 3879081 00:14:56.308 04:21:33 -- common/autotest_common.sh@941 -- # uname 00:14:56.308 04:21:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:56.308 04:21:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3879081 00:14:56.308 04:21:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:56.308 04:21:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:56.308 04:21:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3879081' 00:14:56.308 killing process with pid 3879081 00:14:56.308 04:21:33 -- common/autotest_common.sh@955 -- # kill 3879081 00:14:56.308 Received shutdown signal, test time was about 10.000000 seconds 00:14:56.308 00:14:56.308 Latency(us) 00:14:56.308 [2024-11-28T03:21:33.619Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:56.308 [2024-11-28T03:21:33.619Z] =================================================================================================================== 00:14:56.308 [2024-11-28T03:21:33.619Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:56.308 04:21:33 -- common/autotest_common.sh@960 -- # wait 3879081 00:14:56.566 04:21:33 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:57.134 04:21:34 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:57.134 04:21:34 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:57.134 04:21:34 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:57.134 04:21:34 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:57.134 04:21:34 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:57.392 [2024-11-28 04:21:34.639466] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:57.392 04:21:34 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:57.392 04:21:34 -- common/autotest_common.sh@650 -- # local es=0 00:14:57.392 04:21:34 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:57.392 04:21:34 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.392 04:21:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:57.393 04:21:34 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.393 04:21:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:57.393 04:21:34 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.393 04:21:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:57.393 04:21:34 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:57.393 04:21:34 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:57.393 04:21:34 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:57.651 request: 00:14:57.651 { 00:14:57.651 "uuid": "b65ac906-842a-401d-90d3-15bcfb1a2190", 00:14:57.651 "method": "bdev_lvol_get_lvstores", 00:14:57.651 "req_id": 1 00:14:57.651 } 00:14:57.651 Got JSON-RPC error response 00:14:57.651 response: 00:14:57.651 { 00:14:57.651 "code": -19, 00:14:57.651 "message": "No such device" 00:14:57.651 } 00:14:57.651 04:21:34 -- common/autotest_common.sh@653 -- # es=1 00:14:57.651 04:21:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:57.651 04:21:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:57.651 04:21:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:57.651 04:21:34 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:57.908 aio_bdev 00:14:57.908 04:21:35 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b 00:14:57.908 04:21:35 -- common/autotest_common.sh@897 -- # local bdev_name=ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b 00:14:57.908 04:21:35 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:57.908 04:21:35 -- common/autotest_common.sh@899 -- # local i 00:14:57.908 04:21:35 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:57.908 04:21:35 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:57.908 04:21:35 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:58.165 04:21:35 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b -t 2000 00:14:58.424 [ 00:14:58.424 { 00:14:58.424 "name": "ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b", 00:14:58.424 "aliases": [ 00:14:58.424 "lvs/lvol" 00:14:58.424 ], 00:14:58.424 "product_name": "Logical Volume", 00:14:58.424 "block_size": 4096, 00:14:58.424 "num_blocks": 38912, 00:14:58.424 "uuid": "ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b", 00:14:58.424 "assigned_rate_limits": { 00:14:58.424 "rw_ios_per_sec": 0, 00:14:58.424 "rw_mbytes_per_sec": 0, 00:14:58.424 "r_mbytes_per_sec": 0, 00:14:58.424 "w_mbytes_per_sec": 0 00:14:58.424 }, 00:14:58.424 "claimed": false, 00:14:58.424 "zoned": false, 00:14:58.424 "supported_io_types": { 00:14:58.424 "read": true, 00:14:58.424 "write": true, 00:14:58.424 "unmap": true, 00:14:58.424 "write_zeroes": true, 00:14:58.424 "flush": false, 00:14:58.424 "reset": true, 00:14:58.424 "compare": false, 00:14:58.424 "compare_and_write": false, 00:14:58.424 "abort": false, 00:14:58.424 "nvme_admin": false, 00:14:58.424 "nvme_io": false 00:14:58.424 }, 00:14:58.424 "driver_specific": { 00:14:58.424 "lvol": { 00:14:58.424 "lvol_store_uuid": "b65ac906-842a-401d-90d3-15bcfb1a2190", 00:14:58.424 "base_bdev": "aio_bdev", 00:14:58.424 "thin_provision": false, 00:14:58.424 "snapshot": false, 00:14:58.424 "clone": false, 00:14:58.424 "esnap_clone": false 00:14:58.424 } 00:14:58.424 } 00:14:58.424 } 00:14:58.424 ] 00:14:58.424 04:21:35 -- common/autotest_common.sh@905 -- # return 0 00:14:58.424 04:21:35 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:58.424 04:21:35 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:58.683 04:21:35 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:58.683 04:21:35 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:58.683 04:21:35 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:58.941 04:21:36 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:58.941 04:21:36 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ca65e8c2-5816-43c6-ba9e-1faaa9b76d1b 00:14:59.199 04:21:36 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b65ac906-842a-401d-90d3-15bcfb1a2190 00:14:59.457 04:21:36 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:59.716 04:21:36 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:59.716 00:14:59.716 real 0m18.027s 00:14:59.716 user 0m17.817s 00:14:59.716 sys 0m1.743s 00:14:59.716 04:21:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:59.716 04:21:36 -- common/autotest_common.sh@10 -- # set +x 00:14:59.716 ************************************ 00:14:59.716 END TEST lvs_grow_clean 00:14:59.716 ************************************ 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:59.716 04:21:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:59.716 04:21:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:59.716 04:21:37 -- common/autotest_common.sh@10 -- # set +x 00:14:59.716 ************************************ 00:14:59.716 START TEST lvs_grow_dirty 00:14:59.716 ************************************ 00:14:59.716 04:21:37 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:59.716 04:21:37 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:00.283 04:21:37 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:00.283 04:21:37 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:00.283 04:21:37 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:00.283 04:21:37 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:00.283 04:21:37 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:00.541 04:21:37 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:00.541 04:21:37 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:00.541 04:21:37 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e7ab5c38-275b-4a63-bc13-06b227696eba lvol 150 00:15:00.800 04:21:38 -- target/nvmf_lvs_grow.sh@33 -- # lvol=4718fb2e-4b42-4a12-920b-42cefcb0843e 00:15:00.800 04:21:38 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:00.800 04:21:38 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:01.057 [2024-11-28 04:21:38.297887] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:01.058 [2024-11-28 04:21:38.297980] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:01.058 true 00:15:01.058 04:21:38 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:01.058 04:21:38 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:01.316 04:21:38 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:01.316 04:21:38 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:01.574 04:21:38 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4718fb2e-4b42-4a12-920b-42cefcb0843e 00:15:01.832 04:21:39 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:02.090 04:21:39 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:02.349 04:21:39 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3881191 00:15:02.349 04:21:39 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:02.349 04:21:39 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:02.349 04:21:39 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3881191 /var/tmp/bdevperf.sock 00:15:02.349 04:21:39 -- common/autotest_common.sh@829 -- # '[' -z 3881191 ']' 00:15:02.349 04:21:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:02.349 04:21:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:02.349 04:21:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:02.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:02.349 04:21:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:02.349 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:15:02.608 [2024-11-28 04:21:39.659975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:02.608 [2024-11-28 04:21:39.660062] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3881191 ] 00:15:02.608 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.608 [2024-11-28 04:21:39.723839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:02.608 [2024-11-28 04:21:39.841435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:03.544 04:21:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:03.544 04:21:40 -- common/autotest_common.sh@862 -- # return 0 00:15:03.544 04:21:40 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:03.802 Nvme0n1 00:15:03.802 04:21:41 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:04.061 [ 00:15:04.061 { 00:15:04.061 "name": "Nvme0n1", 00:15:04.061 "aliases": [ 00:15:04.061 "4718fb2e-4b42-4a12-920b-42cefcb0843e" 00:15:04.061 ], 00:15:04.061 "product_name": "NVMe disk", 00:15:04.061 "block_size": 4096, 00:15:04.061 "num_blocks": 38912, 00:15:04.061 "uuid": "4718fb2e-4b42-4a12-920b-42cefcb0843e", 00:15:04.061 "assigned_rate_limits": { 00:15:04.061 "rw_ios_per_sec": 0, 00:15:04.061 "rw_mbytes_per_sec": 0, 00:15:04.061 "r_mbytes_per_sec": 0, 00:15:04.061 "w_mbytes_per_sec": 0 00:15:04.061 }, 00:15:04.061 "claimed": false, 00:15:04.061 "zoned": false, 00:15:04.061 "supported_io_types": { 00:15:04.061 "read": true, 00:15:04.061 "write": true, 00:15:04.061 "unmap": true, 00:15:04.061 "write_zeroes": true, 00:15:04.061 "flush": true, 00:15:04.061 "reset": true, 00:15:04.061 "compare": true, 00:15:04.061 "compare_and_write": true, 00:15:04.061 "abort": true, 00:15:04.061 "nvme_admin": true, 00:15:04.061 "nvme_io": true 00:15:04.061 }, 00:15:04.061 "driver_specific": { 00:15:04.061 "nvme": [ 00:15:04.061 { 00:15:04.061 "trid": { 00:15:04.061 "trtype": "TCP", 00:15:04.061 "adrfam": "IPv4", 00:15:04.061 "traddr": "10.0.0.2", 00:15:04.061 "trsvcid": "4420", 00:15:04.061 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:04.061 }, 00:15:04.061 "ctrlr_data": { 00:15:04.061 "cntlid": 1, 00:15:04.061 "vendor_id": "0x8086", 00:15:04.061 "model_number": "SPDK bdev Controller", 00:15:04.061 "serial_number": "SPDK0", 00:15:04.061 "firmware_revision": "24.01.1", 00:15:04.061 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:04.061 "oacs": { 00:15:04.061 "security": 0, 00:15:04.061 "format": 0, 00:15:04.061 "firmware": 0, 00:15:04.061 "ns_manage": 0 00:15:04.061 }, 00:15:04.061 "multi_ctrlr": true, 00:15:04.061 "ana_reporting": false 00:15:04.061 }, 00:15:04.061 "vs": { 00:15:04.061 "nvme_version": "1.3" 00:15:04.061 }, 00:15:04.061 "ns_data": { 00:15:04.061 "id": 1, 00:15:04.061 "can_share": true 00:15:04.061 } 00:15:04.061 } 00:15:04.061 ], 00:15:04.061 "mp_policy": "active_passive" 00:15:04.061 } 00:15:04.061 } 00:15:04.061 ] 00:15:04.061 04:21:41 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3881465 00:15:04.061 04:21:41 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:04.061 04:21:41 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:04.320 Running I/O for 10 seconds... 00:15:05.257 Latency(us) 00:15:05.257 [2024-11-28T03:21:42.568Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:05.257 [2024-11-28T03:21:42.568Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.257 Nvme0n1 : 1.00 14493.00 56.61 0.00 0.00 0.00 0.00 0.00 00:15:05.257 [2024-11-28T03:21:42.568Z] =================================================================================================================== 00:15:05.257 [2024-11-28T03:21:42.568Z] Total : 14493.00 56.61 0.00 0.00 0.00 0.00 0.00 00:15:05.257 00:15:06.194 04:21:43 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:06.194 [2024-11-28T03:21:43.505Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.194 Nvme0n1 : 2.00 14705.00 57.44 0.00 0.00 0.00 0.00 0.00 00:15:06.194 [2024-11-28T03:21:43.505Z] =================================================================================================================== 00:15:06.194 [2024-11-28T03:21:43.505Z] Total : 14705.00 57.44 0.00 0.00 0.00 0.00 0.00 00:15:06.194 00:15:06.452 true 00:15:06.452 04:21:43 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:06.452 04:21:43 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:06.711 04:21:43 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:06.711 04:21:43 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:06.711 04:21:43 -- target/nvmf_lvs_grow.sh@65 -- # wait 3881465 00:15:07.278 [2024-11-28T03:21:44.589Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.278 Nvme0n1 : 3.00 14814.67 57.87 0.00 0.00 0.00 0.00 0.00 00:15:07.278 [2024-11-28T03:21:44.589Z] =================================================================================================================== 00:15:07.278 [2024-11-28T03:21:44.589Z] Total : 14814.67 57.87 0.00 0.00 0.00 0.00 0.00 00:15:07.278 00:15:08.214 [2024-11-28T03:21:45.525Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:08.214 Nvme0n1 : 4.00 14889.25 58.16 0.00 0.00 0.00 0.00 0.00 00:15:08.214 [2024-11-28T03:21:45.525Z] =================================================================================================================== 00:15:08.214 [2024-11-28T03:21:45.525Z] Total : 14889.25 58.16 0.00 0.00 0.00 0.00 0.00 00:15:08.214 00:15:09.201 [2024-11-28T03:21:46.512Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:09.201 Nvme0n1 : 5.00 14941.00 58.36 0.00 0.00 0.00 0.00 0.00 00:15:09.201 [2024-11-28T03:21:46.512Z] =================================================================================================================== 00:15:09.201 [2024-11-28T03:21:46.512Z] Total : 14941.00 58.36 0.00 0.00 0.00 0.00 0.00 00:15:09.201 00:15:10.577 [2024-11-28T03:21:47.888Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:10.577 Nvme0n1 : 6.00 14851.00 58.01 0.00 0.00 0.00 0.00 0.00 00:15:10.577 [2024-11-28T03:21:47.888Z] =================================================================================================================== 00:15:10.577 [2024-11-28T03:21:47.888Z] Total : 14851.00 58.01 0.00 0.00 0.00 0.00 0.00 00:15:10.577 00:15:11.144 [2024-11-28T03:21:48.455Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.144 Nvme0n1 : 7.00 14756.86 57.64 0.00 0.00 0.00 0.00 0.00 00:15:11.144 [2024-11-28T03:21:48.455Z] =================================================================================================================== 00:15:11.144 [2024-11-28T03:21:48.455Z] Total : 14756.86 57.64 0.00 0.00 0.00 0.00 0.00 00:15:11.144 00:15:12.520 [2024-11-28T03:21:49.831Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:12.520 Nvme0n1 : 8.00 14689.25 57.38 0.00 0.00 0.00 0.00 0.00 00:15:12.520 [2024-11-28T03:21:49.831Z] =================================================================================================================== 00:15:12.520 [2024-11-28T03:21:49.831Z] Total : 14689.25 57.38 0.00 0.00 0.00 0.00 0.00 00:15:12.520 00:15:13.456 [2024-11-28T03:21:50.767Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.456 Nvme0n1 : 9.00 14625.11 57.13 0.00 0.00 0.00 0.00 0.00 00:15:13.456 [2024-11-28T03:21:50.767Z] =================================================================================================================== 00:15:13.456 [2024-11-28T03:21:50.767Z] Total : 14625.11 57.13 0.00 0.00 0.00 0.00 0.00 00:15:13.456 00:15:14.391 [2024-11-28T03:21:51.702Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.391 Nvme0n1 : 10.00 14585.00 56.97 0.00 0.00 0.00 0.00 0.00 00:15:14.391 [2024-11-28T03:21:51.702Z] =================================================================================================================== 00:15:14.391 [2024-11-28T03:21:51.702Z] Total : 14585.00 56.97 0.00 0.00 0.00 0.00 0.00 00:15:14.391 00:15:14.391 00:15:14.391 Latency(us) 00:15:14.391 [2024-11-28T03:21:51.702Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:14.391 [2024-11-28T03:21:51.702Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.391 Nvme0n1 : 10.01 14584.03 56.97 0.00 0.00 8768.73 2354.44 18350.08 00:15:14.391 [2024-11-28T03:21:51.702Z] =================================================================================================================== 00:15:14.391 [2024-11-28T03:21:51.702Z] Total : 14584.03 56.97 0.00 0.00 8768.73 2354.44 18350.08 00:15:14.391 0 00:15:14.391 04:21:51 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3881191 00:15:14.391 04:21:51 -- common/autotest_common.sh@936 -- # '[' -z 3881191 ']' 00:15:14.391 04:21:51 -- common/autotest_common.sh@940 -- # kill -0 3881191 00:15:14.391 04:21:51 -- common/autotest_common.sh@941 -- # uname 00:15:14.391 04:21:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:14.391 04:21:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3881191 00:15:14.391 04:21:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:14.391 04:21:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:14.391 04:21:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3881191' 00:15:14.391 killing process with pid 3881191 00:15:14.391 04:21:51 -- common/autotest_common.sh@955 -- # kill 3881191 00:15:14.391 Received shutdown signal, test time was about 10.000000 seconds 00:15:14.391 00:15:14.391 Latency(us) 00:15:14.391 [2024-11-28T03:21:51.702Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:14.391 [2024-11-28T03:21:51.702Z] =================================================================================================================== 00:15:14.391 [2024-11-28T03:21:51.702Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:14.391 04:21:51 -- common/autotest_common.sh@960 -- # wait 3881191 00:15:14.649 04:21:51 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:14.907 04:21:52 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:14.907 04:21:52 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:15.166 04:21:52 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:15.166 04:21:52 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:15.166 04:21:52 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3878497 00:15:15.166 04:21:52 -- target/nvmf_lvs_grow.sh@74 -- # wait 3878497 00:15:15.166 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3878497 Killed "${NVMF_APP[@]}" "$@" 00:15:15.166 04:21:52 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:15.166 04:21:52 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:15.166 04:21:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:15.166 04:21:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:15.166 04:21:52 -- common/autotest_common.sh@10 -- # set +x 00:15:15.166 04:21:52 -- nvmf/common.sh@469 -- # nvmfpid=3882835 00:15:15.166 04:21:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:15.166 04:21:52 -- nvmf/common.sh@470 -- # waitforlisten 3882835 00:15:15.166 04:21:52 -- common/autotest_common.sh@829 -- # '[' -z 3882835 ']' 00:15:15.166 04:21:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:15.166 04:21:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:15.166 04:21:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:15.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:15.166 04:21:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:15.166 04:21:52 -- common/autotest_common.sh@10 -- # set +x 00:15:15.166 [2024-11-28 04:21:52.402919] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:15.166 [2024-11-28 04:21:52.402999] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:15.166 EAL: No free 2048 kB hugepages reported on node 1 00:15:15.166 [2024-11-28 04:21:52.466798] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:15.424 [2024-11-28 04:21:52.577054] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:15.424 [2024-11-28 04:21:52.577196] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:15.424 [2024-11-28 04:21:52.577212] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:15.424 [2024-11-28 04:21:52.577224] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:15.424 [2024-11-28 04:21:52.577259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:16.371 04:21:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:16.371 04:21:53 -- common/autotest_common.sh@862 -- # return 0 00:15:16.371 04:21:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:16.371 04:21:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:16.371 04:21:53 -- common/autotest_common.sh@10 -- # set +x 00:15:16.371 04:21:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:16.371 04:21:53 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:16.371 [2024-11-28 04:21:53.624818] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:16.371 [2024-11-28 04:21:53.624964] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:16.371 [2024-11-28 04:21:53.625012] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:16.371 04:21:53 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:16.371 04:21:53 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 4718fb2e-4b42-4a12-920b-42cefcb0843e 00:15:16.371 04:21:53 -- common/autotest_common.sh@897 -- # local bdev_name=4718fb2e-4b42-4a12-920b-42cefcb0843e 00:15:16.371 04:21:53 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:16.371 04:21:53 -- common/autotest_common.sh@899 -- # local i 00:15:16.371 04:21:53 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:16.371 04:21:53 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:16.371 04:21:53 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:16.628 04:21:53 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 4718fb2e-4b42-4a12-920b-42cefcb0843e -t 2000 00:15:16.885 [ 00:15:16.885 { 00:15:16.885 "name": "4718fb2e-4b42-4a12-920b-42cefcb0843e", 00:15:16.885 "aliases": [ 00:15:16.885 "lvs/lvol" 00:15:16.885 ], 00:15:16.885 "product_name": "Logical Volume", 00:15:16.885 "block_size": 4096, 00:15:16.885 "num_blocks": 38912, 00:15:16.885 "uuid": "4718fb2e-4b42-4a12-920b-42cefcb0843e", 00:15:16.885 "assigned_rate_limits": { 00:15:16.885 "rw_ios_per_sec": 0, 00:15:16.885 "rw_mbytes_per_sec": 0, 00:15:16.885 "r_mbytes_per_sec": 0, 00:15:16.885 "w_mbytes_per_sec": 0 00:15:16.885 }, 00:15:16.885 "claimed": false, 00:15:16.885 "zoned": false, 00:15:16.885 "supported_io_types": { 00:15:16.885 "read": true, 00:15:16.885 "write": true, 00:15:16.885 "unmap": true, 00:15:16.885 "write_zeroes": true, 00:15:16.885 "flush": false, 00:15:16.885 "reset": true, 00:15:16.885 "compare": false, 00:15:16.885 "compare_and_write": false, 00:15:16.885 "abort": false, 00:15:16.885 "nvme_admin": false, 00:15:16.885 "nvme_io": false 00:15:16.885 }, 00:15:16.885 "driver_specific": { 00:15:16.885 "lvol": { 00:15:16.885 "lvol_store_uuid": "e7ab5c38-275b-4a63-bc13-06b227696eba", 00:15:16.885 "base_bdev": "aio_bdev", 00:15:16.885 "thin_provision": false, 00:15:16.885 "snapshot": false, 00:15:16.885 "clone": false, 00:15:16.885 "esnap_clone": false 00:15:16.885 } 00:15:16.885 } 00:15:16.885 } 00:15:16.885 ] 00:15:16.885 04:21:54 -- common/autotest_common.sh@905 -- # return 0 00:15:16.885 04:21:54 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:16.885 04:21:54 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:17.142 04:21:54 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:17.142 04:21:54 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:17.142 04:21:54 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:17.400 04:21:54 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:17.400 04:21:54 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:17.657 [2024-11-28 04:21:54.898160] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:17.657 04:21:54 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:17.657 04:21:54 -- common/autotest_common.sh@650 -- # local es=0 00:15:17.657 04:21:54 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:17.657 04:21:54 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:17.657 04:21:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:17.657 04:21:54 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:17.657 04:21:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:17.657 04:21:54 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:17.657 04:21:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:17.657 04:21:54 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:17.657 04:21:54 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:17.657 04:21:54 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:17.917 request: 00:15:17.917 { 00:15:17.917 "uuid": "e7ab5c38-275b-4a63-bc13-06b227696eba", 00:15:17.917 "method": "bdev_lvol_get_lvstores", 00:15:17.917 "req_id": 1 00:15:17.917 } 00:15:17.918 Got JSON-RPC error response 00:15:17.918 response: 00:15:17.918 { 00:15:17.918 "code": -19, 00:15:17.918 "message": "No such device" 00:15:17.918 } 00:15:17.918 04:21:55 -- common/autotest_common.sh@653 -- # es=1 00:15:17.918 04:21:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:17.918 04:21:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:17.918 04:21:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:17.918 04:21:55 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:18.179 aio_bdev 00:15:18.437 04:21:55 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 4718fb2e-4b42-4a12-920b-42cefcb0843e 00:15:18.437 04:21:55 -- common/autotest_common.sh@897 -- # local bdev_name=4718fb2e-4b42-4a12-920b-42cefcb0843e 00:15:18.437 04:21:55 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:18.437 04:21:55 -- common/autotest_common.sh@899 -- # local i 00:15:18.437 04:21:55 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:18.437 04:21:55 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:18.437 04:21:55 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:18.695 04:21:55 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 4718fb2e-4b42-4a12-920b-42cefcb0843e -t 2000 00:15:18.695 [ 00:15:18.695 { 00:15:18.695 "name": "4718fb2e-4b42-4a12-920b-42cefcb0843e", 00:15:18.695 "aliases": [ 00:15:18.695 "lvs/lvol" 00:15:18.695 ], 00:15:18.695 "product_name": "Logical Volume", 00:15:18.695 "block_size": 4096, 00:15:18.695 "num_blocks": 38912, 00:15:18.695 "uuid": "4718fb2e-4b42-4a12-920b-42cefcb0843e", 00:15:18.695 "assigned_rate_limits": { 00:15:18.695 "rw_ios_per_sec": 0, 00:15:18.695 "rw_mbytes_per_sec": 0, 00:15:18.695 "r_mbytes_per_sec": 0, 00:15:18.695 "w_mbytes_per_sec": 0 00:15:18.695 }, 00:15:18.695 "claimed": false, 00:15:18.695 "zoned": false, 00:15:18.695 "supported_io_types": { 00:15:18.695 "read": true, 00:15:18.695 "write": true, 00:15:18.695 "unmap": true, 00:15:18.695 "write_zeroes": true, 00:15:18.695 "flush": false, 00:15:18.695 "reset": true, 00:15:18.695 "compare": false, 00:15:18.695 "compare_and_write": false, 00:15:18.695 "abort": false, 00:15:18.695 "nvme_admin": false, 00:15:18.695 "nvme_io": false 00:15:18.695 }, 00:15:18.695 "driver_specific": { 00:15:18.695 "lvol": { 00:15:18.695 "lvol_store_uuid": "e7ab5c38-275b-4a63-bc13-06b227696eba", 00:15:18.695 "base_bdev": "aio_bdev", 00:15:18.695 "thin_provision": false, 00:15:18.695 "snapshot": false, 00:15:18.695 "clone": false, 00:15:18.695 "esnap_clone": false 00:15:18.695 } 00:15:18.695 } 00:15:18.695 } 00:15:18.695 ] 00:15:18.695 04:21:56 -- common/autotest_common.sh@905 -- # return 0 00:15:18.695 04:21:56 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:18.955 04:21:56 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:18.955 04:21:56 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:18.955 04:21:56 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:18.955 04:21:56 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:19.212 04:21:56 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:19.212 04:21:56 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4718fb2e-4b42-4a12-920b-42cefcb0843e 00:15:19.470 04:21:56 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e7ab5c38-275b-4a63-bc13-06b227696eba 00:15:19.728 04:21:57 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:19.986 04:21:57 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:20.243 00:15:20.243 real 0m20.284s 00:15:20.243 user 0m49.649s 00:15:20.243 sys 0m5.260s 00:15:20.243 04:21:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:20.243 04:21:57 -- common/autotest_common.sh@10 -- # set +x 00:15:20.243 ************************************ 00:15:20.243 END TEST lvs_grow_dirty 00:15:20.243 ************************************ 00:15:20.243 04:21:57 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:20.243 04:21:57 -- common/autotest_common.sh@806 -- # type=--id 00:15:20.243 04:21:57 -- common/autotest_common.sh@807 -- # id=0 00:15:20.243 04:21:57 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:20.243 04:21:57 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:20.243 04:21:57 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:20.243 04:21:57 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:20.243 04:21:57 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:20.243 04:21:57 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:20.243 nvmf_trace.0 00:15:20.243 04:21:57 -- common/autotest_common.sh@821 -- # return 0 00:15:20.243 04:21:57 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:20.243 04:21:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:20.243 04:21:57 -- nvmf/common.sh@116 -- # sync 00:15:20.243 04:21:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:20.243 04:21:57 -- nvmf/common.sh@119 -- # set +e 00:15:20.243 04:21:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:20.243 04:21:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:20.243 rmmod nvme_tcp 00:15:20.243 rmmod nvme_fabrics 00:15:20.243 rmmod nvme_keyring 00:15:20.243 04:21:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:20.243 04:21:57 -- nvmf/common.sh@123 -- # set -e 00:15:20.243 04:21:57 -- nvmf/common.sh@124 -- # return 0 00:15:20.243 04:21:57 -- nvmf/common.sh@477 -- # '[' -n 3882835 ']' 00:15:20.243 04:21:57 -- nvmf/common.sh@478 -- # killprocess 3882835 00:15:20.243 04:21:57 -- common/autotest_common.sh@936 -- # '[' -z 3882835 ']' 00:15:20.243 04:21:57 -- common/autotest_common.sh@940 -- # kill -0 3882835 00:15:20.243 04:21:57 -- common/autotest_common.sh@941 -- # uname 00:15:20.243 04:21:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:20.243 04:21:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3882835 00:15:20.243 04:21:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:20.243 04:21:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:20.243 04:21:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3882835' 00:15:20.243 killing process with pid 3882835 00:15:20.243 04:21:57 -- common/autotest_common.sh@955 -- # kill 3882835 00:15:20.243 04:21:57 -- common/autotest_common.sh@960 -- # wait 3882835 00:15:20.501 04:21:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:20.501 04:21:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:20.501 04:21:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:20.501 04:21:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:20.501 04:21:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:20.501 04:21:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:20.501 04:21:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:20.501 04:21:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:23.031 04:21:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:23.031 00:15:23.031 real 0m44.489s 00:15:23.031 user 1m14.224s 00:15:23.031 sys 0m8.928s 00:15:23.031 04:21:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:23.031 04:21:59 -- common/autotest_common.sh@10 -- # set +x 00:15:23.031 ************************************ 00:15:23.031 END TEST nvmf_lvs_grow 00:15:23.031 ************************************ 00:15:23.031 04:21:59 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:23.031 04:21:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:23.031 04:21:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:23.031 04:21:59 -- common/autotest_common.sh@10 -- # set +x 00:15:23.031 ************************************ 00:15:23.031 START TEST nvmf_bdev_io_wait 00:15:23.031 ************************************ 00:15:23.031 04:21:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:23.031 * Looking for test storage... 00:15:23.031 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:23.031 04:21:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:23.031 04:21:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:23.031 04:21:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:23.031 04:21:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:23.032 04:21:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:23.032 04:21:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:23.032 04:21:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:23.032 04:21:59 -- scripts/common.sh@335 -- # IFS=.-: 00:15:23.032 04:21:59 -- scripts/common.sh@335 -- # read -ra ver1 00:15:23.032 04:21:59 -- scripts/common.sh@336 -- # IFS=.-: 00:15:23.032 04:21:59 -- scripts/common.sh@336 -- # read -ra ver2 00:15:23.032 04:21:59 -- scripts/common.sh@337 -- # local 'op=<' 00:15:23.032 04:21:59 -- scripts/common.sh@339 -- # ver1_l=2 00:15:23.032 04:21:59 -- scripts/common.sh@340 -- # ver2_l=1 00:15:23.032 04:21:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:23.032 04:21:59 -- scripts/common.sh@343 -- # case "$op" in 00:15:23.032 04:21:59 -- scripts/common.sh@344 -- # : 1 00:15:23.032 04:21:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:23.032 04:21:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:23.032 04:21:59 -- scripts/common.sh@364 -- # decimal 1 00:15:23.032 04:21:59 -- scripts/common.sh@352 -- # local d=1 00:15:23.032 04:21:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:23.032 04:21:59 -- scripts/common.sh@354 -- # echo 1 00:15:23.032 04:21:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:23.032 04:21:59 -- scripts/common.sh@365 -- # decimal 2 00:15:23.032 04:21:59 -- scripts/common.sh@352 -- # local d=2 00:15:23.032 04:21:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:23.032 04:21:59 -- scripts/common.sh@354 -- # echo 2 00:15:23.032 04:21:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:23.032 04:21:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:23.032 04:21:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:23.032 04:21:59 -- scripts/common.sh@367 -- # return 0 00:15:23.032 04:21:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:23.032 04:21:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:23.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.032 --rc genhtml_branch_coverage=1 00:15:23.032 --rc genhtml_function_coverage=1 00:15:23.032 --rc genhtml_legend=1 00:15:23.032 --rc geninfo_all_blocks=1 00:15:23.032 --rc geninfo_unexecuted_blocks=1 00:15:23.032 00:15:23.032 ' 00:15:23.032 04:21:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:23.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.032 --rc genhtml_branch_coverage=1 00:15:23.032 --rc genhtml_function_coverage=1 00:15:23.032 --rc genhtml_legend=1 00:15:23.032 --rc geninfo_all_blocks=1 00:15:23.032 --rc geninfo_unexecuted_blocks=1 00:15:23.032 00:15:23.032 ' 00:15:23.032 04:21:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:23.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.032 --rc genhtml_branch_coverage=1 00:15:23.032 --rc genhtml_function_coverage=1 00:15:23.032 --rc genhtml_legend=1 00:15:23.032 --rc geninfo_all_blocks=1 00:15:23.032 --rc geninfo_unexecuted_blocks=1 00:15:23.032 00:15:23.032 ' 00:15:23.032 04:21:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:23.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.032 --rc genhtml_branch_coverage=1 00:15:23.032 --rc genhtml_function_coverage=1 00:15:23.032 --rc genhtml_legend=1 00:15:23.032 --rc geninfo_all_blocks=1 00:15:23.032 --rc geninfo_unexecuted_blocks=1 00:15:23.032 00:15:23.032 ' 00:15:23.032 04:21:59 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:23.032 04:21:59 -- nvmf/common.sh@7 -- # uname -s 00:15:23.032 04:21:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:23.032 04:21:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:23.032 04:21:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:23.032 04:21:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:23.032 04:21:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:23.032 04:21:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:23.032 04:21:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:23.032 04:21:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:23.032 04:21:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:23.032 04:21:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:23.032 04:21:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:23.032 04:21:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:23.032 04:21:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:23.032 04:21:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:23.032 04:21:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:23.032 04:21:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:23.032 04:21:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:23.032 04:21:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:23.032 04:21:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:23.032 04:21:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.032 04:21:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.032 04:21:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.032 04:21:59 -- paths/export.sh@5 -- # export PATH 00:15:23.032 04:21:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.032 04:21:59 -- nvmf/common.sh@46 -- # : 0 00:15:23.032 04:21:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:23.032 04:21:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:23.032 04:21:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:23.032 04:21:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:23.032 04:21:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:23.032 04:21:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:23.032 04:21:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:23.032 04:21:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:23.032 04:21:59 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:23.032 04:21:59 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:23.032 04:21:59 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:23.032 04:21:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:23.032 04:21:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:23.032 04:21:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:23.032 04:21:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:23.032 04:21:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:23.032 04:21:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:23.032 04:21:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:23.032 04:21:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:23.032 04:21:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:23.032 04:21:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:23.033 04:21:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:23.033 04:21:59 -- common/autotest_common.sh@10 -- # set +x 00:15:24.932 04:22:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:24.932 04:22:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:24.932 04:22:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:24.932 04:22:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:24.932 04:22:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:24.932 04:22:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:24.932 04:22:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:24.932 04:22:02 -- nvmf/common.sh@294 -- # net_devs=() 00:15:24.932 04:22:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:24.932 04:22:02 -- nvmf/common.sh@295 -- # e810=() 00:15:24.932 04:22:02 -- nvmf/common.sh@295 -- # local -ga e810 00:15:24.932 04:22:02 -- nvmf/common.sh@296 -- # x722=() 00:15:24.932 04:22:02 -- nvmf/common.sh@296 -- # local -ga x722 00:15:24.932 04:22:02 -- nvmf/common.sh@297 -- # mlx=() 00:15:24.932 04:22:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:24.932 04:22:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:24.932 04:22:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:24.932 04:22:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:24.932 04:22:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:24.932 04:22:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:24.932 04:22:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:24.932 04:22:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:24.932 04:22:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.932 04:22:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:24.932 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:24.932 04:22:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.932 04:22:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.933 04:22:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:24.933 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:24.933 04:22:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:24.933 04:22:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.933 04:22:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.933 04:22:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.933 04:22:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.933 04:22:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:24.933 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:24.933 04:22:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.933 04:22:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.933 04:22:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.933 04:22:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.933 04:22:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.933 04:22:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:24.933 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:24.933 04:22:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.933 04:22:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:24.933 04:22:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:24.933 04:22:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:24.933 04:22:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:24.933 04:22:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:24.933 04:22:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:24.933 04:22:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:24.933 04:22:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:24.933 04:22:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:24.933 04:22:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:24.933 04:22:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:24.933 04:22:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:24.933 04:22:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:24.933 04:22:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:24.933 04:22:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:24.933 04:22:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:24.933 04:22:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:24.933 04:22:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:24.933 04:22:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:24.933 04:22:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:24.933 04:22:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:24.933 04:22:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:24.933 04:22:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:24.933 04:22:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:24.933 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:24.933 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:15:24.933 00:15:24.933 --- 10.0.0.2 ping statistics --- 00:15:24.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.933 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:15:24.933 04:22:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:25.192 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:25.192 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:15:25.192 00:15:25.192 --- 10.0.0.1 ping statistics --- 00:15:25.192 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:25.192 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:15:25.192 04:22:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:25.192 04:22:02 -- nvmf/common.sh@410 -- # return 0 00:15:25.192 04:22:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:25.192 04:22:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:25.192 04:22:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:25.192 04:22:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:25.192 04:22:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:25.192 04:22:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:25.192 04:22:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:25.192 04:22:02 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:25.192 04:22:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:25.192 04:22:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:25.192 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.192 04:22:02 -- nvmf/common.sh@469 -- # nvmfpid=3885405 00:15:25.192 04:22:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:25.192 04:22:02 -- nvmf/common.sh@470 -- # waitforlisten 3885405 00:15:25.192 04:22:02 -- common/autotest_common.sh@829 -- # '[' -z 3885405 ']' 00:15:25.192 04:22:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:25.192 04:22:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:25.192 04:22:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:25.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:25.192 04:22:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:25.192 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.192 [2024-11-28 04:22:02.314319] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.192 [2024-11-28 04:22:02.314395] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:25.192 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.192 [2024-11-28 04:22:02.379164] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:25.192 [2024-11-28 04:22:02.487866] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:25.192 [2024-11-28 04:22:02.488031] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:25.192 [2024-11-28 04:22:02.488048] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:25.192 [2024-11-28 04:22:02.488060] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:25.192 [2024-11-28 04:22:02.488114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:25.192 [2024-11-28 04:22:02.488184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:25.192 [2024-11-28 04:22:02.488156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:25.192 [2024-11-28 04:22:02.488187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:25.451 04:22:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:25.451 04:22:02 -- common/autotest_common.sh@862 -- # return 0 00:15:25.451 04:22:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:25.451 04:22:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 04:22:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:25.451 04:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 04:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:25.451 04:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 04:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:25.451 04:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 [2024-11-28 04:22:02.645923] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:25.451 04:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:25.451 04:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 Malloc0 00:15:25.451 04:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:25.451 04:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 04:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:25.451 04:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 04:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:25.451 04:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.451 04:22:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.451 [2024-11-28 04:22:02.709307] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:25.451 04:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3885546 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@30 -- # READ_PID=3885548 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:25.451 04:22:02 -- nvmf/common.sh@520 -- # config=() 00:15:25.451 04:22:02 -- nvmf/common.sh@520 -- # local subsystem config 00:15:25.451 04:22:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3885550 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:25.451 04:22:02 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:25.451 04:22:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:25.451 { 00:15:25.451 "params": { 00:15:25.451 "name": "Nvme$subsystem", 00:15:25.451 "trtype": "$TEST_TRANSPORT", 00:15:25.451 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:25.451 "adrfam": "ipv4", 00:15:25.451 "trsvcid": "$NVMF_PORT", 00:15:25.451 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:25.451 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:25.451 "hdgst": ${hdgst:-false}, 00:15:25.452 "ddgst": ${ddgst:-false} 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 } 00:15:25.452 EOF 00:15:25.452 )") 00:15:25.452 04:22:02 -- nvmf/common.sh@520 -- # config=() 00:15:25.452 04:22:02 -- nvmf/common.sh@520 -- # local subsystem config 00:15:25.452 04:22:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:25.452 04:22:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:25.452 { 00:15:25.452 "params": { 00:15:25.452 "name": "Nvme$subsystem", 00:15:25.452 "trtype": "$TEST_TRANSPORT", 00:15:25.452 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:25.452 "adrfam": "ipv4", 00:15:25.452 "trsvcid": "$NVMF_PORT", 00:15:25.452 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:25.452 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:25.452 "hdgst": ${hdgst:-false}, 00:15:25.452 "ddgst": ${ddgst:-false} 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 } 00:15:25.452 EOF 00:15:25.452 )") 00:15:25.452 04:22:02 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3885552 00:15:25.452 04:22:02 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:25.452 04:22:02 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:25.452 04:22:02 -- target/bdev_io_wait.sh@35 -- # sync 00:15:25.452 04:22:02 -- nvmf/common.sh@520 -- # config=() 00:15:25.452 04:22:02 -- nvmf/common.sh@520 -- # local subsystem config 00:15:25.452 04:22:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:25.452 04:22:02 -- nvmf/common.sh@542 -- # cat 00:15:25.452 04:22:02 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:25.452 04:22:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:25.452 { 00:15:25.452 "params": { 00:15:25.452 "name": "Nvme$subsystem", 00:15:25.452 "trtype": "$TEST_TRANSPORT", 00:15:25.452 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:25.452 "adrfam": "ipv4", 00:15:25.452 "trsvcid": "$NVMF_PORT", 00:15:25.452 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:25.452 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:25.452 "hdgst": ${hdgst:-false}, 00:15:25.452 "ddgst": ${ddgst:-false} 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 } 00:15:25.452 EOF 00:15:25.452 )") 00:15:25.452 04:22:02 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:25.452 04:22:02 -- nvmf/common.sh@520 -- # config=() 00:15:25.452 04:22:02 -- nvmf/common.sh@542 -- # cat 00:15:25.452 04:22:02 -- nvmf/common.sh@520 -- # local subsystem config 00:15:25.452 04:22:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:25.452 04:22:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:25.452 { 00:15:25.452 "params": { 00:15:25.452 "name": "Nvme$subsystem", 00:15:25.452 "trtype": "$TEST_TRANSPORT", 00:15:25.452 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:25.452 "adrfam": "ipv4", 00:15:25.452 "trsvcid": "$NVMF_PORT", 00:15:25.452 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:25.452 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:25.452 "hdgst": ${hdgst:-false}, 00:15:25.452 "ddgst": ${ddgst:-false} 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 } 00:15:25.452 EOF 00:15:25.452 )") 00:15:25.452 04:22:02 -- nvmf/common.sh@542 -- # cat 00:15:25.452 04:22:02 -- target/bdev_io_wait.sh@37 -- # wait 3885546 00:15:25.452 04:22:02 -- nvmf/common.sh@542 -- # cat 00:15:25.452 04:22:02 -- nvmf/common.sh@544 -- # jq . 00:15:25.452 04:22:02 -- nvmf/common.sh@544 -- # jq . 00:15:25.452 04:22:02 -- nvmf/common.sh@544 -- # jq . 00:15:25.452 04:22:02 -- nvmf/common.sh@545 -- # IFS=, 00:15:25.452 04:22:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:25.452 "params": { 00:15:25.452 "name": "Nvme1", 00:15:25.452 "trtype": "tcp", 00:15:25.452 "traddr": "10.0.0.2", 00:15:25.452 "adrfam": "ipv4", 00:15:25.452 "trsvcid": "4420", 00:15:25.452 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.452 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:25.452 "hdgst": false, 00:15:25.452 "ddgst": false 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 }' 00:15:25.452 04:22:02 -- nvmf/common.sh@544 -- # jq . 00:15:25.452 04:22:02 -- nvmf/common.sh@545 -- # IFS=, 00:15:25.452 04:22:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:25.452 "params": { 00:15:25.452 "name": "Nvme1", 00:15:25.452 "trtype": "tcp", 00:15:25.452 "traddr": "10.0.0.2", 00:15:25.452 "adrfam": "ipv4", 00:15:25.452 "trsvcid": "4420", 00:15:25.452 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.452 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:25.452 "hdgst": false, 00:15:25.452 "ddgst": false 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 }' 00:15:25.452 04:22:02 -- nvmf/common.sh@545 -- # IFS=, 00:15:25.452 04:22:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:25.452 "params": { 00:15:25.452 "name": "Nvme1", 00:15:25.452 "trtype": "tcp", 00:15:25.452 "traddr": "10.0.0.2", 00:15:25.452 "adrfam": "ipv4", 00:15:25.452 "trsvcid": "4420", 00:15:25.452 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.452 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:25.452 "hdgst": false, 00:15:25.452 "ddgst": false 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 }' 00:15:25.452 04:22:02 -- nvmf/common.sh@545 -- # IFS=, 00:15:25.452 04:22:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:25.452 "params": { 00:15:25.452 "name": "Nvme1", 00:15:25.452 "trtype": "tcp", 00:15:25.452 "traddr": "10.0.0.2", 00:15:25.452 "adrfam": "ipv4", 00:15:25.452 "trsvcid": "4420", 00:15:25.452 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.452 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:25.452 "hdgst": false, 00:15:25.452 "ddgst": false 00:15:25.452 }, 00:15:25.452 "method": "bdev_nvme_attach_controller" 00:15:25.452 }' 00:15:25.452 [2024-11-28 04:22:02.752433] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.452 [2024-11-28 04:22:02.752432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.452 [2024-11-28 04:22:02.752432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.452 [2024-11-28 04:22:02.752546] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:25.452 [2024-11-28 04:22:02.752550] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 04:22:02.752553] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:25.452 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:25.452 [2024-11-28 04:22:02.753637] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.452 [2024-11-28 04:22:02.753707] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:25.711 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.711 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.711 [2024-11-28 04:22:02.924961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.711 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.711 [2024-11-28 04:22:03.020281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:25.968 [2024-11-28 04:22:03.026655] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.968 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.968 [2024-11-28 04:22:03.123680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:25.968 [2024-11-28 04:22:03.130698] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.968 [2024-11-28 04:22:03.203628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.968 [2024-11-28 04:22:03.230518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:26.226 [2024-11-28 04:22:03.297012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:26.226 Running I/O for 1 seconds... 00:15:26.227 Running I/O for 1 seconds... 00:15:26.227 Running I/O for 1 seconds... 00:15:26.227 Running I/O for 1 seconds... 00:15:27.163 00:15:27.163 Latency(us) 00:15:27.163 [2024-11-28T03:22:04.474Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:27.163 [2024-11-28T03:22:04.474Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:27.163 Nvme1n1 : 1.01 12228.31 47.77 0.00 0.00 10429.60 6407.96 19223.89 00:15:27.163 [2024-11-28T03:22:04.474Z] =================================================================================================================== 00:15:27.163 [2024-11-28T03:22:04.474Z] Total : 12228.31 47.77 0.00 0.00 10429.60 6407.96 19223.89 00:15:27.163 00:15:27.163 Latency(us) 00:15:27.163 [2024-11-28T03:22:04.474Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:27.163 [2024-11-28T03:22:04.474Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:27.163 Nvme1n1 : 1.02 5596.49 21.86 0.00 0.00 22556.40 8738.13 34564.17 00:15:27.163 [2024-11-28T03:22:04.474Z] =================================================================================================================== 00:15:27.163 [2024-11-28T03:22:04.474Z] Total : 5596.49 21.86 0.00 0.00 22556.40 8738.13 34564.17 00:15:27.163 00:15:27.163 Latency(us) 00:15:27.163 [2024-11-28T03:22:04.474Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:27.163 [2024-11-28T03:22:04.474Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:27.163 Nvme1n1 : 1.00 176112.35 687.94 0.00 0.00 724.04 271.55 1001.24 00:15:27.163 [2024-11-28T03:22:04.474Z] =================================================================================================================== 00:15:27.163 [2024-11-28T03:22:04.474Z] Total : 176112.35 687.94 0.00 0.00 724.04 271.55 1001.24 00:15:27.422 00:15:27.422 Latency(us) 00:15:27.422 [2024-11-28T03:22:04.733Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:27.422 [2024-11-28T03:22:04.733Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:27.422 Nvme1n1 : 1.01 5863.70 22.91 0.00 0.00 21755.75 6165.24 51263.72 00:15:27.422 [2024-11-28T03:22:04.733Z] =================================================================================================================== 00:15:27.422 [2024-11-28T03:22:04.733Z] Total : 5863.70 22.91 0.00 0.00 21755.75 6165.24 51263.72 00:15:27.680 04:22:04 -- target/bdev_io_wait.sh@38 -- # wait 3885548 00:15:27.680 04:22:04 -- target/bdev_io_wait.sh@39 -- # wait 3885550 00:15:27.680 04:22:04 -- target/bdev_io_wait.sh@40 -- # wait 3885552 00:15:27.680 04:22:04 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:27.680 04:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.680 04:22:04 -- common/autotest_common.sh@10 -- # set +x 00:15:27.680 04:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.680 04:22:04 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:27.680 04:22:04 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:27.680 04:22:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:27.680 04:22:04 -- nvmf/common.sh@116 -- # sync 00:15:27.680 04:22:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:27.680 04:22:04 -- nvmf/common.sh@119 -- # set +e 00:15:27.680 04:22:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:27.680 04:22:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:27.680 rmmod nvme_tcp 00:15:27.680 rmmod nvme_fabrics 00:15:27.680 rmmod nvme_keyring 00:15:27.680 04:22:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:27.680 04:22:04 -- nvmf/common.sh@123 -- # set -e 00:15:27.680 04:22:04 -- nvmf/common.sh@124 -- # return 0 00:15:27.680 04:22:04 -- nvmf/common.sh@477 -- # '[' -n 3885405 ']' 00:15:27.680 04:22:04 -- nvmf/common.sh@478 -- # killprocess 3885405 00:15:27.680 04:22:04 -- common/autotest_common.sh@936 -- # '[' -z 3885405 ']' 00:15:27.680 04:22:04 -- common/autotest_common.sh@940 -- # kill -0 3885405 00:15:27.680 04:22:04 -- common/autotest_common.sh@941 -- # uname 00:15:27.680 04:22:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:27.680 04:22:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3885405 00:15:27.680 04:22:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:27.680 04:22:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:27.680 04:22:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3885405' 00:15:27.680 killing process with pid 3885405 00:15:27.680 04:22:04 -- common/autotest_common.sh@955 -- # kill 3885405 00:15:27.680 04:22:04 -- common/autotest_common.sh@960 -- # wait 3885405 00:15:27.937 04:22:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:27.937 04:22:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:27.937 04:22:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:27.937 04:22:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:27.937 04:22:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:27.937 04:22:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:27.937 04:22:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:27.937 04:22:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:30.467 04:22:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:30.467 00:15:30.467 real 0m7.449s 00:15:30.467 user 0m16.933s 00:15:30.468 sys 0m3.532s 00:15:30.468 04:22:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:30.468 04:22:07 -- common/autotest_common.sh@10 -- # set +x 00:15:30.468 ************************************ 00:15:30.468 END TEST nvmf_bdev_io_wait 00:15:30.468 ************************************ 00:15:30.468 04:22:07 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:30.468 04:22:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:30.468 04:22:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:30.468 04:22:07 -- common/autotest_common.sh@10 -- # set +x 00:15:30.468 ************************************ 00:15:30.468 START TEST nvmf_queue_depth 00:15:30.468 ************************************ 00:15:30.468 04:22:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:30.468 * Looking for test storage... 00:15:30.468 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:30.468 04:22:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:30.468 04:22:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:30.468 04:22:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:30.468 04:22:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:30.468 04:22:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:30.468 04:22:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:30.468 04:22:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:30.468 04:22:07 -- scripts/common.sh@335 -- # IFS=.-: 00:15:30.468 04:22:07 -- scripts/common.sh@335 -- # read -ra ver1 00:15:30.468 04:22:07 -- scripts/common.sh@336 -- # IFS=.-: 00:15:30.468 04:22:07 -- scripts/common.sh@336 -- # read -ra ver2 00:15:30.468 04:22:07 -- scripts/common.sh@337 -- # local 'op=<' 00:15:30.468 04:22:07 -- scripts/common.sh@339 -- # ver1_l=2 00:15:30.468 04:22:07 -- scripts/common.sh@340 -- # ver2_l=1 00:15:30.468 04:22:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:30.468 04:22:07 -- scripts/common.sh@343 -- # case "$op" in 00:15:30.468 04:22:07 -- scripts/common.sh@344 -- # : 1 00:15:30.468 04:22:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:30.468 04:22:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:30.468 04:22:07 -- scripts/common.sh@364 -- # decimal 1 00:15:30.468 04:22:07 -- scripts/common.sh@352 -- # local d=1 00:15:30.468 04:22:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:30.468 04:22:07 -- scripts/common.sh@354 -- # echo 1 00:15:30.468 04:22:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:30.468 04:22:07 -- scripts/common.sh@365 -- # decimal 2 00:15:30.468 04:22:07 -- scripts/common.sh@352 -- # local d=2 00:15:30.468 04:22:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:30.468 04:22:07 -- scripts/common.sh@354 -- # echo 2 00:15:30.468 04:22:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:30.468 04:22:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:30.468 04:22:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:30.468 04:22:07 -- scripts/common.sh@367 -- # return 0 00:15:30.468 04:22:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:30.468 04:22:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:30.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.468 --rc genhtml_branch_coverage=1 00:15:30.468 --rc genhtml_function_coverage=1 00:15:30.468 --rc genhtml_legend=1 00:15:30.468 --rc geninfo_all_blocks=1 00:15:30.468 --rc geninfo_unexecuted_blocks=1 00:15:30.468 00:15:30.468 ' 00:15:30.468 04:22:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:30.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.468 --rc genhtml_branch_coverage=1 00:15:30.468 --rc genhtml_function_coverage=1 00:15:30.468 --rc genhtml_legend=1 00:15:30.468 --rc geninfo_all_blocks=1 00:15:30.468 --rc geninfo_unexecuted_blocks=1 00:15:30.468 00:15:30.468 ' 00:15:30.468 04:22:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:30.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.468 --rc genhtml_branch_coverage=1 00:15:30.468 --rc genhtml_function_coverage=1 00:15:30.468 --rc genhtml_legend=1 00:15:30.468 --rc geninfo_all_blocks=1 00:15:30.468 --rc geninfo_unexecuted_blocks=1 00:15:30.468 00:15:30.468 ' 00:15:30.468 04:22:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:30.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.468 --rc genhtml_branch_coverage=1 00:15:30.468 --rc genhtml_function_coverage=1 00:15:30.468 --rc genhtml_legend=1 00:15:30.468 --rc geninfo_all_blocks=1 00:15:30.468 --rc geninfo_unexecuted_blocks=1 00:15:30.468 00:15:30.468 ' 00:15:30.468 04:22:07 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:30.468 04:22:07 -- nvmf/common.sh@7 -- # uname -s 00:15:30.468 04:22:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:30.468 04:22:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:30.468 04:22:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:30.468 04:22:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:30.468 04:22:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:30.468 04:22:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:30.468 04:22:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:30.468 04:22:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:30.468 04:22:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:30.468 04:22:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:30.468 04:22:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:30.468 04:22:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:30.468 04:22:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:30.468 04:22:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:30.468 04:22:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:30.468 04:22:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:30.468 04:22:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:30.468 04:22:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:30.468 04:22:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:30.468 04:22:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.468 04:22:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.468 04:22:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.468 04:22:07 -- paths/export.sh@5 -- # export PATH 00:15:30.468 04:22:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.468 04:22:07 -- nvmf/common.sh@46 -- # : 0 00:15:30.468 04:22:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:30.468 04:22:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:30.468 04:22:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:30.468 04:22:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:30.468 04:22:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:30.468 04:22:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:30.468 04:22:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:30.468 04:22:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:30.468 04:22:07 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:30.468 04:22:07 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:30.468 04:22:07 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:30.468 04:22:07 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:30.468 04:22:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:30.468 04:22:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:30.468 04:22:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:30.468 04:22:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:30.468 04:22:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:30.468 04:22:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:30.468 04:22:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:30.468 04:22:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:30.468 04:22:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:30.468 04:22:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:30.468 04:22:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:30.468 04:22:07 -- common/autotest_common.sh@10 -- # set +x 00:15:32.369 04:22:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:32.369 04:22:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:32.369 04:22:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:32.369 04:22:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:32.369 04:22:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:32.369 04:22:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:32.369 04:22:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:32.369 04:22:09 -- nvmf/common.sh@294 -- # net_devs=() 00:15:32.369 04:22:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:32.369 04:22:09 -- nvmf/common.sh@295 -- # e810=() 00:15:32.369 04:22:09 -- nvmf/common.sh@295 -- # local -ga e810 00:15:32.369 04:22:09 -- nvmf/common.sh@296 -- # x722=() 00:15:32.369 04:22:09 -- nvmf/common.sh@296 -- # local -ga x722 00:15:32.369 04:22:09 -- nvmf/common.sh@297 -- # mlx=() 00:15:32.369 04:22:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:32.369 04:22:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:32.369 04:22:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:32.369 04:22:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:32.369 04:22:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:32.369 04:22:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:32.369 04:22:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:32.369 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:32.369 04:22:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:32.369 04:22:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:32.369 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:32.369 04:22:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:32.369 04:22:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:32.370 04:22:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:32.370 04:22:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:32.370 04:22:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:32.370 04:22:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:32.370 04:22:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:32.370 04:22:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:32.370 04:22:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:32.370 04:22:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:32.370 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:32.370 04:22:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:32.370 04:22:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:32.370 04:22:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:32.370 04:22:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:32.370 04:22:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:32.370 04:22:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:32.370 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:32.370 04:22:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:32.370 04:22:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:32.370 04:22:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:32.370 04:22:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:32.370 04:22:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:32.370 04:22:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:32.370 04:22:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:32.370 04:22:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:32.370 04:22:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:32.370 04:22:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:32.370 04:22:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:32.370 04:22:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:32.370 04:22:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:32.370 04:22:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:32.370 04:22:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:32.370 04:22:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:32.370 04:22:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:32.370 04:22:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:32.370 04:22:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:32.370 04:22:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:32.370 04:22:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:32.370 04:22:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:32.370 04:22:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:32.370 04:22:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:32.370 04:22:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:32.370 04:22:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:32.370 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:32.370 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:15:32.370 00:15:32.370 --- 10.0.0.2 ping statistics --- 00:15:32.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:32.370 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:15:32.628 04:22:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:32.628 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:32.628 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:15:32.628 00:15:32.628 --- 10.0.0.1 ping statistics --- 00:15:32.628 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:32.628 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:15:32.628 04:22:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:32.628 04:22:09 -- nvmf/common.sh@410 -- # return 0 00:15:32.628 04:22:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:32.628 04:22:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:32.628 04:22:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:32.628 04:22:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:32.628 04:22:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:32.628 04:22:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:32.628 04:22:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:32.628 04:22:09 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:32.628 04:22:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:32.628 04:22:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:32.628 04:22:09 -- common/autotest_common.sh@10 -- # set +x 00:15:32.628 04:22:09 -- nvmf/common.sh@469 -- # nvmfpid=3887799 00:15:32.628 04:22:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:32.628 04:22:09 -- nvmf/common.sh@470 -- # waitforlisten 3887799 00:15:32.628 04:22:09 -- common/autotest_common.sh@829 -- # '[' -z 3887799 ']' 00:15:32.628 04:22:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:32.628 04:22:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:32.628 04:22:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:32.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:32.628 04:22:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:32.629 04:22:09 -- common/autotest_common.sh@10 -- # set +x 00:15:32.629 [2024-11-28 04:22:09.763549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:32.629 [2024-11-28 04:22:09.763618] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:32.629 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.629 [2024-11-28 04:22:09.827284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:32.629 [2024-11-28 04:22:09.934013] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:32.629 [2024-11-28 04:22:09.934170] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:32.629 [2024-11-28 04:22:09.934189] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:32.629 [2024-11-28 04:22:09.934203] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:32.629 [2024-11-28 04:22:09.934252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:33.563 04:22:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:33.563 04:22:10 -- common/autotest_common.sh@862 -- # return 0 00:15:33.563 04:22:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:33.563 04:22:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:33.563 04:22:10 -- common/autotest_common.sh@10 -- # set +x 00:15:33.563 04:22:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:33.563 04:22:10 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:33.563 04:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.563 04:22:10 -- common/autotest_common.sh@10 -- # set +x 00:15:33.563 [2024-11-28 04:22:10.769126] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:33.563 04:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.563 04:22:10 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:33.563 04:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.563 04:22:10 -- common/autotest_common.sh@10 -- # set +x 00:15:33.563 Malloc0 00:15:33.563 04:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.563 04:22:10 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:33.563 04:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.563 04:22:10 -- common/autotest_common.sh@10 -- # set +x 00:15:33.563 04:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.563 04:22:10 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:33.563 04:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.563 04:22:10 -- common/autotest_common.sh@10 -- # set +x 00:15:33.563 04:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.563 04:22:10 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:33.563 04:22:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.563 04:22:10 -- common/autotest_common.sh@10 -- # set +x 00:15:33.563 [2024-11-28 04:22:10.831258] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:33.563 04:22:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.563 04:22:10 -- target/queue_depth.sh@30 -- # bdevperf_pid=3887952 00:15:33.563 04:22:10 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:33.563 04:22:10 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:33.563 04:22:10 -- target/queue_depth.sh@33 -- # waitforlisten 3887952 /var/tmp/bdevperf.sock 00:15:33.563 04:22:10 -- common/autotest_common.sh@829 -- # '[' -z 3887952 ']' 00:15:33.563 04:22:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:33.563 04:22:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:33.563 04:22:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:33.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:33.563 04:22:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:33.563 04:22:10 -- common/autotest_common.sh@10 -- # set +x 00:15:33.821 [2024-11-28 04:22:10.874467] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.821 [2024-11-28 04:22:10.874579] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3887952 ] 00:15:33.821 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.821 [2024-11-28 04:22:10.936627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:33.821 [2024-11-28 04:22:11.051085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:34.754 04:22:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:34.754 04:22:11 -- common/autotest_common.sh@862 -- # return 0 00:15:34.754 04:22:11 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:34.754 04:22:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.754 04:22:11 -- common/autotest_common.sh@10 -- # set +x 00:15:35.012 NVMe0n1 00:15:35.012 04:22:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.012 04:22:12 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:35.012 Running I/O for 10 seconds... 00:15:44.978 00:15:44.978 Latency(us) 00:15:44.978 [2024-11-28T03:22:22.289Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:44.978 [2024-11-28T03:22:22.289Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:44.978 Verification LBA range: start 0x0 length 0x4000 00:15:44.978 NVMe0n1 : 10.07 12413.35 48.49 0.00 0.00 82161.12 15728.64 73788.68 00:15:44.978 [2024-11-28T03:22:22.289Z] =================================================================================================================== 00:15:44.978 [2024-11-28T03:22:22.289Z] Total : 12413.35 48.49 0.00 0.00 82161.12 15728.64 73788.68 00:15:44.978 0 00:15:44.978 04:22:22 -- target/queue_depth.sh@39 -- # killprocess 3887952 00:15:44.978 04:22:22 -- common/autotest_common.sh@936 -- # '[' -z 3887952 ']' 00:15:44.978 04:22:22 -- common/autotest_common.sh@940 -- # kill -0 3887952 00:15:44.978 04:22:22 -- common/autotest_common.sh@941 -- # uname 00:15:45.236 04:22:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:45.236 04:22:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3887952 00:15:45.236 04:22:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:45.236 04:22:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:45.236 04:22:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3887952' 00:15:45.236 killing process with pid 3887952 00:15:45.236 04:22:22 -- common/autotest_common.sh@955 -- # kill 3887952 00:15:45.236 Received shutdown signal, test time was about 10.000000 seconds 00:15:45.236 00:15:45.236 Latency(us) 00:15:45.236 [2024-11-28T03:22:22.547Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:45.236 [2024-11-28T03:22:22.547Z] =================================================================================================================== 00:15:45.236 [2024-11-28T03:22:22.547Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:45.236 04:22:22 -- common/autotest_common.sh@960 -- # wait 3887952 00:15:45.494 04:22:22 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:45.494 04:22:22 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:45.494 04:22:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:45.494 04:22:22 -- nvmf/common.sh@116 -- # sync 00:15:45.494 04:22:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:45.494 04:22:22 -- nvmf/common.sh@119 -- # set +e 00:15:45.494 04:22:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:45.494 04:22:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:45.494 rmmod nvme_tcp 00:15:45.494 rmmod nvme_fabrics 00:15:45.494 rmmod nvme_keyring 00:15:45.494 04:22:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:45.494 04:22:22 -- nvmf/common.sh@123 -- # set -e 00:15:45.494 04:22:22 -- nvmf/common.sh@124 -- # return 0 00:15:45.494 04:22:22 -- nvmf/common.sh@477 -- # '[' -n 3887799 ']' 00:15:45.494 04:22:22 -- nvmf/common.sh@478 -- # killprocess 3887799 00:15:45.494 04:22:22 -- common/autotest_common.sh@936 -- # '[' -z 3887799 ']' 00:15:45.494 04:22:22 -- common/autotest_common.sh@940 -- # kill -0 3887799 00:15:45.494 04:22:22 -- common/autotest_common.sh@941 -- # uname 00:15:45.494 04:22:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:45.494 04:22:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3887799 00:15:45.494 04:22:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:45.494 04:22:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:45.494 04:22:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3887799' 00:15:45.494 killing process with pid 3887799 00:15:45.494 04:22:22 -- common/autotest_common.sh@955 -- # kill 3887799 00:15:45.494 04:22:22 -- common/autotest_common.sh@960 -- # wait 3887799 00:15:45.753 04:22:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:45.753 04:22:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:45.753 04:22:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:45.753 04:22:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:45.753 04:22:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:45.753 04:22:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:45.753 04:22:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:45.753 04:22:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:48.284 04:22:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:48.284 00:15:48.284 real 0m17.760s 00:15:48.284 user 0m22.651s 00:15:48.284 sys 0m4.358s 00:15:48.284 04:22:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:48.284 04:22:25 -- common/autotest_common.sh@10 -- # set +x 00:15:48.284 ************************************ 00:15:48.284 END TEST nvmf_queue_depth 00:15:48.284 ************************************ 00:15:48.284 04:22:25 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:48.284 04:22:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:48.284 04:22:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:48.284 04:22:25 -- common/autotest_common.sh@10 -- # set +x 00:15:48.284 ************************************ 00:15:48.284 START TEST nvmf_multipath 00:15:48.284 ************************************ 00:15:48.284 04:22:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:48.284 * Looking for test storage... 00:15:48.284 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:48.284 04:22:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:48.284 04:22:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:48.284 04:22:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:48.284 04:22:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:48.284 04:22:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:48.284 04:22:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:48.284 04:22:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:48.284 04:22:25 -- scripts/common.sh@335 -- # IFS=.-: 00:15:48.284 04:22:25 -- scripts/common.sh@335 -- # read -ra ver1 00:15:48.285 04:22:25 -- scripts/common.sh@336 -- # IFS=.-: 00:15:48.285 04:22:25 -- scripts/common.sh@336 -- # read -ra ver2 00:15:48.285 04:22:25 -- scripts/common.sh@337 -- # local 'op=<' 00:15:48.285 04:22:25 -- scripts/common.sh@339 -- # ver1_l=2 00:15:48.285 04:22:25 -- scripts/common.sh@340 -- # ver2_l=1 00:15:48.285 04:22:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:48.285 04:22:25 -- scripts/common.sh@343 -- # case "$op" in 00:15:48.285 04:22:25 -- scripts/common.sh@344 -- # : 1 00:15:48.285 04:22:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:48.285 04:22:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:48.285 04:22:25 -- scripts/common.sh@364 -- # decimal 1 00:15:48.285 04:22:25 -- scripts/common.sh@352 -- # local d=1 00:15:48.285 04:22:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:48.285 04:22:25 -- scripts/common.sh@354 -- # echo 1 00:15:48.285 04:22:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:48.285 04:22:25 -- scripts/common.sh@365 -- # decimal 2 00:15:48.285 04:22:25 -- scripts/common.sh@352 -- # local d=2 00:15:48.285 04:22:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:48.285 04:22:25 -- scripts/common.sh@354 -- # echo 2 00:15:48.285 04:22:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:48.285 04:22:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:48.285 04:22:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:48.285 04:22:25 -- scripts/common.sh@367 -- # return 0 00:15:48.285 04:22:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:48.285 04:22:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:48.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.285 --rc genhtml_branch_coverage=1 00:15:48.285 --rc genhtml_function_coverage=1 00:15:48.285 --rc genhtml_legend=1 00:15:48.285 --rc geninfo_all_blocks=1 00:15:48.285 --rc geninfo_unexecuted_blocks=1 00:15:48.285 00:15:48.285 ' 00:15:48.285 04:22:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:48.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.285 --rc genhtml_branch_coverage=1 00:15:48.285 --rc genhtml_function_coverage=1 00:15:48.285 --rc genhtml_legend=1 00:15:48.285 --rc geninfo_all_blocks=1 00:15:48.285 --rc geninfo_unexecuted_blocks=1 00:15:48.285 00:15:48.285 ' 00:15:48.285 04:22:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:48.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.285 --rc genhtml_branch_coverage=1 00:15:48.285 --rc genhtml_function_coverage=1 00:15:48.285 --rc genhtml_legend=1 00:15:48.285 --rc geninfo_all_blocks=1 00:15:48.285 --rc geninfo_unexecuted_blocks=1 00:15:48.285 00:15:48.285 ' 00:15:48.285 04:22:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:48.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:48.285 --rc genhtml_branch_coverage=1 00:15:48.285 --rc genhtml_function_coverage=1 00:15:48.285 --rc genhtml_legend=1 00:15:48.285 --rc geninfo_all_blocks=1 00:15:48.285 --rc geninfo_unexecuted_blocks=1 00:15:48.285 00:15:48.285 ' 00:15:48.285 04:22:25 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:48.285 04:22:25 -- nvmf/common.sh@7 -- # uname -s 00:15:48.285 04:22:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:48.285 04:22:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:48.285 04:22:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:48.285 04:22:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:48.285 04:22:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:48.285 04:22:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:48.285 04:22:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:48.285 04:22:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:48.285 04:22:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:48.285 04:22:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:48.285 04:22:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:48.285 04:22:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:48.285 04:22:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:48.285 04:22:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:48.285 04:22:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:48.285 04:22:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:48.285 04:22:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:48.285 04:22:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:48.285 04:22:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:48.285 04:22:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.285 04:22:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.285 04:22:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.285 04:22:25 -- paths/export.sh@5 -- # export PATH 00:15:48.285 04:22:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:48.285 04:22:25 -- nvmf/common.sh@46 -- # : 0 00:15:48.285 04:22:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:48.285 04:22:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:48.285 04:22:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:48.285 04:22:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:48.285 04:22:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:48.285 04:22:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:48.285 04:22:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:48.285 04:22:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:48.285 04:22:25 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:48.285 04:22:25 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:48.285 04:22:25 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:48.285 04:22:25 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:48.285 04:22:25 -- target/multipath.sh@43 -- # nvmftestinit 00:15:48.285 04:22:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:48.285 04:22:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:48.285 04:22:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:48.285 04:22:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:48.285 04:22:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:48.285 04:22:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:48.285 04:22:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:48.285 04:22:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:48.285 04:22:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:48.285 04:22:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:48.285 04:22:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:48.285 04:22:25 -- common/autotest_common.sh@10 -- # set +x 00:15:50.296 04:22:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:50.296 04:22:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:50.296 04:22:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:50.296 04:22:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:50.296 04:22:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:50.296 04:22:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:50.296 04:22:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:50.296 04:22:27 -- nvmf/common.sh@294 -- # net_devs=() 00:15:50.296 04:22:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:50.296 04:22:27 -- nvmf/common.sh@295 -- # e810=() 00:15:50.296 04:22:27 -- nvmf/common.sh@295 -- # local -ga e810 00:15:50.296 04:22:27 -- nvmf/common.sh@296 -- # x722=() 00:15:50.296 04:22:27 -- nvmf/common.sh@296 -- # local -ga x722 00:15:50.296 04:22:27 -- nvmf/common.sh@297 -- # mlx=() 00:15:50.296 04:22:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:50.296 04:22:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:50.296 04:22:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:50.296 04:22:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:50.296 04:22:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:50.296 04:22:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:50.296 04:22:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:50.296 04:22:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:50.296 04:22:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:50.297 04:22:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:50.297 04:22:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:50.297 04:22:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:50.297 04:22:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:50.297 04:22:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:50.297 04:22:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:50.297 04:22:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:50.297 04:22:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:50.297 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:50.297 04:22:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:50.297 04:22:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:50.297 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:50.297 04:22:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:50.297 04:22:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:50.297 04:22:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:50.297 04:22:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:50.297 04:22:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:50.297 04:22:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:50.297 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:50.297 04:22:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:50.297 04:22:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:50.297 04:22:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:50.297 04:22:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:50.297 04:22:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:50.297 04:22:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:50.297 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:50.297 04:22:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:50.297 04:22:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:50.297 04:22:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:50.297 04:22:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:50.297 04:22:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:50.297 04:22:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:50.297 04:22:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:50.297 04:22:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:50.297 04:22:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:50.297 04:22:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:50.297 04:22:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:50.297 04:22:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:50.297 04:22:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:50.297 04:22:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:50.297 04:22:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:50.297 04:22:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:50.297 04:22:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:50.297 04:22:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:50.297 04:22:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:50.297 04:22:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:50.297 04:22:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:50.297 04:22:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:50.297 04:22:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:50.297 04:22:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:50.297 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:50.297 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:15:50.297 00:15:50.297 --- 10.0.0.2 ping statistics --- 00:15:50.297 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:50.297 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:15:50.297 04:22:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:50.297 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:50.297 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:15:50.297 00:15:50.297 --- 10.0.0.1 ping statistics --- 00:15:50.297 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:50.297 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:15:50.297 04:22:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:50.297 04:22:27 -- nvmf/common.sh@410 -- # return 0 00:15:50.297 04:22:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:50.297 04:22:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:50.297 04:22:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:50.297 04:22:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:50.297 04:22:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:50.297 04:22:27 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:50.297 04:22:27 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:50.297 only one NIC for nvmf test 00:15:50.297 04:22:27 -- target/multipath.sh@47 -- # nvmftestfini 00:15:50.297 04:22:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:50.297 04:22:27 -- nvmf/common.sh@116 -- # sync 00:15:50.297 04:22:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:50.297 04:22:27 -- nvmf/common.sh@119 -- # set +e 00:15:50.297 04:22:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:50.297 04:22:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:50.297 rmmod nvme_tcp 00:15:50.297 rmmod nvme_fabrics 00:15:50.297 rmmod nvme_keyring 00:15:50.297 04:22:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:50.297 04:22:27 -- nvmf/common.sh@123 -- # set -e 00:15:50.297 04:22:27 -- nvmf/common.sh@124 -- # return 0 00:15:50.297 04:22:27 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:50.297 04:22:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:50.297 04:22:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:50.297 04:22:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:50.297 04:22:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:50.297 04:22:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:50.297 04:22:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:50.297 04:22:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:52.203 04:22:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:52.203 04:22:29 -- target/multipath.sh@48 -- # exit 0 00:15:52.203 04:22:29 -- target/multipath.sh@1 -- # nvmftestfini 00:15:52.203 04:22:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:52.203 04:22:29 -- nvmf/common.sh@116 -- # sync 00:15:52.203 04:22:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:52.203 04:22:29 -- nvmf/common.sh@119 -- # set +e 00:15:52.203 04:22:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:52.203 04:22:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:52.203 04:22:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:52.203 04:22:29 -- nvmf/common.sh@123 -- # set -e 00:15:52.203 04:22:29 -- nvmf/common.sh@124 -- # return 0 00:15:52.203 04:22:29 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:52.203 04:22:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:52.203 04:22:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:52.203 04:22:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:52.203 04:22:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:52.203 04:22:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:52.203 04:22:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:52.203 04:22:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:52.203 04:22:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:52.203 04:22:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:52.203 00:15:52.203 real 0m4.430s 00:15:52.203 user 0m0.868s 00:15:52.203 sys 0m1.553s 00:15:52.203 04:22:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:52.203 04:22:29 -- common/autotest_common.sh@10 -- # set +x 00:15:52.203 ************************************ 00:15:52.203 END TEST nvmf_multipath 00:15:52.203 ************************************ 00:15:52.462 04:22:29 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:52.462 04:22:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:52.462 04:22:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:52.462 04:22:29 -- common/autotest_common.sh@10 -- # set +x 00:15:52.462 ************************************ 00:15:52.462 START TEST nvmf_zcopy 00:15:52.462 ************************************ 00:15:52.462 04:22:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:52.462 * Looking for test storage... 00:15:52.462 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:52.462 04:22:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:52.462 04:22:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:52.462 04:22:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:52.462 04:22:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:52.462 04:22:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:52.462 04:22:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:52.462 04:22:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:52.462 04:22:29 -- scripts/common.sh@335 -- # IFS=.-: 00:15:52.462 04:22:29 -- scripts/common.sh@335 -- # read -ra ver1 00:15:52.462 04:22:29 -- scripts/common.sh@336 -- # IFS=.-: 00:15:52.462 04:22:29 -- scripts/common.sh@336 -- # read -ra ver2 00:15:52.462 04:22:29 -- scripts/common.sh@337 -- # local 'op=<' 00:15:52.462 04:22:29 -- scripts/common.sh@339 -- # ver1_l=2 00:15:52.462 04:22:29 -- scripts/common.sh@340 -- # ver2_l=1 00:15:52.462 04:22:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:52.462 04:22:29 -- scripts/common.sh@343 -- # case "$op" in 00:15:52.462 04:22:29 -- scripts/common.sh@344 -- # : 1 00:15:52.462 04:22:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:52.462 04:22:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:52.462 04:22:29 -- scripts/common.sh@364 -- # decimal 1 00:15:52.462 04:22:29 -- scripts/common.sh@352 -- # local d=1 00:15:52.462 04:22:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:52.462 04:22:29 -- scripts/common.sh@354 -- # echo 1 00:15:52.462 04:22:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:52.462 04:22:29 -- scripts/common.sh@365 -- # decimal 2 00:15:52.462 04:22:29 -- scripts/common.sh@352 -- # local d=2 00:15:52.462 04:22:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:52.462 04:22:29 -- scripts/common.sh@354 -- # echo 2 00:15:52.462 04:22:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:52.462 04:22:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:52.462 04:22:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:52.462 04:22:29 -- scripts/common.sh@367 -- # return 0 00:15:52.462 04:22:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:52.462 04:22:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.462 --rc genhtml_branch_coverage=1 00:15:52.462 --rc genhtml_function_coverage=1 00:15:52.462 --rc genhtml_legend=1 00:15:52.462 --rc geninfo_all_blocks=1 00:15:52.462 --rc geninfo_unexecuted_blocks=1 00:15:52.462 00:15:52.462 ' 00:15:52.462 04:22:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.462 --rc genhtml_branch_coverage=1 00:15:52.462 --rc genhtml_function_coverage=1 00:15:52.462 --rc genhtml_legend=1 00:15:52.462 --rc geninfo_all_blocks=1 00:15:52.462 --rc geninfo_unexecuted_blocks=1 00:15:52.462 00:15:52.462 ' 00:15:52.462 04:22:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.462 --rc genhtml_branch_coverage=1 00:15:52.462 --rc genhtml_function_coverage=1 00:15:52.462 --rc genhtml_legend=1 00:15:52.462 --rc geninfo_all_blocks=1 00:15:52.462 --rc geninfo_unexecuted_blocks=1 00:15:52.462 00:15:52.462 ' 00:15:52.462 04:22:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:52.462 --rc genhtml_branch_coverage=1 00:15:52.462 --rc genhtml_function_coverage=1 00:15:52.462 --rc genhtml_legend=1 00:15:52.462 --rc geninfo_all_blocks=1 00:15:52.462 --rc geninfo_unexecuted_blocks=1 00:15:52.462 00:15:52.462 ' 00:15:52.462 04:22:29 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:52.462 04:22:29 -- nvmf/common.sh@7 -- # uname -s 00:15:52.462 04:22:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:52.462 04:22:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:52.462 04:22:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:52.462 04:22:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:52.462 04:22:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:52.462 04:22:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:52.462 04:22:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:52.462 04:22:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:52.462 04:22:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:52.462 04:22:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:52.462 04:22:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:52.462 04:22:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:52.462 04:22:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:52.462 04:22:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:52.462 04:22:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:52.462 04:22:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:52.462 04:22:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:52.462 04:22:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:52.462 04:22:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:52.462 04:22:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.462 04:22:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.462 04:22:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.462 04:22:29 -- paths/export.sh@5 -- # export PATH 00:15:52.462 04:22:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:52.462 04:22:29 -- nvmf/common.sh@46 -- # : 0 00:15:52.462 04:22:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:52.462 04:22:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:52.462 04:22:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:52.462 04:22:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:52.462 04:22:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:52.462 04:22:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:52.462 04:22:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:52.462 04:22:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:52.462 04:22:29 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:52.462 04:22:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:52.462 04:22:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:52.462 04:22:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:52.462 04:22:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:52.462 04:22:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:52.462 04:22:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:52.462 04:22:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:52.462 04:22:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:52.462 04:22:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:52.462 04:22:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:52.462 04:22:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:52.462 04:22:29 -- common/autotest_common.sh@10 -- # set +x 00:15:54.997 04:22:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:54.997 04:22:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:54.997 04:22:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:54.997 04:22:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:54.997 04:22:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:54.997 04:22:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:54.997 04:22:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:54.997 04:22:31 -- nvmf/common.sh@294 -- # net_devs=() 00:15:54.997 04:22:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:54.997 04:22:31 -- nvmf/common.sh@295 -- # e810=() 00:15:54.997 04:22:31 -- nvmf/common.sh@295 -- # local -ga e810 00:15:54.997 04:22:31 -- nvmf/common.sh@296 -- # x722=() 00:15:54.997 04:22:31 -- nvmf/common.sh@296 -- # local -ga x722 00:15:54.997 04:22:31 -- nvmf/common.sh@297 -- # mlx=() 00:15:54.997 04:22:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:54.997 04:22:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:54.997 04:22:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:54.997 04:22:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:54.997 04:22:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:54.997 04:22:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:54.997 04:22:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:54.997 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:54.997 04:22:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:54.997 04:22:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:54.997 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:54.997 04:22:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:54.997 04:22:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:54.997 04:22:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:54.997 04:22:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.997 04:22:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:54.997 04:22:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.997 04:22:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:54.997 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:54.997 04:22:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.997 04:22:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:54.997 04:22:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.997 04:22:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:54.997 04:22:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.997 04:22:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:54.998 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:54.998 04:22:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.998 04:22:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:54.998 04:22:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:54.998 04:22:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:54.998 04:22:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:54.998 04:22:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:54.998 04:22:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:54.998 04:22:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:54.998 04:22:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:54.998 04:22:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:54.998 04:22:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:54.998 04:22:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:54.998 04:22:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:54.998 04:22:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:54.998 04:22:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:54.998 04:22:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:54.998 04:22:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:54.998 04:22:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:54.998 04:22:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:54.998 04:22:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:54.998 04:22:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:54.998 04:22:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:54.998 04:22:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:54.998 04:22:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:54.998 04:22:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:54.998 04:22:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:54.998 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:54.998 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.151 ms 00:15:54.998 00:15:54.998 --- 10.0.0.2 ping statistics --- 00:15:54.998 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:54.998 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:15:54.998 04:22:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:54.998 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:54.998 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:15:54.998 00:15:54.998 --- 10.0.0.1 ping statistics --- 00:15:54.998 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:54.998 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:15:54.998 04:22:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:54.998 04:22:31 -- nvmf/common.sh@410 -- # return 0 00:15:54.998 04:22:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:54.998 04:22:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:54.998 04:22:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:54.998 04:22:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:54.998 04:22:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:54.998 04:22:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:54.998 04:22:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:54.998 04:22:31 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:54.998 04:22:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:54.998 04:22:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:54.998 04:22:31 -- common/autotest_common.sh@10 -- # set +x 00:15:54.998 04:22:31 -- nvmf/common.sh@469 -- # nvmfpid=3893276 00:15:54.998 04:22:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:54.998 04:22:31 -- nvmf/common.sh@470 -- # waitforlisten 3893276 00:15:54.998 04:22:31 -- common/autotest_common.sh@829 -- # '[' -z 3893276 ']' 00:15:54.998 04:22:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:54.998 04:22:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:54.998 04:22:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:54.998 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:54.998 04:22:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:54.998 04:22:31 -- common/autotest_common.sh@10 -- # set +x 00:15:54.998 [2024-11-28 04:22:31.982349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:54.998 [2024-11-28 04:22:31.982447] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:54.998 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.998 [2024-11-28 04:22:32.051521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:54.998 [2024-11-28 04:22:32.168556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:54.998 [2024-11-28 04:22:32.168741] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:54.998 [2024-11-28 04:22:32.168761] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:54.998 [2024-11-28 04:22:32.168775] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:54.998 [2024-11-28 04:22:32.168818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:55.933 04:22:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:55.933 04:22:32 -- common/autotest_common.sh@862 -- # return 0 00:15:55.933 04:22:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:55.933 04:22:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:55.933 04:22:32 -- common/autotest_common.sh@10 -- # set +x 00:15:55.933 04:22:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:55.933 04:22:32 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:55.933 04:22:32 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:55.933 04:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:55.933 04:22:32 -- common/autotest_common.sh@10 -- # set +x 00:15:55.933 [2024-11-28 04:22:32.953274] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:55.933 04:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:55.933 04:22:32 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:55.933 04:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:55.933 04:22:32 -- common/autotest_common.sh@10 -- # set +x 00:15:55.933 04:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:55.933 04:22:32 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:55.933 04:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:55.933 04:22:32 -- common/autotest_common.sh@10 -- # set +x 00:15:55.933 [2024-11-28 04:22:32.969460] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:55.933 04:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:55.933 04:22:32 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:55.933 04:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:55.933 04:22:32 -- common/autotest_common.sh@10 -- # set +x 00:15:55.933 04:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:55.933 04:22:32 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:55.933 04:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:55.933 04:22:32 -- common/autotest_common.sh@10 -- # set +x 00:15:55.933 malloc0 00:15:55.933 04:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:55.933 04:22:32 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:55.933 04:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:55.933 04:22:32 -- common/autotest_common.sh@10 -- # set +x 00:15:55.933 04:22:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:55.933 04:22:33 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:55.933 04:22:33 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:55.933 04:22:33 -- nvmf/common.sh@520 -- # config=() 00:15:55.933 04:22:33 -- nvmf/common.sh@520 -- # local subsystem config 00:15:55.933 04:22:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:55.933 04:22:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:55.933 { 00:15:55.933 "params": { 00:15:55.933 "name": "Nvme$subsystem", 00:15:55.933 "trtype": "$TEST_TRANSPORT", 00:15:55.933 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:55.933 "adrfam": "ipv4", 00:15:55.933 "trsvcid": "$NVMF_PORT", 00:15:55.933 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:55.933 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:55.933 "hdgst": ${hdgst:-false}, 00:15:55.933 "ddgst": ${ddgst:-false} 00:15:55.933 }, 00:15:55.933 "method": "bdev_nvme_attach_controller" 00:15:55.933 } 00:15:55.933 EOF 00:15:55.933 )") 00:15:55.933 04:22:33 -- nvmf/common.sh@542 -- # cat 00:15:55.933 04:22:33 -- nvmf/common.sh@544 -- # jq . 00:15:55.933 04:22:33 -- nvmf/common.sh@545 -- # IFS=, 00:15:55.933 04:22:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:55.933 "params": { 00:15:55.933 "name": "Nvme1", 00:15:55.933 "trtype": "tcp", 00:15:55.933 "traddr": "10.0.0.2", 00:15:55.933 "adrfam": "ipv4", 00:15:55.933 "trsvcid": "4420", 00:15:55.933 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:55.933 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:55.933 "hdgst": false, 00:15:55.933 "ddgst": false 00:15:55.933 }, 00:15:55.933 "method": "bdev_nvme_attach_controller" 00:15:55.933 }' 00:15:55.933 [2024-11-28 04:22:33.043967] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:55.933 [2024-11-28 04:22:33.044052] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3893384 ] 00:15:55.933 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.933 [2024-11-28 04:22:33.109883] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:55.933 [2024-11-28 04:22:33.226732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:56.500 Running I/O for 10 seconds... 00:16:06.470 00:16:06.470 Latency(us) 00:16:06.470 [2024-11-28T03:22:43.781Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:06.470 [2024-11-28T03:22:43.781Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:06.470 Verification LBA range: start 0x0 length 0x1000 00:16:06.470 Nvme1n1 : 10.01 8548.93 66.79 0.00 0.00 14937.97 1347.13 23495.87 00:16:06.470 [2024-11-28T03:22:43.781Z] =================================================================================================================== 00:16:06.470 [2024-11-28T03:22:43.781Z] Total : 8548.93 66.79 0.00 0.00 14937.97 1347.13 23495.87 00:16:06.729 04:22:43 -- target/zcopy.sh@39 -- # perfpid=3894730 00:16:06.729 04:22:43 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:06.729 04:22:43 -- common/autotest_common.sh@10 -- # set +x 00:16:06.729 04:22:43 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:06.729 04:22:43 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:06.729 04:22:43 -- nvmf/common.sh@520 -- # config=() 00:16:06.729 04:22:43 -- nvmf/common.sh@520 -- # local subsystem config 00:16:06.729 04:22:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:06.729 04:22:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:06.729 { 00:16:06.729 "params": { 00:16:06.729 "name": "Nvme$subsystem", 00:16:06.729 "trtype": "$TEST_TRANSPORT", 00:16:06.729 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:06.729 "adrfam": "ipv4", 00:16:06.729 "trsvcid": "$NVMF_PORT", 00:16:06.729 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:06.729 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:06.729 "hdgst": ${hdgst:-false}, 00:16:06.729 "ddgst": ${ddgst:-false} 00:16:06.729 }, 00:16:06.729 "method": "bdev_nvme_attach_controller" 00:16:06.729 } 00:16:06.729 EOF 00:16:06.729 )") 00:16:06.729 [2024-11-28 04:22:43.845426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.845476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 04:22:43 -- nvmf/common.sh@542 -- # cat 00:16:06.729 04:22:43 -- nvmf/common.sh@544 -- # jq . 00:16:06.729 04:22:43 -- nvmf/common.sh@545 -- # IFS=, 00:16:06.729 04:22:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:06.729 "params": { 00:16:06.729 "name": "Nvme1", 00:16:06.729 "trtype": "tcp", 00:16:06.729 "traddr": "10.0.0.2", 00:16:06.729 "adrfam": "ipv4", 00:16:06.729 "trsvcid": "4420", 00:16:06.729 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:06.729 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:06.729 "hdgst": false, 00:16:06.729 "ddgst": false 00:16:06.729 }, 00:16:06.729 "method": "bdev_nvme_attach_controller" 00:16:06.729 }' 00:16:06.729 [2024-11-28 04:22:43.853361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.853388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.861374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.861398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.869391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.869413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.877410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.877430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.880201] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:06.729 [2024-11-28 04:22:43.880257] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3894730 ] 00:16:06.729 [2024-11-28 04:22:43.885429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.885449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.893451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.893471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.901471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.901491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.729 [2024-11-28 04:22:43.909493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.909534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.917543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.917592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.925559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.925596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.933603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.933634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.941610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.941631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.943347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:06.729 [2024-11-28 04:22:43.949649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.949678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.957692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.957730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.965668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.965690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.973690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.973711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.981712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.981734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.989736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.989758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:43.997759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:43.997780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:44.005784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:44.005824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:44.013853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:44.013892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:44.021850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:44.021877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:44.029870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:44.029896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.729 [2024-11-28 04:22:44.037900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.729 [2024-11-28 04:22:44.037928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.045928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.045954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.053952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.053979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.061971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.061997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.064030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:06.988 [2024-11-28 04:22:44.069994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.070019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.078021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.078055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.086074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.086113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.094097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.094138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.102123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.102163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.110153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.110197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.118177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.118219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.126196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.126238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.134193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.134221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.142228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.142263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.150261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.150303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.158285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.158327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.166275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.166301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.174293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.174318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.182330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.182374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.190349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.190380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.198374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.198402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.206395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.206422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.214414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.214440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.222433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.222458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.230456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.230490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.238484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.238510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.246503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.988 [2024-11-28 04:22:44.246536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.988 [2024-11-28 04:22:44.254537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.989 [2024-11-28 04:22:44.254565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.989 [2024-11-28 04:22:44.262556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.989 [2024-11-28 04:22:44.262596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.989 [2024-11-28 04:22:44.270595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.989 [2024-11-28 04:22:44.270619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.989 [2024-11-28 04:22:44.278610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.989 [2024-11-28 04:22:44.278646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.989 [2024-11-28 04:22:44.286640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.989 [2024-11-28 04:22:44.286666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.989 [2024-11-28 04:22:44.294646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.989 [2024-11-28 04:22:44.294670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.989 Running I/O for 5 seconds... 00:16:07.247 [2024-11-28 04:22:44.302698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.302724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.316129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.316163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.327753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.327793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.341052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.341085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.351275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.351307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.362661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.362690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.375936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.375970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.386329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.386358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.396203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.396234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.407321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.407348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.420011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.420050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.430649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.430678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.247 [2024-11-28 04:22:44.441337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.247 [2024-11-28 04:22:44.441367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.454403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.454432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.464982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.465013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.476222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.476252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.489783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.489827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.500103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.500134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.511480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.511510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.522658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.522690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.533681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.533723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.546616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.546644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.248 [2024-11-28 04:22:44.556738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.248 [2024-11-28 04:22:44.556766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.568520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.568573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.579731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.579759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.593090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.593120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.603933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.603964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.615346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.615376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.626218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.626248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.637743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.637771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.649311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.649342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.661229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.661258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.672105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.672135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.684793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.684838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.694664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.694692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.706504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.706542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.717736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.717763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.728671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.728698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.740108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.740138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.506 [2024-11-28 04:22:44.751444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.506 [2024-11-28 04:22:44.751474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.507 [2024-11-28 04:22:44.764434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.507 [2024-11-28 04:22:44.764464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.507 [2024-11-28 04:22:44.774601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.507 [2024-11-28 04:22:44.774629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.507 [2024-11-28 04:22:44.785713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.507 [2024-11-28 04:22:44.785740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.507 [2024-11-28 04:22:44.798583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.507 [2024-11-28 04:22:44.798611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.507 [2024-11-28 04:22:44.809412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.507 [2024-11-28 04:22:44.809443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.820981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.821012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.831745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.831772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.845093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.845125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.856099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.856130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.867047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.867077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.879675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.879703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.888765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.888793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.900257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.900288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.911080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.911110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.922027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.922058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.932825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.932855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.944332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.944362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.955117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.955147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.966288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.966319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.977446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.977477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:44.990729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:44.990757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:45.001283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:45.001313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:45.012730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:45.012757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:45.024128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:45.024157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:45.037231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:45.037261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.765 [2024-11-28 04:22:45.048093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.765 [2024-11-28 04:22:45.048123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.766 [2024-11-28 04:22:45.058987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.766 [2024-11-28 04:22:45.059018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.766 [2024-11-28 04:22:45.072480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.766 [2024-11-28 04:22:45.072510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.023 [2024-11-28 04:22:45.082757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.023 [2024-11-28 04:22:45.082784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.023 [2024-11-28 04:22:45.093371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.023 [2024-11-28 04:22:45.093401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.023 [2024-11-28 04:22:45.103882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.023 [2024-11-28 04:22:45.103912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.023 [2024-11-28 04:22:45.114511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.023 [2024-11-28 04:22:45.114570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.023 [2024-11-28 04:22:45.125287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.023 [2024-11-28 04:22:45.125317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.023 [2024-11-28 04:22:45.136425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.023 [2024-11-28 04:22:45.136456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.023 [2024-11-28 04:22:45.149265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.149295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.159520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.159578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.170593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.170620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.183429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.183460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.193787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.193831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.204847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.204876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.217641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.217668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.227853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.227883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.239195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.239226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.250106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.250137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.261181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.261211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.272350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.272379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.283090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.283120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.296137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.296167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.306048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.306078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.317745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.317772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.024 [2024-11-28 04:22:45.328588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.024 [2024-11-28 04:22:45.328615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.339519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.339575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.352374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.352404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.362978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.363007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.373754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.373782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.384842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.384872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.395918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.395949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.409017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.409047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.419127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.419157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.430772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.430799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.441521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.441575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.452381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.452411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.463201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.463232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.475981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.476013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.485590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.485625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.496665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.496693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.509311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.509341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.519242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.519272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.530125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.530155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.540758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.540785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.551581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.551608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.562684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.562712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.573839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.573870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.282 [2024-11-28 04:22:45.584675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.282 [2024-11-28 04:22:45.584702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.595788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.595816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.608384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.608415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.618571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.618599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.630275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.630305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.641501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.641540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.654263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.654293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.664081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.664112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.675766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.675793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.688511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.688551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.541 [2024-11-28 04:22:45.699310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.541 [2024-11-28 04:22:45.699349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.710548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.710591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.721255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.721286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.731958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.731989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.743264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.743294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.756776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.756819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.767203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.767233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.777838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.777868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.788692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.788720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.801311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.801341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.811201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.811230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.823721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.823748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.835021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.835052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.542 [2024-11-28 04:22:45.847963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.542 [2024-11-28 04:22:45.848007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.858293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.858323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.869179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.869208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.880193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.880222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.891590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.891617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.902609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.902637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.913807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.913862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.926946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.926977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.937290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.937320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.948097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.948127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.961574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.961601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.971925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.971955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.982711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.982738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:45.995359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:45.995389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.005498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.005539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.016778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.016822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.027425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.027456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.038517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.038572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.051304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.051335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.060997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.061027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.072873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.072903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.086082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.086112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.096325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.096355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.808 [2024-11-28 04:22:46.107656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.808 [2024-11-28 04:22:46.107685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.120322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.120352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.130250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.130294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.142030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.142061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.153264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.153294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.166264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.166293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.176423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.176453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.187833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.187863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.200873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.200904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.211606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.211633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.222716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.222743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.233334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.233364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.244780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.244824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.255888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.255919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.266512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.266572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.276896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.276927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.288254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.288284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.301262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.301292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.311308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.311338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.322709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.322736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.335777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.335821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.346137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.346167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.357200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.357230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.067 [2024-11-28 04:22:46.370240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.067 [2024-11-28 04:22:46.370270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.326 [2024-11-28 04:22:46.380542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.326 [2024-11-28 04:22:46.380591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.326 [2024-11-28 04:22:46.391740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.326 [2024-11-28 04:22:46.391768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.326 [2024-11-28 04:22:46.404508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.326 [2024-11-28 04:22:46.404547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.326 [2024-11-28 04:22:46.415172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.326 [2024-11-28 04:22:46.415202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.326 [2024-11-28 04:22:46.426380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.326 [2024-11-28 04:22:46.426410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.326 [2024-11-28 04:22:46.439225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.326 [2024-11-28 04:22:46.439255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.326 [2024-11-28 04:22:46.448702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.326 [2024-11-28 04:22:46.448728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.460335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.460365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.471494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.471535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.482414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.482444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.495790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.495833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.506188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.506218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.517430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.517459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.530285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.530315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.541040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.541070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.552146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.552176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.565600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.565627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.576480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.576509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.587195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.587225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.599625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.599652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.609679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.609707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.620487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.620518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.327 [2024-11-28 04:22:46.631353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.327 [2024-11-28 04:22:46.631384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.641970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.642001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.654848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.654879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.665508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.665549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.675856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.675887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.689498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.689552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.700241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.700270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.710799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.710843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.721629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.721657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.734594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.734622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.744821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.744852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.756129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.756160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.769346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.769376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.779745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.779773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.791039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.791069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.803457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.803487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.813257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.813287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.825230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.825268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.838126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.838156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.848031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.848062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.859463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.859493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.870593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.870620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.881744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.881772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.586 [2024-11-28 04:22:46.894896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.586 [2024-11-28 04:22:46.894927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.905298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.905328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.916498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.916540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.927490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.927521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.939010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.939040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.950136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.950166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.961155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.961185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.972606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.972633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.985508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.985565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:46.996200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:46.996230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.007278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.007308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.020631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.020658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.031363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.031393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.042777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.042804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.055723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.055751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.065668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.065695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.077612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.077640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.088285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.088315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.099770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.099797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.112514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.112570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.122715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.122742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.133913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.133942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.845 [2024-11-28 04:22:47.147320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.845 [2024-11-28 04:22:47.147351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.157868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.157896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.168783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.168827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.181998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.182029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.192722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.192749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.204018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.204056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.215075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.215105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.226061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.226091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.236929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.236959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.247937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.247966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.258894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.258924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.271729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.271756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.282183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.282213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.293205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.293235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.306603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.306631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.317105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.317134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.328319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.328348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.339445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.339476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.350621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.350648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.362877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.362907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.373253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.373284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.384166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.384196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.395677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.395704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.104 [2024-11-28 04:22:47.406602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.104 [2024-11-28 04:22:47.406629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.363 [2024-11-28 04:22:47.417578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.363 [2024-11-28 04:22:47.417613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.363 [2024-11-28 04:22:47.428614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.363 [2024-11-28 04:22:47.428641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.363 [2024-11-28 04:22:47.441826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.363 [2024-11-28 04:22:47.441857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.363 [2024-11-28 04:22:47.452035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.363 [2024-11-28 04:22:47.452065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.363 [2024-11-28 04:22:47.463017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.363 [2024-11-28 04:22:47.463047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.363 [2024-11-28 04:22:47.474228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.363 [2024-11-28 04:22:47.474258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.363 [2024-11-28 04:22:47.485304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.363 [2024-11-28 04:22:47.485334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.496623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.496650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.507607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.507634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.520150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.520179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.530151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.530181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.541587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.541615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.552726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.552753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.563849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.563879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.575228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.575258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.587080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.587110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.597780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.597824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.609231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.609261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.622206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.622237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.632464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.632501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.644065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.644095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.656878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.656908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.364 [2024-11-28 04:22:47.667273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.364 [2024-11-28 04:22:47.667303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.622 [2024-11-28 04:22:47.678456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.678487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.689787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.689831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.701248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.701277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.712217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.712247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.723578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.723605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.736545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.736590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.746232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.746264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.757768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.757795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.768843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.768870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.779613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.779641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.790781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.790825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.802059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.802089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.813612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.813639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.825168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.825198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.836468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.836506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.849310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.849348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.860038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.860069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.870919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.870949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.882517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.882572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.893446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.893476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.904437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.904467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.916059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.916088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.623 [2024-11-28 04:22:47.927150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.623 [2024-11-28 04:22:47.927182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-28 04:22:47.938532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-28 04:22:47.938577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-28 04:22:47.949734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-28 04:22:47.949761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:47.961093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:47.961122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:47.971074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:47.971101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:47.981185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:47.981213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:47.991172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:47.991199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.001257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.001284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.011213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.011240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.021245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.021272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.031457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.031484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.041489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.041516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.051611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.051639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.061777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.061804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.071417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.071445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.081515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.081551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.092036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.092063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.101921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.101948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.112231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.112258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.122181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.122209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.132053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.132080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.142301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.142328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.152362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.152389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.162753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.162781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.174945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.174973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-28 04:22:48.183599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-28 04:22:48.183627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-28 04:22:48.193987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-28 04:22:48.194015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-28 04:22:48.204096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-28 04:22:48.204123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.214250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.214278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.224423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.224451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.234651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.234680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.244854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.244882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.255143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.255170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.267389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.267417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.276138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.276165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.286882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.286908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.297088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.297115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.306763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.306790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.316709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.316736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.326594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.326621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.336370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.336397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.346860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.346886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.359380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.359407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.369312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.369339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.379468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.379494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.389477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.389504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.399767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.399794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.410241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.410268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.420453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.420480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.430187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.430213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-28 04:22:48.440493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-28 04:22:48.440519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-28 04:22:48.451028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-28 04:22:48.451054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.463784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.463829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.474211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.474240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.485369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.485399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.496759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.496786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.508012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.508043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.519302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.519332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.530654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.530681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.541722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.541749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.553120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.553150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.564206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.564237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.575913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.575942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.588511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.588550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.598423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.598452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.610122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.610152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.621532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.621577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.633073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.633103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.644340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.644369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.655155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.655186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.666309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.666339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.676798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.676825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.687793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.687836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.698687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.698715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.400 [2024-11-28 04:22:48.709837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.400 [2024-11-28 04:22:48.709865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-28 04:22:48.723058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-28 04:22:48.723089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-28 04:22:48.733152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-28 04:22:48.733183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-28 04:22:48.744936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-28 04:22:48.744966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-28 04:22:48.756433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-28 04:22:48.756464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.769899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.769927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.780489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.780519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.792135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.792166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.803601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.803629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.816647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.816674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.827392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.827421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.838710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.838737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.849493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.849523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.860467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.860505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.871929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.871960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.883368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.883399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.894396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.894428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.906052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.906082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.917184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.917214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.930047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.930078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.940349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.940379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.951895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.951926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.660 [2024-11-28 04:22:48.965423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.660 [2024-11-28 04:22:48.965453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:48.976096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:48.976128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:48.987055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:48.987086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:48.999951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:48.999982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.010098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.010129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.021086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.021116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.034008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.034038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.044073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.044104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.055411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.055443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.068410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.068442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.078754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.078797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.090024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.090054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.101275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.101305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.112277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.112307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.123786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.123813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.135265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.135295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.146209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.146240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.157364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.157394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.168644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.168672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.179606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.179634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.192294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.192324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.201903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.201933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.213372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.213402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-28 04:22:49.224547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-28 04:22:49.224590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.235688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.235715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.248933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.248963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.259743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.259770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.279990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.280023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.290814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.290860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.301053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.301098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.312125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.312155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.319989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.320018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 00:16:12.180 Latency(us) 00:16:12.180 [2024-11-28T03:22:49.491Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:12.180 [2024-11-28T03:22:49.491Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:12.180 Nvme1n1 : 5.01 11575.14 90.43 0.00 0.00 11043.15 4514.70 25049.32 00:16:12.180 [2024-11-28T03:22:49.491Z] =================================================================================================================== 00:16:12.180 [2024-11-28T03:22:49.491Z] Total : 11575.14 90.43 0.00 0.00 11043.15 4514.70 25049.32 00:16:12.180 [2024-11-28 04:22:49.328022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.328050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.336031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.336059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.344057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.344086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.352133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.352184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.360154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.360205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.368176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.368224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.376213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.376269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.384225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.384278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.392245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.392297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.400267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.400317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.408282] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.408333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.416315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.416364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.424331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.424383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.432351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.432416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.440375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.440425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.448394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.448444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.456425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.456475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.464420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.464462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.472406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.472431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-28 04:22:49.480431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-28 04:22:49.480456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.181 [2024-11-28 04:22:49.488449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.181 [2024-11-28 04:22:49.488473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.496473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.496499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.504548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.504592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.512577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.512624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.520595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.520632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.528583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.528604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.536601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.536622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.544621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.544644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.552633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.552654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.560710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.560758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.568733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.568780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.576692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.576715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.584710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.584731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 [2024-11-28 04:22:49.592734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.439 [2024-11-28 04:22:49.592757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.439 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3894730) - No such process 00:16:12.439 04:22:49 -- target/zcopy.sh@49 -- # wait 3894730 00:16:12.439 04:22:49 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:12.439 04:22:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:12.439 04:22:49 -- common/autotest_common.sh@10 -- # set +x 00:16:12.439 04:22:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:12.439 04:22:49 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:12.439 04:22:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:12.439 04:22:49 -- common/autotest_common.sh@10 -- # set +x 00:16:12.439 delay0 00:16:12.439 04:22:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:12.439 04:22:49 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:12.439 04:22:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:12.439 04:22:49 -- common/autotest_common.sh@10 -- # set +x 00:16:12.439 04:22:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:12.439 04:22:49 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:12.439 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.439 [2024-11-28 04:22:49.673620] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:19.000 Initializing NVMe Controllers 00:16:19.000 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:19.000 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:19.000 Initialization complete. Launching workers. 00:16:19.000 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 132 00:16:19.000 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 405, failed to submit 47 00:16:19.000 success 260, unsuccess 145, failed 0 00:16:19.001 04:22:55 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:19.001 04:22:55 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:19.001 04:22:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:19.001 04:22:55 -- nvmf/common.sh@116 -- # sync 00:16:19.001 04:22:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:19.001 04:22:55 -- nvmf/common.sh@119 -- # set +e 00:16:19.001 04:22:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:19.001 04:22:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:19.001 rmmod nvme_tcp 00:16:19.001 rmmod nvme_fabrics 00:16:19.001 rmmod nvme_keyring 00:16:19.001 04:22:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:19.001 04:22:55 -- nvmf/common.sh@123 -- # set -e 00:16:19.001 04:22:55 -- nvmf/common.sh@124 -- # return 0 00:16:19.001 04:22:55 -- nvmf/common.sh@477 -- # '[' -n 3893276 ']' 00:16:19.001 04:22:55 -- nvmf/common.sh@478 -- # killprocess 3893276 00:16:19.001 04:22:55 -- common/autotest_common.sh@936 -- # '[' -z 3893276 ']' 00:16:19.001 04:22:55 -- common/autotest_common.sh@940 -- # kill -0 3893276 00:16:19.001 04:22:55 -- common/autotest_common.sh@941 -- # uname 00:16:19.001 04:22:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:19.001 04:22:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3893276 00:16:19.001 04:22:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:19.001 04:22:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:19.001 04:22:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3893276' 00:16:19.001 killing process with pid 3893276 00:16:19.001 04:22:55 -- common/autotest_common.sh@955 -- # kill 3893276 00:16:19.001 04:22:55 -- common/autotest_common.sh@960 -- # wait 3893276 00:16:19.001 04:22:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:19.001 04:22:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:19.001 04:22:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:19.001 04:22:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:19.001 04:22:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:19.001 04:22:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:19.001 04:22:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:19.001 04:22:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:21.536 04:22:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:21.536 00:16:21.536 real 0m28.732s 00:16:21.536 user 0m42.327s 00:16:21.536 sys 0m8.144s 00:16:21.536 04:22:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:21.536 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:16:21.536 ************************************ 00:16:21.536 END TEST nvmf_zcopy 00:16:21.536 ************************************ 00:16:21.536 04:22:58 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:21.536 04:22:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:21.536 04:22:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:21.536 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:16:21.536 ************************************ 00:16:21.536 START TEST nvmf_nmic 00:16:21.536 ************************************ 00:16:21.536 04:22:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:21.536 * Looking for test storage... 00:16:21.536 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:21.536 04:22:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:21.536 04:22:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:21.536 04:22:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:21.536 04:22:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:21.536 04:22:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:21.536 04:22:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:21.536 04:22:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:21.536 04:22:58 -- scripts/common.sh@335 -- # IFS=.-: 00:16:21.536 04:22:58 -- scripts/common.sh@335 -- # read -ra ver1 00:16:21.536 04:22:58 -- scripts/common.sh@336 -- # IFS=.-: 00:16:21.536 04:22:58 -- scripts/common.sh@336 -- # read -ra ver2 00:16:21.536 04:22:58 -- scripts/common.sh@337 -- # local 'op=<' 00:16:21.536 04:22:58 -- scripts/common.sh@339 -- # ver1_l=2 00:16:21.536 04:22:58 -- scripts/common.sh@340 -- # ver2_l=1 00:16:21.536 04:22:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:21.536 04:22:58 -- scripts/common.sh@343 -- # case "$op" in 00:16:21.536 04:22:58 -- scripts/common.sh@344 -- # : 1 00:16:21.536 04:22:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:21.536 04:22:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:21.536 04:22:58 -- scripts/common.sh@364 -- # decimal 1 00:16:21.536 04:22:58 -- scripts/common.sh@352 -- # local d=1 00:16:21.536 04:22:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:21.536 04:22:58 -- scripts/common.sh@354 -- # echo 1 00:16:21.537 04:22:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:21.537 04:22:58 -- scripts/common.sh@365 -- # decimal 2 00:16:21.537 04:22:58 -- scripts/common.sh@352 -- # local d=2 00:16:21.537 04:22:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:21.537 04:22:58 -- scripts/common.sh@354 -- # echo 2 00:16:21.537 04:22:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:21.537 04:22:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:21.537 04:22:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:21.537 04:22:58 -- scripts/common.sh@367 -- # return 0 00:16:21.537 04:22:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:21.537 04:22:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:21.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.537 --rc genhtml_branch_coverage=1 00:16:21.537 --rc genhtml_function_coverage=1 00:16:21.537 --rc genhtml_legend=1 00:16:21.537 --rc geninfo_all_blocks=1 00:16:21.537 --rc geninfo_unexecuted_blocks=1 00:16:21.537 00:16:21.537 ' 00:16:21.537 04:22:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:21.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.537 --rc genhtml_branch_coverage=1 00:16:21.537 --rc genhtml_function_coverage=1 00:16:21.537 --rc genhtml_legend=1 00:16:21.537 --rc geninfo_all_blocks=1 00:16:21.537 --rc geninfo_unexecuted_blocks=1 00:16:21.537 00:16:21.537 ' 00:16:21.537 04:22:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:21.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.537 --rc genhtml_branch_coverage=1 00:16:21.537 --rc genhtml_function_coverage=1 00:16:21.537 --rc genhtml_legend=1 00:16:21.537 --rc geninfo_all_blocks=1 00:16:21.537 --rc geninfo_unexecuted_blocks=1 00:16:21.537 00:16:21.537 ' 00:16:21.537 04:22:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:21.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.537 --rc genhtml_branch_coverage=1 00:16:21.537 --rc genhtml_function_coverage=1 00:16:21.537 --rc genhtml_legend=1 00:16:21.537 --rc geninfo_all_blocks=1 00:16:21.537 --rc geninfo_unexecuted_blocks=1 00:16:21.537 00:16:21.537 ' 00:16:21.537 04:22:58 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:21.537 04:22:58 -- nvmf/common.sh@7 -- # uname -s 00:16:21.537 04:22:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:21.537 04:22:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:21.537 04:22:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:21.537 04:22:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:21.537 04:22:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:21.537 04:22:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:21.537 04:22:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:21.537 04:22:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:21.537 04:22:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:21.537 04:22:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:21.537 04:22:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:21.537 04:22:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:21.537 04:22:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:21.537 04:22:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:21.537 04:22:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:21.537 04:22:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:21.537 04:22:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:21.537 04:22:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:21.537 04:22:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:21.537 04:22:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.537 04:22:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.537 04:22:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.537 04:22:58 -- paths/export.sh@5 -- # export PATH 00:16:21.537 04:22:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:21.537 04:22:58 -- nvmf/common.sh@46 -- # : 0 00:16:21.537 04:22:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:21.537 04:22:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:21.537 04:22:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:21.537 04:22:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:21.537 04:22:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:21.537 04:22:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:21.537 04:22:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:21.537 04:22:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:21.537 04:22:58 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:21.537 04:22:58 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:21.537 04:22:58 -- target/nmic.sh@14 -- # nvmftestinit 00:16:21.537 04:22:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:21.537 04:22:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:21.537 04:22:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:21.537 04:22:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:21.537 04:22:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:21.537 04:22:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:21.537 04:22:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:21.537 04:22:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:21.537 04:22:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:21.537 04:22:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:21.537 04:22:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:21.537 04:22:58 -- common/autotest_common.sh@10 -- # set +x 00:16:23.440 04:23:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:23.440 04:23:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:23.440 04:23:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:23.440 04:23:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:23.440 04:23:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:23.440 04:23:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:23.440 04:23:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:23.440 04:23:00 -- nvmf/common.sh@294 -- # net_devs=() 00:16:23.440 04:23:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:23.440 04:23:00 -- nvmf/common.sh@295 -- # e810=() 00:16:23.440 04:23:00 -- nvmf/common.sh@295 -- # local -ga e810 00:16:23.440 04:23:00 -- nvmf/common.sh@296 -- # x722=() 00:16:23.440 04:23:00 -- nvmf/common.sh@296 -- # local -ga x722 00:16:23.440 04:23:00 -- nvmf/common.sh@297 -- # mlx=() 00:16:23.440 04:23:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:23.440 04:23:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:23.440 04:23:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:23.440 04:23:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:23.440 04:23:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:23.440 04:23:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:23.440 04:23:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:23.440 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:23.440 04:23:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:23.440 04:23:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:23.440 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:23.440 04:23:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:23.440 04:23:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:23.440 04:23:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:23.440 04:23:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:23.440 04:23:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:23.440 04:23:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:23.440 04:23:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:23.440 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:23.440 04:23:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:23.440 04:23:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:23.440 04:23:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:23.440 04:23:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:23.440 04:23:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:23.440 04:23:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:23.440 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:23.440 04:23:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:23.440 04:23:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:23.440 04:23:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:23.441 04:23:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:23.441 04:23:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:23.441 04:23:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:23.441 04:23:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:23.441 04:23:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:23.441 04:23:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:23.441 04:23:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:23.441 04:23:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:23.441 04:23:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:23.441 04:23:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:23.441 04:23:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:23.441 04:23:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:23.441 04:23:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:23.441 04:23:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:23.441 04:23:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:23.441 04:23:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:23.441 04:23:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:23.441 04:23:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:23.441 04:23:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:23.441 04:23:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:23.441 04:23:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:23.441 04:23:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:23.441 04:23:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:23.441 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:23.441 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.406 ms 00:16:23.441 00:16:23.441 --- 10.0.0.2 ping statistics --- 00:16:23.441 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:23.441 rtt min/avg/max/mdev = 0.406/0.406/0.406/0.000 ms 00:16:23.441 04:23:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:23.441 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:23.441 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:16:23.441 00:16:23.441 --- 10.0.0.1 ping statistics --- 00:16:23.441 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:23.441 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:16:23.441 04:23:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:23.441 04:23:00 -- nvmf/common.sh@410 -- # return 0 00:16:23.441 04:23:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:23.441 04:23:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:23.441 04:23:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:23.441 04:23:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:23.441 04:23:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:23.441 04:23:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:23.441 04:23:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:23.441 04:23:00 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:23.441 04:23:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:23.441 04:23:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:23.441 04:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:23.441 04:23:00 -- nvmf/common.sh@469 -- # nvmfpid=3898161 00:16:23.441 04:23:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:23.441 04:23:00 -- nvmf/common.sh@470 -- # waitforlisten 3898161 00:16:23.441 04:23:00 -- common/autotest_common.sh@829 -- # '[' -z 3898161 ']' 00:16:23.441 04:23:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:23.441 04:23:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:23.441 04:23:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:23.441 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:23.441 04:23:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:23.441 04:23:00 -- common/autotest_common.sh@10 -- # set +x 00:16:23.441 [2024-11-28 04:23:00.565679] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:23.441 [2024-11-28 04:23:00.565766] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:23.441 EAL: No free 2048 kB hugepages reported on node 1 00:16:23.441 [2024-11-28 04:23:00.630476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:23.441 [2024-11-28 04:23:00.747747] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:23.441 [2024-11-28 04:23:00.747923] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:23.441 [2024-11-28 04:23:00.747941] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:23.441 [2024-11-28 04:23:00.747954] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:23.441 [2024-11-28 04:23:00.748008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:23.441 [2024-11-28 04:23:00.748208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:23.441 [2024-11-28 04:23:00.748257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:23.441 [2024-11-28 04:23:00.748260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:24.374 04:23:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:24.374 04:23:01 -- common/autotest_common.sh@862 -- # return 0 00:16:24.374 04:23:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:24.374 04:23:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:24.374 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.374 04:23:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:24.374 04:23:01 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:24.374 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.374 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.374 [2024-11-28 04:23:01.620375] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:24.374 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.374 04:23:01 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:24.374 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.374 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.374 Malloc0 00:16:24.374 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.374 04:23:01 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:24.374 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.374 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.374 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.374 04:23:01 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:24.374 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.374 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.374 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.374 04:23:01 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:24.374 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.374 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.374 [2024-11-28 04:23:01.673641] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:24.374 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.374 04:23:01 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:24.374 test case1: single bdev can't be used in multiple subsystems 00:16:24.374 04:23:01 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:24.374 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.374 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.631 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.631 04:23:01 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:24.631 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.631 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.631 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.631 04:23:01 -- target/nmic.sh@28 -- # nmic_status=0 00:16:24.631 04:23:01 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:24.631 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.631 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.631 [2024-11-28 04:23:01.697483] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:24.631 [2024-11-28 04:23:01.697535] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:24.631 [2024-11-28 04:23:01.697562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:24.631 request: 00:16:24.631 { 00:16:24.631 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:24.631 "namespace": { 00:16:24.631 "bdev_name": "Malloc0" 00:16:24.631 }, 00:16:24.631 "method": "nvmf_subsystem_add_ns", 00:16:24.631 "req_id": 1 00:16:24.631 } 00:16:24.631 Got JSON-RPC error response 00:16:24.631 response: 00:16:24.631 { 00:16:24.631 "code": -32602, 00:16:24.631 "message": "Invalid parameters" 00:16:24.631 } 00:16:24.631 04:23:01 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:24.631 04:23:01 -- target/nmic.sh@29 -- # nmic_status=1 00:16:24.631 04:23:01 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:24.631 04:23:01 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:24.631 Adding namespace failed - expected result. 00:16:24.631 04:23:01 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:24.631 test case2: host connect to nvmf target in multiple paths 00:16:24.631 04:23:01 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:24.631 04:23:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.631 04:23:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.631 [2024-11-28 04:23:01.705657] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:24.631 04:23:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.631 04:23:01 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:25.197 04:23:02 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:26.150 04:23:03 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:26.150 04:23:03 -- common/autotest_common.sh@1187 -- # local i=0 00:16:26.150 04:23:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:26.150 04:23:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:26.150 04:23:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:28.046 04:23:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:28.046 04:23:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:28.046 04:23:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:28.046 04:23:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:28.046 04:23:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:28.046 04:23:05 -- common/autotest_common.sh@1197 -- # return 0 00:16:28.046 04:23:05 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:28.046 [global] 00:16:28.046 thread=1 00:16:28.046 invalidate=1 00:16:28.046 rw=write 00:16:28.046 time_based=1 00:16:28.046 runtime=1 00:16:28.046 ioengine=libaio 00:16:28.046 direct=1 00:16:28.046 bs=4096 00:16:28.046 iodepth=1 00:16:28.046 norandommap=0 00:16:28.046 numjobs=1 00:16:28.046 00:16:28.046 verify_dump=1 00:16:28.046 verify_backlog=512 00:16:28.046 verify_state_save=0 00:16:28.046 do_verify=1 00:16:28.046 verify=crc32c-intel 00:16:28.046 [job0] 00:16:28.046 filename=/dev/nvme0n1 00:16:28.046 Could not set queue depth (nvme0n1) 00:16:28.046 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:28.046 fio-3.35 00:16:28.046 Starting 1 thread 00:16:29.417 00:16:29.417 job0: (groupid=0, jobs=1): err= 0: pid=3898826: Thu Nov 28 04:23:06 2024 00:16:29.417 read: IOPS=998, BW=3992KiB/s (4088kB/s)(4132KiB/1035msec) 00:16:29.417 slat (nsec): min=5505, max=69221, avg=22406.82, stdev=10699.25 00:16:29.417 clat (usec): min=202, max=41052, avg=679.13, stdev=3775.77 00:16:29.417 lat (usec): min=211, max=41068, avg=701.54, stdev=3775.29 00:16:29.417 clat percentiles (usec): 00:16:29.417 | 1.00th=[ 227], 5.00th=[ 265], 10.00th=[ 273], 20.00th=[ 281], 00:16:29.417 | 30.00th=[ 293], 40.00th=[ 306], 50.00th=[ 326], 60.00th=[ 343], 00:16:29.417 | 70.00th=[ 355], 80.00th=[ 367], 90.00th=[ 379], 95.00th=[ 392], 00:16:29.417 | 99.00th=[ 523], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:29.417 | 99.99th=[41157] 00:16:29.417 write: IOPS=1484, BW=5936KiB/s (6079kB/s)(6144KiB/1035msec); 0 zone resets 00:16:29.417 slat (nsec): min=6956, max=53838, avg=14883.70, stdev=6012.58 00:16:29.417 clat (usec): min=137, max=457, avg=177.84, stdev=24.17 00:16:29.417 lat (usec): min=146, max=503, avg=192.73, stdev=28.07 00:16:29.417 clat percentiles (usec): 00:16:29.417 | 1.00th=[ 141], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 155], 00:16:29.417 | 30.00th=[ 163], 40.00th=[ 172], 50.00th=[ 178], 60.00th=[ 184], 00:16:29.417 | 70.00th=[ 188], 80.00th=[ 196], 90.00th=[ 208], 95.00th=[ 217], 00:16:29.417 | 99.00th=[ 237], 99.50th=[ 255], 99.90th=[ 334], 99.95th=[ 457], 00:16:29.417 | 99.99th=[ 457] 00:16:29.417 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6144.00, stdev=2896.31, samples=2 00:16:29.417 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:29.417 lat (usec) : 250=60.22%, 500=39.08%, 750=0.35% 00:16:29.417 lat (msec) : 50=0.35% 00:16:29.417 cpu : usr=3.00%, sys=4.55%, ctx=2569, majf=0, minf=1 00:16:29.417 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:29.417 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:29.417 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:29.417 issued rwts: total=1033,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:29.417 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:29.417 00:16:29.417 Run status group 0 (all jobs): 00:16:29.417 READ: bw=3992KiB/s (4088kB/s), 3992KiB/s-3992KiB/s (4088kB/s-4088kB/s), io=4132KiB (4231kB), run=1035-1035msec 00:16:29.417 WRITE: bw=5936KiB/s (6079kB/s), 5936KiB/s-5936KiB/s (6079kB/s-6079kB/s), io=6144KiB (6291kB), run=1035-1035msec 00:16:29.417 00:16:29.417 Disk stats (read/write): 00:16:29.417 nvme0n1: ios=1079/1536, merge=0/0, ticks=564/271, in_queue=835, util=91.68% 00:16:29.417 04:23:06 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:29.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:29.417 04:23:06 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:29.417 04:23:06 -- common/autotest_common.sh@1208 -- # local i=0 00:16:29.417 04:23:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:29.417 04:23:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:29.417 04:23:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:29.417 04:23:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:29.417 04:23:06 -- common/autotest_common.sh@1220 -- # return 0 00:16:29.417 04:23:06 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:29.417 04:23:06 -- target/nmic.sh@53 -- # nvmftestfini 00:16:29.417 04:23:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:29.417 04:23:06 -- nvmf/common.sh@116 -- # sync 00:16:29.417 04:23:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:29.417 04:23:06 -- nvmf/common.sh@119 -- # set +e 00:16:29.417 04:23:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:29.417 04:23:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:29.417 rmmod nvme_tcp 00:16:29.417 rmmod nvme_fabrics 00:16:29.417 rmmod nvme_keyring 00:16:29.417 04:23:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:29.417 04:23:06 -- nvmf/common.sh@123 -- # set -e 00:16:29.417 04:23:06 -- nvmf/common.sh@124 -- # return 0 00:16:29.417 04:23:06 -- nvmf/common.sh@477 -- # '[' -n 3898161 ']' 00:16:29.417 04:23:06 -- nvmf/common.sh@478 -- # killprocess 3898161 00:16:29.417 04:23:06 -- common/autotest_common.sh@936 -- # '[' -z 3898161 ']' 00:16:29.417 04:23:06 -- common/autotest_common.sh@940 -- # kill -0 3898161 00:16:29.417 04:23:06 -- common/autotest_common.sh@941 -- # uname 00:16:29.417 04:23:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:29.417 04:23:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3898161 00:16:29.417 04:23:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:29.417 04:23:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:29.417 04:23:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3898161' 00:16:29.417 killing process with pid 3898161 00:16:29.417 04:23:06 -- common/autotest_common.sh@955 -- # kill 3898161 00:16:29.417 04:23:06 -- common/autotest_common.sh@960 -- # wait 3898161 00:16:29.985 04:23:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:29.985 04:23:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:29.985 04:23:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:29.985 04:23:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:29.985 04:23:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:29.985 04:23:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:29.985 04:23:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:29.985 04:23:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:31.891 04:23:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:31.891 00:16:31.891 real 0m10.791s 00:16:31.891 user 0m26.034s 00:16:31.891 sys 0m2.427s 00:16:31.891 04:23:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:31.891 04:23:09 -- common/autotest_common.sh@10 -- # set +x 00:16:31.891 ************************************ 00:16:31.891 END TEST nvmf_nmic 00:16:31.891 ************************************ 00:16:31.891 04:23:09 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:31.891 04:23:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:31.891 04:23:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:31.891 04:23:09 -- common/autotest_common.sh@10 -- # set +x 00:16:31.891 ************************************ 00:16:31.891 START TEST nvmf_fio_target 00:16:31.891 ************************************ 00:16:31.891 04:23:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:31.891 * Looking for test storage... 00:16:31.891 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:31.891 04:23:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:31.891 04:23:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:31.891 04:23:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:32.149 04:23:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:32.150 04:23:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:32.150 04:23:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:32.150 04:23:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:32.150 04:23:09 -- scripts/common.sh@335 -- # IFS=.-: 00:16:32.150 04:23:09 -- scripts/common.sh@335 -- # read -ra ver1 00:16:32.150 04:23:09 -- scripts/common.sh@336 -- # IFS=.-: 00:16:32.150 04:23:09 -- scripts/common.sh@336 -- # read -ra ver2 00:16:32.150 04:23:09 -- scripts/common.sh@337 -- # local 'op=<' 00:16:32.150 04:23:09 -- scripts/common.sh@339 -- # ver1_l=2 00:16:32.150 04:23:09 -- scripts/common.sh@340 -- # ver2_l=1 00:16:32.150 04:23:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:32.150 04:23:09 -- scripts/common.sh@343 -- # case "$op" in 00:16:32.150 04:23:09 -- scripts/common.sh@344 -- # : 1 00:16:32.150 04:23:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:32.150 04:23:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:32.150 04:23:09 -- scripts/common.sh@364 -- # decimal 1 00:16:32.150 04:23:09 -- scripts/common.sh@352 -- # local d=1 00:16:32.150 04:23:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:32.150 04:23:09 -- scripts/common.sh@354 -- # echo 1 00:16:32.150 04:23:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:32.150 04:23:09 -- scripts/common.sh@365 -- # decimal 2 00:16:32.150 04:23:09 -- scripts/common.sh@352 -- # local d=2 00:16:32.150 04:23:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:32.150 04:23:09 -- scripts/common.sh@354 -- # echo 2 00:16:32.150 04:23:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:32.150 04:23:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:32.150 04:23:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:32.150 04:23:09 -- scripts/common.sh@367 -- # return 0 00:16:32.150 04:23:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:32.150 04:23:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:32.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.150 --rc genhtml_branch_coverage=1 00:16:32.150 --rc genhtml_function_coverage=1 00:16:32.150 --rc genhtml_legend=1 00:16:32.150 --rc geninfo_all_blocks=1 00:16:32.150 --rc geninfo_unexecuted_blocks=1 00:16:32.150 00:16:32.150 ' 00:16:32.150 04:23:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:32.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.150 --rc genhtml_branch_coverage=1 00:16:32.150 --rc genhtml_function_coverage=1 00:16:32.150 --rc genhtml_legend=1 00:16:32.150 --rc geninfo_all_blocks=1 00:16:32.150 --rc geninfo_unexecuted_blocks=1 00:16:32.150 00:16:32.150 ' 00:16:32.150 04:23:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:32.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.150 --rc genhtml_branch_coverage=1 00:16:32.150 --rc genhtml_function_coverage=1 00:16:32.150 --rc genhtml_legend=1 00:16:32.150 --rc geninfo_all_blocks=1 00:16:32.150 --rc geninfo_unexecuted_blocks=1 00:16:32.150 00:16:32.150 ' 00:16:32.150 04:23:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:32.150 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.150 --rc genhtml_branch_coverage=1 00:16:32.150 --rc genhtml_function_coverage=1 00:16:32.150 --rc genhtml_legend=1 00:16:32.150 --rc geninfo_all_blocks=1 00:16:32.150 --rc geninfo_unexecuted_blocks=1 00:16:32.150 00:16:32.150 ' 00:16:32.150 04:23:09 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:32.150 04:23:09 -- nvmf/common.sh@7 -- # uname -s 00:16:32.150 04:23:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:32.150 04:23:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:32.150 04:23:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:32.150 04:23:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:32.150 04:23:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:32.150 04:23:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:32.150 04:23:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:32.150 04:23:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:32.150 04:23:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:32.150 04:23:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:32.150 04:23:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:32.150 04:23:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:32.150 04:23:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:32.150 04:23:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:32.150 04:23:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:32.150 04:23:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:32.150 04:23:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:32.150 04:23:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:32.150 04:23:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:32.150 04:23:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.150 04:23:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.150 04:23:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.150 04:23:09 -- paths/export.sh@5 -- # export PATH 00:16:32.150 04:23:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.150 04:23:09 -- nvmf/common.sh@46 -- # : 0 00:16:32.150 04:23:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:32.150 04:23:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:32.150 04:23:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:32.150 04:23:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:32.150 04:23:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:32.150 04:23:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:32.150 04:23:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:32.150 04:23:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:32.150 04:23:09 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:32.150 04:23:09 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:32.150 04:23:09 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:32.150 04:23:09 -- target/fio.sh@16 -- # nvmftestinit 00:16:32.150 04:23:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:32.150 04:23:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:32.150 04:23:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:32.150 04:23:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:32.150 04:23:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:32.150 04:23:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:32.150 04:23:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:32.150 04:23:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:32.150 04:23:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:32.150 04:23:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:32.150 04:23:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:32.150 04:23:09 -- common/autotest_common.sh@10 -- # set +x 00:16:34.124 04:23:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:34.124 04:23:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:34.124 04:23:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:34.124 04:23:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:34.124 04:23:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:34.124 04:23:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:34.125 04:23:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:34.125 04:23:11 -- nvmf/common.sh@294 -- # net_devs=() 00:16:34.125 04:23:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:34.125 04:23:11 -- nvmf/common.sh@295 -- # e810=() 00:16:34.125 04:23:11 -- nvmf/common.sh@295 -- # local -ga e810 00:16:34.125 04:23:11 -- nvmf/common.sh@296 -- # x722=() 00:16:34.125 04:23:11 -- nvmf/common.sh@296 -- # local -ga x722 00:16:34.125 04:23:11 -- nvmf/common.sh@297 -- # mlx=() 00:16:34.125 04:23:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:34.125 04:23:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:34.125 04:23:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:34.125 04:23:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:34.125 04:23:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:34.125 04:23:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:34.125 04:23:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:34.125 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:34.125 04:23:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:34.125 04:23:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:34.125 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:34.125 04:23:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:34.125 04:23:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:34.125 04:23:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:34.125 04:23:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:34.125 04:23:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:34.125 04:23:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:34.125 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:34.125 04:23:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:34.125 04:23:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:34.125 04:23:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:34.125 04:23:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:34.125 04:23:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:34.125 04:23:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:34.125 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:34.125 04:23:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:34.125 04:23:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:34.125 04:23:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:34.125 04:23:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:34.125 04:23:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:34.125 04:23:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:34.125 04:23:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:34.125 04:23:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:34.125 04:23:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:34.125 04:23:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:34.125 04:23:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:34.125 04:23:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:34.125 04:23:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:34.125 04:23:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:34.125 04:23:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:34.125 04:23:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:34.125 04:23:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:34.125 04:23:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:34.125 04:23:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:34.125 04:23:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:34.125 04:23:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:34.125 04:23:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:34.125 04:23:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:34.125 04:23:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:34.125 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:34.125 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:16:34.125 00:16:34.125 --- 10.0.0.2 ping statistics --- 00:16:34.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:34.125 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:16:34.125 04:23:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:34.125 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:34.125 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:16:34.125 00:16:34.125 --- 10.0.0.1 ping statistics --- 00:16:34.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:34.125 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:16:34.125 04:23:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:34.125 04:23:11 -- nvmf/common.sh@410 -- # return 0 00:16:34.125 04:23:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:34.125 04:23:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:34.125 04:23:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:34.125 04:23:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:34.125 04:23:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:34.125 04:23:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:34.383 04:23:11 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:34.383 04:23:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:34.383 04:23:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:34.383 04:23:11 -- common/autotest_common.sh@10 -- # set +x 00:16:34.383 04:23:11 -- nvmf/common.sh@469 -- # nvmfpid=3900924 00:16:34.383 04:23:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:34.383 04:23:11 -- nvmf/common.sh@470 -- # waitforlisten 3900924 00:16:34.383 04:23:11 -- common/autotest_common.sh@829 -- # '[' -z 3900924 ']' 00:16:34.383 04:23:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:34.383 04:23:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:34.383 04:23:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:34.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:34.383 04:23:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:34.383 04:23:11 -- common/autotest_common.sh@10 -- # set +x 00:16:34.383 [2024-11-28 04:23:11.487542] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:34.383 [2024-11-28 04:23:11.487620] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:34.383 EAL: No free 2048 kB hugepages reported on node 1 00:16:34.383 [2024-11-28 04:23:11.557808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:34.383 [2024-11-28 04:23:11.667281] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:34.383 [2024-11-28 04:23:11.667442] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:34.383 [2024-11-28 04:23:11.667460] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:34.383 [2024-11-28 04:23:11.667473] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:34.383 [2024-11-28 04:23:11.667555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:34.383 [2024-11-28 04:23:11.667599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:34.383 [2024-11-28 04:23:11.667652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:34.383 [2024-11-28 04:23:11.667655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:35.316 04:23:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:35.316 04:23:12 -- common/autotest_common.sh@862 -- # return 0 00:16:35.316 04:23:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:35.316 04:23:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:35.316 04:23:12 -- common/autotest_common.sh@10 -- # set +x 00:16:35.316 04:23:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:35.316 04:23:12 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:35.573 [2024-11-28 04:23:12.701906] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:35.573 04:23:12 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:35.831 04:23:13 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:35.831 04:23:13 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:36.089 04:23:13 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:36.089 04:23:13 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:36.346 04:23:13 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:36.346 04:23:13 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:36.605 04:23:13 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:36.605 04:23:13 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:36.862 04:23:14 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:37.120 04:23:14 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:37.120 04:23:14 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:37.379 04:23:14 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:37.379 04:23:14 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:37.637 04:23:14 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:37.637 04:23:14 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:37.894 04:23:15 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:38.152 04:23:15 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:38.152 04:23:15 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:38.410 04:23:15 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:38.410 04:23:15 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:38.668 04:23:15 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:38.925 [2024-11-28 04:23:16.129576] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:38.925 04:23:16 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:39.182 04:23:16 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:39.439 04:23:16 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:40.372 04:23:17 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:40.372 04:23:17 -- common/autotest_common.sh@1187 -- # local i=0 00:16:40.372 04:23:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:40.372 04:23:17 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:40.372 04:23:17 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:40.372 04:23:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:42.270 04:23:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:42.270 04:23:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:42.270 04:23:19 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:42.270 04:23:19 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:42.270 04:23:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:42.270 04:23:19 -- common/autotest_common.sh@1197 -- # return 0 00:16:42.270 04:23:19 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:42.270 [global] 00:16:42.270 thread=1 00:16:42.270 invalidate=1 00:16:42.270 rw=write 00:16:42.270 time_based=1 00:16:42.270 runtime=1 00:16:42.270 ioengine=libaio 00:16:42.270 direct=1 00:16:42.270 bs=4096 00:16:42.270 iodepth=1 00:16:42.270 norandommap=0 00:16:42.270 numjobs=1 00:16:42.270 00:16:42.270 verify_dump=1 00:16:42.270 verify_backlog=512 00:16:42.270 verify_state_save=0 00:16:42.270 do_verify=1 00:16:42.270 verify=crc32c-intel 00:16:42.270 [job0] 00:16:42.270 filename=/dev/nvme0n1 00:16:42.270 [job1] 00:16:42.270 filename=/dev/nvme0n2 00:16:42.270 [job2] 00:16:42.270 filename=/dev/nvme0n3 00:16:42.270 [job3] 00:16:42.270 filename=/dev/nvme0n4 00:16:42.270 Could not set queue depth (nvme0n1) 00:16:42.270 Could not set queue depth (nvme0n2) 00:16:42.270 Could not set queue depth (nvme0n3) 00:16:42.270 Could not set queue depth (nvme0n4) 00:16:42.528 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:42.528 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:42.529 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:42.529 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:42.529 fio-3.35 00:16:42.529 Starting 4 threads 00:16:43.901 00:16:43.901 job0: (groupid=0, jobs=1): err= 0: pid=3902130: Thu Nov 28 04:23:20 2024 00:16:43.901 read: IOPS=20, BW=83.7KiB/s (85.8kB/s)(84.0KiB/1003msec) 00:16:43.901 slat (nsec): min=7203, max=36593, avg=27097.00, stdev=10183.94 00:16:43.901 clat (usec): min=40854, max=41031, avg=40955.27, stdev=40.57 00:16:43.901 lat (usec): min=40861, max=41059, avg=40982.37, stdev=41.78 00:16:43.901 clat percentiles (usec): 00:16:43.901 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:43.901 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:43.901 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:43.901 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:43.901 | 99.99th=[41157] 00:16:43.901 write: IOPS=510, BW=2042KiB/s (2091kB/s)(2048KiB/1003msec); 0 zone resets 00:16:43.901 slat (usec): min=7, max=916, avg=14.54, stdev=40.58 00:16:43.901 clat (usec): min=183, max=652, avg=252.47, stdev=37.92 00:16:43.901 lat (usec): min=199, max=1190, avg=267.00, stdev=55.76 00:16:43.901 clat percentiles (usec): 00:16:43.901 | 1.00th=[ 198], 5.00th=[ 208], 10.00th=[ 221], 20.00th=[ 231], 00:16:43.901 | 30.00th=[ 241], 40.00th=[ 243], 50.00th=[ 245], 60.00th=[ 245], 00:16:43.901 | 70.00th=[ 251], 80.00th=[ 269], 90.00th=[ 293], 95.00th=[ 322], 00:16:43.901 | 99.00th=[ 379], 99.50th=[ 408], 99.90th=[ 652], 99.95th=[ 652], 00:16:43.901 | 99.99th=[ 652] 00:16:43.901 bw ( KiB/s): min= 4096, max= 4096, per=34.57%, avg=4096.00, stdev= 0.00, samples=1 00:16:43.901 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:43.901 lat (usec) : 250=65.29%, 500=30.58%, 750=0.19% 00:16:43.901 lat (msec) : 50=3.94% 00:16:43.901 cpu : usr=0.60%, sys=0.80%, ctx=535, majf=0, minf=1 00:16:43.901 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:43.901 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.901 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.901 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.901 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:43.901 job1: (groupid=0, jobs=1): err= 0: pid=3902151: Thu Nov 28 04:23:20 2024 00:16:43.901 read: IOPS=1072, BW=4290KiB/s (4393kB/s)(4444KiB/1036msec) 00:16:43.901 slat (nsec): min=6506, max=52806, avg=15663.29, stdev=4161.37 00:16:43.901 clat (usec): min=237, max=43814, avg=610.33, stdev=3459.33 00:16:43.901 lat (usec): min=245, max=43829, avg=625.99, stdev=3458.95 00:16:43.901 clat percentiles (usec): 00:16:43.901 | 1.00th=[ 251], 5.00th=[ 265], 10.00th=[ 277], 20.00th=[ 281], 00:16:43.901 | 30.00th=[ 285], 40.00th=[ 289], 50.00th=[ 293], 60.00th=[ 297], 00:16:43.901 | 70.00th=[ 306], 80.00th=[ 330], 90.00th=[ 437], 95.00th=[ 494], 00:16:43.901 | 99.00th=[ 594], 99.50th=[40633], 99.90th=[41157], 99.95th=[43779], 00:16:43.901 | 99.99th=[43779] 00:16:43.901 write: IOPS=1482, BW=5931KiB/s (6073kB/s)(6144KiB/1036msec); 0 zone resets 00:16:43.901 slat (nsec): min=6957, max=49896, avg=17350.82, stdev=6634.44 00:16:43.901 clat (usec): min=149, max=746, avg=195.50, stdev=35.80 00:16:43.901 lat (usec): min=160, max=754, avg=212.85, stdev=35.92 00:16:43.901 clat percentiles (usec): 00:16:43.901 | 1.00th=[ 155], 5.00th=[ 163], 10.00th=[ 172], 20.00th=[ 180], 00:16:43.901 | 30.00th=[ 182], 40.00th=[ 184], 50.00th=[ 188], 60.00th=[ 192], 00:16:43.901 | 70.00th=[ 196], 80.00th=[ 202], 90.00th=[ 225], 95.00th=[ 273], 00:16:43.902 | 99.00th=[ 326], 99.50th=[ 359], 99.90th=[ 537], 99.95th=[ 750], 00:16:43.902 | 99.99th=[ 750] 00:16:43.902 bw ( KiB/s): min= 4096, max= 8192, per=51.85%, avg=6144.00, stdev=2896.31, samples=2 00:16:43.902 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:43.902 lat (usec) : 250=54.48%, 500=43.71%, 750=1.51% 00:16:43.902 lat (msec) : 50=0.30% 00:16:43.902 cpu : usr=3.86%, sys=5.12%, ctx=2647, majf=0, minf=2 00:16:43.902 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:43.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.902 issued rwts: total=1111,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.902 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:43.902 job2: (groupid=0, jobs=1): err= 0: pid=3902158: Thu Nov 28 04:23:20 2024 00:16:43.902 read: IOPS=326, BW=1307KiB/s (1338kB/s)(1308KiB/1001msec) 00:16:43.902 slat (nsec): min=6928, max=38858, avg=13174.59, stdev=6776.34 00:16:43.902 clat (usec): min=236, max=41256, avg=2608.79, stdev=9337.50 00:16:43.902 lat (usec): min=244, max=41263, avg=2621.97, stdev=9341.12 00:16:43.902 clat percentiles (usec): 00:16:43.902 | 1.00th=[ 241], 5.00th=[ 251], 10.00th=[ 255], 20.00th=[ 265], 00:16:43.902 | 30.00th=[ 269], 40.00th=[ 277], 50.00th=[ 310], 60.00th=[ 326], 00:16:43.902 | 70.00th=[ 338], 80.00th=[ 355], 90.00th=[ 429], 95.00th=[41157], 00:16:43.902 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:43.902 | 99.99th=[41157] 00:16:43.902 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:16:43.902 slat (nsec): min=7850, max=49163, avg=12562.98, stdev=6793.00 00:16:43.902 clat (usec): min=150, max=493, avg=254.22, stdev=58.70 00:16:43.902 lat (usec): min=158, max=519, avg=266.78, stdev=59.70 00:16:43.902 clat percentiles (usec): 00:16:43.902 | 1.00th=[ 157], 5.00th=[ 178], 10.00th=[ 198], 20.00th=[ 215], 00:16:43.902 | 30.00th=[ 223], 40.00th=[ 231], 50.00th=[ 241], 60.00th=[ 249], 00:16:43.902 | 70.00th=[ 262], 80.00th=[ 293], 90.00th=[ 338], 95.00th=[ 392], 00:16:43.902 | 99.00th=[ 429], 99.50th=[ 437], 99.90th=[ 494], 99.95th=[ 494], 00:16:43.902 | 99.99th=[ 494] 00:16:43.902 bw ( KiB/s): min= 4096, max= 4096, per=34.57%, avg=4096.00, stdev= 0.00, samples=1 00:16:43.902 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:43.902 lat (usec) : 250=39.21%, 500=57.81%, 750=0.72% 00:16:43.902 lat (msec) : 50=2.26% 00:16:43.902 cpu : usr=0.70%, sys=1.40%, ctx=840, majf=0, minf=1 00:16:43.902 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:43.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.902 issued rwts: total=327,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.902 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:43.902 job3: (groupid=0, jobs=1): err= 0: pid=3902159: Thu Nov 28 04:23:20 2024 00:16:43.902 read: IOPS=81, BW=328KiB/s (336kB/s)(340KiB/1037msec) 00:16:43.902 slat (nsec): min=7101, max=36165, avg=17883.86, stdev=11262.59 00:16:43.902 clat (usec): min=241, max=41355, avg=10764.74, stdev=17807.12 00:16:43.902 lat (usec): min=256, max=41365, avg=10782.62, stdev=17811.02 00:16:43.902 clat percentiles (usec): 00:16:43.902 | 1.00th=[ 241], 5.00th=[ 251], 10.00th=[ 255], 20.00th=[ 262], 00:16:43.902 | 30.00th=[ 273], 40.00th=[ 277], 50.00th=[ 322], 60.00th=[ 379], 00:16:43.902 | 70.00th=[ 392], 80.00th=[40633], 90.00th=[40633], 95.00th=[41157], 00:16:43.902 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:43.902 | 99.99th=[41157] 00:16:43.902 write: IOPS=493, BW=1975KiB/s (2022kB/s)(2048KiB/1037msec); 0 zone resets 00:16:43.902 slat (usec): min=7, max=952, avg=15.81, stdev=48.43 00:16:43.902 clat (usec): min=161, max=981, avg=208.23, stdev=45.72 00:16:43.902 lat (usec): min=170, max=1258, avg=224.03, stdev=71.19 00:16:43.902 clat percentiles (usec): 00:16:43.902 | 1.00th=[ 169], 5.00th=[ 176], 10.00th=[ 180], 20.00th=[ 184], 00:16:43.902 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 200], 60.00th=[ 206], 00:16:43.902 | 70.00th=[ 215], 80.00th=[ 225], 90.00th=[ 243], 95.00th=[ 260], 00:16:43.902 | 99.00th=[ 355], 99.50th=[ 396], 99.90th=[ 979], 99.95th=[ 979], 00:16:43.902 | 99.99th=[ 979] 00:16:43.902 bw ( KiB/s): min= 4096, max= 4096, per=34.57%, avg=4096.00, stdev= 0.00, samples=1 00:16:43.902 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:43.902 lat (usec) : 250=79.90%, 500=16.25%, 1000=0.17% 00:16:43.902 lat (msec) : 50=3.69% 00:16:43.902 cpu : usr=0.58%, sys=0.87%, ctx=602, majf=0, minf=1 00:16:43.902 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:43.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.902 issued rwts: total=85,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.902 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:43.902 00:16:43.902 Run status group 0 (all jobs): 00:16:43.902 READ: bw=5956KiB/s (6099kB/s), 83.7KiB/s-4290KiB/s (85.8kB/s-4393kB/s), io=6176KiB (6324kB), run=1001-1037msec 00:16:43.902 WRITE: bw=11.6MiB/s (12.1MB/s), 1975KiB/s-5931KiB/s (2022kB/s-6073kB/s), io=12.0MiB (12.6MB), run=1001-1037msec 00:16:43.902 00:16:43.902 Disk stats (read/write): 00:16:43.902 nvme0n1: ios=68/512, merge=0/0, ticks=891/128, in_queue=1019, util=98.20% 00:16:43.902 nvme0n2: ios=1037/1331, merge=0/0, ticks=523/247, in_queue=770, util=86.67% 00:16:43.902 nvme0n3: ios=194/512, merge=0/0, ticks=1415/121, in_queue=1536, util=98.43% 00:16:43.902 nvme0n4: ios=120/512, merge=0/0, ticks=903/100, in_queue=1003, util=100.00% 00:16:43.902 04:23:20 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:43.902 [global] 00:16:43.902 thread=1 00:16:43.902 invalidate=1 00:16:43.902 rw=randwrite 00:16:43.902 time_based=1 00:16:43.902 runtime=1 00:16:43.902 ioengine=libaio 00:16:43.902 direct=1 00:16:43.902 bs=4096 00:16:43.902 iodepth=1 00:16:43.902 norandommap=0 00:16:43.902 numjobs=1 00:16:43.902 00:16:43.902 verify_dump=1 00:16:43.902 verify_backlog=512 00:16:43.902 verify_state_save=0 00:16:43.902 do_verify=1 00:16:43.902 verify=crc32c-intel 00:16:43.902 [job0] 00:16:43.902 filename=/dev/nvme0n1 00:16:43.902 [job1] 00:16:43.902 filename=/dev/nvme0n2 00:16:43.902 [job2] 00:16:43.902 filename=/dev/nvme0n3 00:16:43.902 [job3] 00:16:43.902 filename=/dev/nvme0n4 00:16:43.902 Could not set queue depth (nvme0n1) 00:16:43.902 Could not set queue depth (nvme0n2) 00:16:43.902 Could not set queue depth (nvme0n3) 00:16:43.902 Could not set queue depth (nvme0n4) 00:16:43.902 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.902 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.902 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.902 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.902 fio-3.35 00:16:43.902 Starting 4 threads 00:16:45.276 00:16:45.276 job0: (groupid=0, jobs=1): err= 0: pid=3902397: Thu Nov 28 04:23:22 2024 00:16:45.276 read: IOPS=21, BW=87.6KiB/s (89.7kB/s)(88.0KiB/1005msec) 00:16:45.276 slat (nsec): min=6725, max=34221, avg=21108.09, stdev=9073.43 00:16:45.276 clat (usec): min=40897, max=41996, avg=41241.38, stdev=450.38 00:16:45.276 lat (usec): min=40903, max=42028, avg=41262.49, stdev=453.31 00:16:45.276 clat percentiles (usec): 00:16:45.276 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:45.276 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:45.276 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:45.276 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:45.276 | 99.99th=[42206] 00:16:45.276 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:16:45.276 slat (nsec): min=5928, max=36950, avg=7307.68, stdev=2716.98 00:16:45.276 clat (usec): min=153, max=280, avg=180.21, stdev=11.76 00:16:45.276 lat (usec): min=159, max=317, avg=187.51, stdev=12.59 00:16:45.276 clat percentiles (usec): 00:16:45.276 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 167], 20.00th=[ 172], 00:16:45.276 | 30.00th=[ 174], 40.00th=[ 178], 50.00th=[ 180], 60.00th=[ 182], 00:16:45.276 | 70.00th=[ 184], 80.00th=[ 188], 90.00th=[ 196], 95.00th=[ 200], 00:16:45.276 | 99.00th=[ 210], 99.50th=[ 227], 99.90th=[ 281], 99.95th=[ 281], 00:16:45.276 | 99.99th=[ 281] 00:16:45.276 bw ( KiB/s): min= 4096, max= 4096, per=18.39%, avg=4096.00, stdev= 0.00, samples=1 00:16:45.276 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:45.276 lat (usec) : 250=95.69%, 500=0.19% 00:16:45.276 lat (msec) : 50=4.12% 00:16:45.276 cpu : usr=0.30%, sys=0.20%, ctx=534, majf=0, minf=2 00:16:45.276 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.276 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.277 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.277 job1: (groupid=0, jobs=1): err= 0: pid=3902398: Thu Nov 28 04:23:22 2024 00:16:45.277 read: IOPS=1164, BW=4659KiB/s (4771kB/s)(4664KiB/1001msec) 00:16:45.277 slat (nsec): min=4311, max=54216, avg=11730.70, stdev=5860.96 00:16:45.277 clat (usec): min=205, max=40987, avg=533.09, stdev=2963.10 00:16:45.277 lat (usec): min=210, max=41003, avg=544.83, stdev=2963.36 00:16:45.277 clat percentiles (usec): 00:16:45.277 | 1.00th=[ 225], 5.00th=[ 243], 10.00th=[ 251], 20.00th=[ 260], 00:16:45.277 | 30.00th=[ 269], 40.00th=[ 281], 50.00th=[ 289], 60.00th=[ 302], 00:16:45.277 | 70.00th=[ 314], 80.00th=[ 367], 90.00th=[ 383], 95.00th=[ 400], 00:16:45.277 | 99.00th=[ 832], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:16:45.277 | 99.99th=[41157] 00:16:45.277 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:16:45.277 slat (nsec): min=5933, max=53069, avg=15029.51, stdev=6226.80 00:16:45.277 clat (usec): min=148, max=478, avg=214.03, stdev=42.36 00:16:45.277 lat (usec): min=156, max=506, avg=229.06, stdev=41.21 00:16:45.277 clat percentiles (usec): 00:16:45.277 | 1.00th=[ 163], 5.00th=[ 176], 10.00th=[ 182], 20.00th=[ 188], 00:16:45.277 | 30.00th=[ 192], 40.00th=[ 198], 50.00th=[ 204], 60.00th=[ 210], 00:16:45.277 | 70.00th=[ 219], 80.00th=[ 231], 90.00th=[ 251], 95.00th=[ 277], 00:16:45.277 | 99.00th=[ 408], 99.50th=[ 437], 99.90th=[ 449], 99.95th=[ 478], 00:16:45.277 | 99.99th=[ 478] 00:16:45.277 bw ( KiB/s): min= 8192, max= 8192, per=36.77%, avg=8192.00, stdev= 0.00, samples=1 00:16:45.277 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:45.277 lat (usec) : 250=55.14%, 500=44.12%, 750=0.30%, 1000=0.07% 00:16:45.277 lat (msec) : 2=0.11%, 50=0.26% 00:16:45.277 cpu : usr=1.80%, sys=4.80%, ctx=2703, majf=0, minf=1 00:16:45.277 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.277 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 issued rwts: total=1166,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.277 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.277 job2: (groupid=0, jobs=1): err= 0: pid=3902400: Thu Nov 28 04:23:22 2024 00:16:45.277 read: IOPS=1443, BW=5774KiB/s (5913kB/s)(5780KiB/1001msec) 00:16:45.277 slat (nsec): min=5992, max=35414, avg=10643.29, stdev=5007.39 00:16:45.277 clat (usec): min=225, max=41233, avg=417.54, stdev=2141.49 00:16:45.277 lat (usec): min=233, max=41252, avg=428.18, stdev=2141.93 00:16:45.277 clat percentiles (usec): 00:16:45.277 | 1.00th=[ 247], 5.00th=[ 262], 10.00th=[ 265], 20.00th=[ 273], 00:16:45.277 | 30.00th=[ 281], 40.00th=[ 285], 50.00th=[ 293], 60.00th=[ 306], 00:16:45.277 | 70.00th=[ 314], 80.00th=[ 326], 90.00th=[ 351], 95.00th=[ 388], 00:16:45.277 | 99.00th=[ 441], 99.50th=[ 1020], 99.90th=[41157], 99.95th=[41157], 00:16:45.277 | 99.99th=[41157] 00:16:45.277 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:16:45.277 slat (nsec): min=7578, max=59203, avg=16287.71, stdev=7252.09 00:16:45.277 clat (usec): min=155, max=471, avg=222.66, stdev=42.22 00:16:45.277 lat (usec): min=166, max=488, avg=238.95, stdev=43.38 00:16:45.277 clat percentiles (usec): 00:16:45.277 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 180], 20.00th=[ 194], 00:16:45.277 | 30.00th=[ 202], 40.00th=[ 210], 50.00th=[ 217], 60.00th=[ 223], 00:16:45.277 | 70.00th=[ 231], 80.00th=[ 243], 90.00th=[ 269], 95.00th=[ 293], 00:16:45.277 | 99.00th=[ 408], 99.50th=[ 416], 99.90th=[ 469], 99.95th=[ 474], 00:16:45.277 | 99.99th=[ 474] 00:16:45.277 bw ( KiB/s): min= 4952, max= 4952, per=22.23%, avg=4952.00, stdev= 0.00, samples=1 00:16:45.277 iops : min= 1238, max= 1238, avg=1238.00, stdev= 0.00, samples=1 00:16:45.277 lat (usec) : 250=43.91%, 500=55.75%, 750=0.03%, 1000=0.03% 00:16:45.277 lat (msec) : 2=0.13%, 50=0.13% 00:16:45.277 cpu : usr=2.50%, sys=5.80%, ctx=2983, majf=0, minf=1 00:16:45.277 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.277 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 issued rwts: total=1445,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.277 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.277 job3: (groupid=0, jobs=1): err= 0: pid=3902401: Thu Nov 28 04:23:22 2024 00:16:45.277 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:45.277 slat (nsec): min=4701, max=56525, avg=13656.37, stdev=6263.28 00:16:45.277 clat (usec): min=230, max=40747, avg=348.85, stdev=1033.95 00:16:45.277 lat (usec): min=239, max=40765, avg=362.50, stdev=1034.14 00:16:45.277 clat percentiles (usec): 00:16:45.277 | 1.00th=[ 245], 5.00th=[ 255], 10.00th=[ 265], 20.00th=[ 273], 00:16:45.277 | 30.00th=[ 285], 40.00th=[ 293], 50.00th=[ 302], 60.00th=[ 310], 00:16:45.277 | 70.00th=[ 322], 80.00th=[ 379], 90.00th=[ 412], 95.00th=[ 465], 00:16:45.277 | 99.00th=[ 529], 99.50th=[ 586], 99.90th=[ 1369], 99.95th=[40633], 00:16:45.277 | 99.99th=[40633] 00:16:45.277 write: IOPS=2010, BW=8044KiB/s (8237kB/s)(8052KiB/1001msec); 0 zone resets 00:16:45.277 slat (nsec): min=6021, max=57334, avg=12407.20, stdev=5879.86 00:16:45.277 clat (usec): min=155, max=391, avg=201.25, stdev=27.34 00:16:45.277 lat (usec): min=164, max=399, avg=213.66, stdev=27.25 00:16:45.277 clat percentiles (usec): 00:16:45.277 | 1.00th=[ 161], 5.00th=[ 167], 10.00th=[ 172], 20.00th=[ 178], 00:16:45.277 | 30.00th=[ 186], 40.00th=[ 190], 50.00th=[ 198], 60.00th=[ 204], 00:16:45.277 | 70.00th=[ 210], 80.00th=[ 223], 90.00th=[ 239], 95.00th=[ 251], 00:16:45.277 | 99.00th=[ 277], 99.50th=[ 293], 99.90th=[ 379], 99.95th=[ 392], 00:16:45.277 | 99.99th=[ 392] 00:16:45.277 bw ( KiB/s): min= 8192, max= 8192, per=36.77%, avg=8192.00, stdev= 0.00, samples=1 00:16:45.277 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:45.277 lat (usec) : 250=54.64%, 500=44.29%, 750=0.99% 00:16:45.277 lat (msec) : 2=0.06%, 50=0.03% 00:16:45.277 cpu : usr=2.60%, sys=5.80%, ctx=3550, majf=0, minf=1 00:16:45.277 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.277 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.277 issued rwts: total=1536,2013,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.277 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.277 00:16:45.277 Run status group 0 (all jobs): 00:16:45.277 READ: bw=16.2MiB/s (17.0MB/s), 87.6KiB/s-6138KiB/s (89.7kB/s-6285kB/s), io=16.3MiB (17.1MB), run=1001-1005msec 00:16:45.277 WRITE: bw=21.8MiB/s (22.8MB/s), 2038KiB/s-8044KiB/s (2087kB/s-8237kB/s), io=21.9MiB (22.9MB), run=1001-1005msec 00:16:45.277 00:16:45.277 Disk stats (read/write): 00:16:45.277 nvme0n1: ios=68/512, merge=0/0, ticks=758/82, in_queue=840, util=86.67% 00:16:45.277 nvme0n2: ios=1050/1382, merge=0/0, ticks=1475/276, in_queue=1751, util=97.66% 00:16:45.277 nvme0n3: ios=1081/1428, merge=0/0, ticks=1353/304, in_queue=1657, util=97.59% 00:16:45.277 nvme0n4: ios=1350/1536, merge=0/0, ticks=465/288, in_queue=753, util=89.66% 00:16:45.277 04:23:22 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:45.277 [global] 00:16:45.277 thread=1 00:16:45.277 invalidate=1 00:16:45.277 rw=write 00:16:45.277 time_based=1 00:16:45.277 runtime=1 00:16:45.277 ioengine=libaio 00:16:45.277 direct=1 00:16:45.277 bs=4096 00:16:45.277 iodepth=128 00:16:45.277 norandommap=0 00:16:45.277 numjobs=1 00:16:45.277 00:16:45.277 verify_dump=1 00:16:45.277 verify_backlog=512 00:16:45.277 verify_state_save=0 00:16:45.277 do_verify=1 00:16:45.277 verify=crc32c-intel 00:16:45.277 [job0] 00:16:45.277 filename=/dev/nvme0n1 00:16:45.277 [job1] 00:16:45.277 filename=/dev/nvme0n2 00:16:45.277 [job2] 00:16:45.277 filename=/dev/nvme0n3 00:16:45.277 [job3] 00:16:45.277 filename=/dev/nvme0n4 00:16:45.277 Could not set queue depth (nvme0n1) 00:16:45.277 Could not set queue depth (nvme0n2) 00:16:45.277 Could not set queue depth (nvme0n3) 00:16:45.277 Could not set queue depth (nvme0n4) 00:16:45.277 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:45.277 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:45.277 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:45.277 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:45.277 fio-3.35 00:16:45.277 Starting 4 threads 00:16:46.653 00:16:46.653 job0: (groupid=0, jobs=1): err= 0: pid=3902628: Thu Nov 28 04:23:23 2024 00:16:46.653 read: IOPS=3050, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1007msec) 00:16:46.653 slat (usec): min=3, max=9474, avg=133.01, stdev=743.36 00:16:46.653 clat (usec): min=8745, max=44889, avg=16100.50, stdev=5238.40 00:16:46.653 lat (usec): min=8767, max=44908, avg=16233.52, stdev=5313.22 00:16:46.653 clat percentiles (usec): 00:16:46.653 | 1.00th=[ 9241], 5.00th=[11338], 10.00th=[11600], 20.00th=[12125], 00:16:46.653 | 30.00th=[12911], 40.00th=[13304], 50.00th=[14484], 60.00th=[16057], 00:16:46.653 | 70.00th=[17695], 80.00th=[19530], 90.00th=[21365], 95.00th=[25560], 00:16:46.653 | 99.00th=[37487], 99.50th=[42206], 99.90th=[44827], 99.95th=[44827], 00:16:46.653 | 99.99th=[44827] 00:16:46.653 write: IOPS=3200, BW=12.5MiB/s (13.1MB/s)(12.6MiB/1007msec); 0 zone resets 00:16:46.653 slat (usec): min=4, max=15433, avg=173.84, stdev=841.90 00:16:46.653 clat (usec): min=4194, max=48059, avg=24059.34, stdev=8409.64 00:16:46.653 lat (usec): min=9035, max=48094, avg=24233.18, stdev=8469.11 00:16:46.653 clat percentiles (usec): 00:16:46.653 | 1.00th=[10552], 5.00th=[11863], 10.00th=[13829], 20.00th=[16450], 00:16:46.653 | 30.00th=[17957], 40.00th=[20055], 50.00th=[22414], 60.00th=[25560], 00:16:46.653 | 70.00th=[29754], 80.00th=[32900], 90.00th=[36439], 95.00th=[38536], 00:16:46.653 | 99.00th=[43254], 99.50th=[44827], 99.90th=[47973], 99.95th=[47973], 00:16:46.653 | 99.99th=[47973] 00:16:46.653 bw ( KiB/s): min=10624, max=14136, per=21.30%, avg=12380.00, stdev=2483.36, samples=2 00:16:46.653 iops : min= 2656, max= 3534, avg=3095.00, stdev=620.84, samples=2 00:16:46.653 lat (msec) : 10=0.98%, 20=58.57%, 50=40.44% 00:16:46.653 cpu : usr=5.07%, sys=6.36%, ctx=394, majf=0, minf=1 00:16:46.653 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:46.653 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:46.653 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:46.653 issued rwts: total=3072,3223,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:46.653 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:46.653 job1: (groupid=0, jobs=1): err= 0: pid=3902629: Thu Nov 28 04:23:23 2024 00:16:46.653 read: IOPS=3059, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1004msec) 00:16:46.653 slat (usec): min=2, max=15153, avg=133.15, stdev=823.86 00:16:46.653 clat (usec): min=8444, max=41782, avg=16673.60, stdev=5854.36 00:16:46.653 lat (usec): min=8447, max=41790, avg=16806.75, stdev=5914.10 00:16:46.653 clat percentiles (usec): 00:16:46.653 | 1.00th=[ 8455], 5.00th=[ 8586], 10.00th=[11076], 20.00th=[12387], 00:16:46.653 | 30.00th=[13042], 40.00th=[14222], 50.00th=[15139], 60.00th=[16581], 00:16:46.653 | 70.00th=[18744], 80.00th=[20317], 90.00th=[23725], 95.00th=[28443], 00:16:46.653 | 99.00th=[38011], 99.50th=[38011], 99.90th=[38011], 99.95th=[41681], 00:16:46.653 | 99.99th=[41681] 00:16:46.653 write: IOPS=3163, BW=12.4MiB/s (13.0MB/s)(12.4MiB/1004msec); 0 zone resets 00:16:46.653 slat (usec): min=3, max=41030, avg=175.48, stdev=1061.63 00:16:46.653 clat (usec): min=1329, max=44417, avg=21375.63, stdev=9677.97 00:16:46.653 lat (usec): min=5141, max=66234, avg=21551.11, stdev=9778.30 00:16:46.653 clat percentiles (usec): 00:16:46.653 | 1.00th=[ 5997], 5.00th=[ 8455], 10.00th=[ 8848], 20.00th=[13042], 00:16:46.653 | 30.00th=[14746], 40.00th=[17957], 50.00th=[19530], 60.00th=[22152], 00:16:46.653 | 70.00th=[26084], 80.00th=[31327], 90.00th=[35914], 95.00th=[38011], 00:16:46.653 | 99.00th=[42206], 99.50th=[43779], 99.90th=[44303], 99.95th=[44303], 00:16:46.653 | 99.99th=[44303] 00:16:46.653 bw ( KiB/s): min=12208, max=12392, per=21.16%, avg=12300.00, stdev=130.11, samples=2 00:16:46.653 iops : min= 3052, max= 3098, avg=3075.00, stdev=32.53, samples=2 00:16:46.653 lat (msec) : 2=0.02%, 10=12.74%, 20=51.71%, 50=35.53% 00:16:46.653 cpu : usr=4.49%, sys=7.58%, ctx=381, majf=0, minf=1 00:16:46.653 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:46.653 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:46.653 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:46.653 issued rwts: total=3072,3176,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:46.653 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:46.653 job2: (groupid=0, jobs=1): err= 0: pid=3902630: Thu Nov 28 04:23:23 2024 00:16:46.653 read: IOPS=3709, BW=14.5MiB/s (15.2MB/s)(14.5MiB/1001msec) 00:16:46.653 slat (usec): min=2, max=14024, avg=136.30, stdev=804.87 00:16:46.653 clat (usec): min=724, max=57346, avg=17731.32, stdev=10485.62 00:16:46.653 lat (usec): min=740, max=60043, avg=17867.62, stdev=10563.70 00:16:46.653 clat percentiles (usec): 00:16:46.653 | 1.00th=[ 4359], 5.00th=[ 9765], 10.00th=[10683], 20.00th=[11600], 00:16:46.653 | 30.00th=[12125], 40.00th=[12387], 50.00th=[12780], 60.00th=[13698], 00:16:46.653 | 70.00th=[16057], 80.00th=[19530], 90.00th=[38011], 95.00th=[40109], 00:16:46.653 | 99.00th=[47449], 99.50th=[49546], 99.90th=[50594], 99.95th=[52167], 00:16:46.653 | 99.99th=[57410] 00:16:46.653 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:16:46.653 slat (usec): min=3, max=11032, avg=110.53, stdev=569.59 00:16:46.653 clat (usec): min=503, max=51890, avg=14927.42, stdev=7166.65 00:16:46.653 lat (usec): min=508, max=51912, avg=15037.95, stdev=7193.62 00:16:46.653 clat percentiles (usec): 00:16:46.653 | 1.00th=[ 2409], 5.00th=[ 7177], 10.00th=[ 8356], 20.00th=[10290], 00:16:46.653 | 30.00th=[11207], 40.00th=[12780], 50.00th=[13173], 60.00th=[13566], 00:16:46.653 | 70.00th=[14091], 80.00th=[19006], 90.00th=[22152], 95.00th=[32113], 00:16:46.653 | 99.00th=[38536], 99.50th=[39584], 99.90th=[41681], 99.95th=[41681], 00:16:46.653 | 99.99th=[51643] 00:16:46.653 bw ( KiB/s): min=20456, max=20456, per=35.19%, avg=20456.00, stdev= 0.00, samples=1 00:16:46.653 iops : min= 5114, max= 5114, avg=5114.00, stdev= 0.00, samples=1 00:16:46.653 lat (usec) : 750=0.06%, 1000=0.03% 00:16:46.653 lat (msec) : 2=0.23%, 4=1.36%, 10=9.92%, 20=69.22%, 50=19.03% 00:16:46.653 lat (msec) : 100=0.15% 00:16:46.653 cpu : usr=4.00%, sys=8.30%, ctx=338, majf=0, minf=1 00:16:46.653 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:46.653 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:46.653 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:46.653 issued rwts: total=3713,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:46.653 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:46.653 job3: (groupid=0, jobs=1): err= 0: pid=3902631: Thu Nov 28 04:23:23 2024 00:16:46.653 read: IOPS=4063, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1008msec) 00:16:46.653 slat (usec): min=2, max=11223, avg=95.64, stdev=668.80 00:16:46.653 clat (usec): min=647, max=32527, avg=12699.98, stdev=3747.21 00:16:46.653 lat (usec): min=671, max=32532, avg=12795.61, stdev=3790.33 00:16:46.653 clat percentiles (usec): 00:16:46.653 | 1.00th=[ 2474], 5.00th=[ 8586], 10.00th=[ 9241], 20.00th=[10159], 00:16:46.653 | 30.00th=[10683], 40.00th=[11994], 50.00th=[12518], 60.00th=[12911], 00:16:46.653 | 70.00th=[13173], 80.00th=[14353], 90.00th=[17171], 95.00th=[20317], 00:16:46.653 | 99.00th=[26084], 99.50th=[29754], 99.90th=[32375], 99.95th=[32375], 00:16:46.653 | 99.99th=[32637] 00:16:46.653 write: IOPS=4119, BW=16.1MiB/s (16.9MB/s)(16.2MiB/1008msec); 0 zone resets 00:16:46.653 slat (usec): min=4, max=66470, avg=130.75, stdev=1507.65 00:16:46.653 clat (usec): min=1003, max=146296, avg=16804.60, stdev=18042.82 00:16:46.653 lat (usec): min=1013, max=146307, avg=16935.35, stdev=18167.59 00:16:46.654 clat percentiles (msec): 00:16:46.654 | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], 00:16:46.654 | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 14], 00:16:46.654 | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 23], 95.00th=[ 49], 00:16:46.654 | 99.00th=[ 128], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], 00:16:46.654 | 99.99th=[ 146] 00:16:46.654 bw ( KiB/s): min=15120, max=17648, per=28.19%, avg=16384.00, stdev=1787.57, samples=2 00:16:46.654 iops : min= 3780, max= 4412, avg=4096.00, stdev=446.89, samples=2 00:16:46.654 lat (usec) : 750=0.01% 00:16:46.654 lat (msec) : 2=0.48%, 4=0.58%, 10=20.53%, 20=66.11%, 50=10.73% 00:16:46.654 lat (msec) : 100=0.78%, 250=0.78% 00:16:46.654 cpu : usr=3.67%, sys=5.86%, ctx=358, majf=0, minf=1 00:16:46.654 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:46.654 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:46.654 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:46.654 issued rwts: total=4096,4152,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:46.654 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:46.654 00:16:46.654 Run status group 0 (all jobs): 00:16:46.654 READ: bw=54.1MiB/s (56.7MB/s), 11.9MiB/s-15.9MiB/s (12.5MB/s-16.6MB/s), io=54.5MiB (57.2MB), run=1001-1008msec 00:16:46.654 WRITE: bw=56.8MiB/s (59.5MB/s), 12.4MiB/s-16.1MiB/s (13.0MB/s-16.9MB/s), io=57.2MiB (60.0MB), run=1001-1008msec 00:16:46.654 00:16:46.654 Disk stats (read/write): 00:16:46.654 nvme0n1: ios=2579/2999, merge=0/0, ticks=19342/33786, in_queue=53128, util=90.18% 00:16:46.654 nvme0n2: ios=2504/2560, merge=0/0, ticks=22215/30951, in_queue=53166, util=95.13% 00:16:46.654 nvme0n3: ios=3132/3250, merge=0/0, ticks=21862/21857, in_queue=43719, util=98.02% 00:16:46.654 nvme0n4: ios=3231/3584, merge=0/0, ticks=37600/42651, in_queue=80251, util=96.96% 00:16:46.654 04:23:23 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:46.654 [global] 00:16:46.654 thread=1 00:16:46.654 invalidate=1 00:16:46.654 rw=randwrite 00:16:46.654 time_based=1 00:16:46.654 runtime=1 00:16:46.654 ioengine=libaio 00:16:46.654 direct=1 00:16:46.654 bs=4096 00:16:46.654 iodepth=128 00:16:46.654 norandommap=0 00:16:46.654 numjobs=1 00:16:46.654 00:16:46.654 verify_dump=1 00:16:46.654 verify_backlog=512 00:16:46.654 verify_state_save=0 00:16:46.654 do_verify=1 00:16:46.654 verify=crc32c-intel 00:16:46.654 [job0] 00:16:46.654 filename=/dev/nvme0n1 00:16:46.654 [job1] 00:16:46.654 filename=/dev/nvme0n2 00:16:46.654 [job2] 00:16:46.654 filename=/dev/nvme0n3 00:16:46.654 [job3] 00:16:46.654 filename=/dev/nvme0n4 00:16:46.654 Could not set queue depth (nvme0n1) 00:16:46.654 Could not set queue depth (nvme0n2) 00:16:46.654 Could not set queue depth (nvme0n3) 00:16:46.654 Could not set queue depth (nvme0n4) 00:16:46.913 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:46.913 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:46.913 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:46.913 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:46.913 fio-3.35 00:16:46.913 Starting 4 threads 00:16:48.287 00:16:48.287 job0: (groupid=0, jobs=1): err= 0: pid=3902859: Thu Nov 28 04:23:25 2024 00:16:48.287 read: IOPS=3828, BW=15.0MiB/s (15.7MB/s)(15.0MiB/1003msec) 00:16:48.287 slat (usec): min=2, max=47504, avg=140.61, stdev=1062.59 00:16:48.287 clat (usec): min=457, max=66048, avg=17170.87, stdev=10196.98 00:16:48.287 lat (usec): min=8220, max=66128, avg=17311.47, stdev=10270.48 00:16:48.287 clat percentiles (usec): 00:16:48.287 | 1.00th=[ 8717], 5.00th=[ 9634], 10.00th=[10421], 20.00th=[10683], 00:16:48.287 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11863], 60.00th=[14222], 00:16:48.287 | 70.00th=[18744], 80.00th=[22938], 90.00th=[29230], 95.00th=[42206], 00:16:48.287 | 99.00th=[60031], 99.50th=[60031], 99.90th=[60031], 99.95th=[60031], 00:16:48.287 | 99.99th=[65799] 00:16:48.287 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:16:48.287 slat (usec): min=3, max=8894, avg=102.63, stdev=509.72 00:16:48.288 clat (usec): min=7356, max=66344, avg=14964.33, stdev=7927.22 00:16:48.288 lat (usec): min=8285, max=66356, avg=15066.96, stdev=7949.40 00:16:48.288 clat percentiles (usec): 00:16:48.288 | 1.00th=[ 8848], 5.00th=[ 9503], 10.00th=[ 9765], 20.00th=[10552], 00:16:48.288 | 30.00th=[10945], 40.00th=[11469], 50.00th=[12125], 60.00th=[14484], 00:16:48.288 | 70.00th=[15401], 80.00th=[18744], 90.00th=[20841], 95.00th=[25035], 00:16:48.288 | 99.00th=[60556], 99.50th=[60556], 99.90th=[60556], 99.95th=[66323], 00:16:48.288 | 99.99th=[66323] 00:16:48.288 bw ( KiB/s): min=14400, max=18368, per=24.93%, avg=16384.00, stdev=2805.80, samples=2 00:16:48.288 iops : min= 3600, max= 4592, avg=4096.00, stdev=701.45, samples=2 00:16:48.288 lat (usec) : 500=0.01% 00:16:48.288 lat (msec) : 10=9.38%, 20=72.69%, 50=15.94%, 100=1.98% 00:16:48.288 cpu : usr=4.69%, sys=8.48%, ctx=440, majf=0, minf=1 00:16:48.288 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:48.288 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.288 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.288 issued rwts: total=3840,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.288 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.288 job1: (groupid=0, jobs=1): err= 0: pid=3902860: Thu Nov 28 04:23:25 2024 00:16:48.288 read: IOPS=4027, BW=15.7MiB/s (16.5MB/s)(15.8MiB/1006msec) 00:16:48.288 slat (usec): min=2, max=14211, avg=121.04, stdev=750.05 00:16:48.288 clat (usec): min=3092, max=39999, avg=15210.95, stdev=7202.65 00:16:48.288 lat (usec): min=6019, max=40013, avg=15332.00, stdev=7254.28 00:16:48.288 clat percentiles (usec): 00:16:48.288 | 1.00th=[ 7242], 5.00th=[ 8160], 10.00th=[ 9503], 20.00th=[10159], 00:16:48.288 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11731], 60.00th=[13698], 00:16:48.288 | 70.00th=[17171], 80.00th=[21103], 90.00th=[27132], 95.00th=[29492], 00:16:48.288 | 99.00th=[37487], 99.50th=[38536], 99.90th=[39060], 99.95th=[39060], 00:16:48.288 | 99.99th=[40109] 00:16:48.288 write: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:16:48.288 slat (usec): min=4, max=20653, avg=115.01, stdev=775.17 00:16:48.288 clat (usec): min=5993, max=45278, avg=15830.83, stdev=6534.90 00:16:48.288 lat (usec): min=6342, max=45298, avg=15945.84, stdev=6576.70 00:16:48.288 clat percentiles (usec): 00:16:48.288 | 1.00th=[ 8586], 5.00th=[ 9896], 10.00th=[10814], 20.00th=[11338], 00:16:48.288 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12387], 60.00th=[15008], 00:16:48.288 | 70.00th=[18482], 80.00th=[20579], 90.00th=[22676], 95.00th=[30278], 00:16:48.288 | 99.00th=[40109], 99.50th=[40109], 99.90th=[40109], 99.95th=[40109], 00:16:48.288 | 99.99th=[45351] 00:16:48.288 bw ( KiB/s): min=13000, max=19768, per=24.93%, avg=16384.00, stdev=4785.70, samples=2 00:16:48.288 iops : min= 3250, max= 4942, avg=4096.00, stdev=1196.42, samples=2 00:16:48.288 lat (msec) : 4=0.01%, 10=11.86%, 20=65.46%, 50=22.67% 00:16:48.288 cpu : usr=5.77%, sys=7.16%, ctx=390, majf=0, minf=1 00:16:48.288 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:48.288 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.288 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.288 issued rwts: total=4052,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.288 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.288 job2: (groupid=0, jobs=1): err= 0: pid=3902865: Thu Nov 28 04:23:25 2024 00:16:48.288 read: IOPS=3689, BW=14.4MiB/s (15.1MB/s)(14.5MiB/1006msec) 00:16:48.288 slat (usec): min=2, max=16908, avg=104.72, stdev=753.71 00:16:48.288 clat (usec): min=1475, max=38808, avg=15311.13, stdev=6497.38 00:16:48.288 lat (usec): min=1489, max=39081, avg=15415.86, stdev=6528.59 00:16:48.288 clat percentiles (usec): 00:16:48.288 | 1.00th=[ 1631], 5.00th=[ 5669], 10.00th=[ 8029], 20.00th=[11076], 00:16:48.288 | 30.00th=[11994], 40.00th=[12780], 50.00th=[13304], 60.00th=[14484], 00:16:48.288 | 70.00th=[18220], 80.00th=[20317], 90.00th=[25822], 95.00th=[28443], 00:16:48.288 | 99.00th=[30802], 99.50th=[31065], 99.90th=[31589], 99.95th=[33162], 00:16:48.288 | 99.99th=[39060] 00:16:48.288 write: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:16:48.288 slat (usec): min=3, max=16575, avg=126.42, stdev=712.79 00:16:48.288 clat (usec): min=793, max=40053, avg=17308.64, stdev=7859.79 00:16:48.288 lat (usec): min=800, max=40057, avg=17435.07, stdev=7911.42 00:16:48.288 clat percentiles (usec): 00:16:48.288 | 1.00th=[ 3621], 5.00th=[ 9372], 10.00th=[ 9896], 20.00th=[11076], 00:16:48.288 | 30.00th=[12256], 40.00th=[12649], 50.00th=[13435], 60.00th=[18220], 00:16:48.288 | 70.00th=[20841], 80.00th=[23462], 90.00th=[28967], 95.00th=[33817], 00:16:48.288 | 99.00th=[39584], 99.50th=[39584], 99.90th=[39584], 99.95th=[40109], 00:16:48.288 | 99.99th=[40109] 00:16:48.288 bw ( KiB/s): min=16384, max=16384, per=24.93%, avg=16384.00, stdev= 0.00, samples=2 00:16:48.288 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:16:48.288 lat (usec) : 1000=0.26% 00:16:48.288 lat (msec) : 2=1.22%, 4=0.69%, 10=10.75%, 20=60.49%, 50=26.60% 00:16:48.288 cpu : usr=2.79%, sys=6.27%, ctx=399, majf=0, minf=1 00:16:48.288 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:48.288 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.288 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.288 issued rwts: total=3712,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.288 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.288 job3: (groupid=0, jobs=1): err= 0: pid=3902869: Thu Nov 28 04:23:25 2024 00:16:48.288 read: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec) 00:16:48.288 slat (usec): min=2, max=23042, avg=110.20, stdev=713.12 00:16:48.288 clat (usec): min=6866, max=36240, avg=14453.72, stdev=4353.73 00:16:48.288 lat (usec): min=6894, max=36255, avg=14563.92, stdev=4389.05 00:16:48.288 clat percentiles (usec): 00:16:48.288 | 1.00th=[ 9110], 5.00th=[10159], 10.00th=[11076], 20.00th=[11600], 00:16:48.288 | 30.00th=[12256], 40.00th=[12911], 50.00th=[13173], 60.00th=[13566], 00:16:48.288 | 70.00th=[13960], 80.00th=[15926], 90.00th=[21890], 95.00th=[24773], 00:16:48.288 | 99.00th=[31851], 99.50th=[32113], 99.90th=[32113], 99.95th=[32113], 00:16:48.288 | 99.99th=[36439] 00:16:48.288 write: IOPS=4213, BW=16.5MiB/s (17.3MB/s)(16.6MiB/1006msec); 0 zone resets 00:16:48.288 slat (usec): min=3, max=13992, avg=119.17, stdev=643.35 00:16:48.288 clat (usec): min=1394, max=55213, avg=16004.21, stdev=8652.24 00:16:48.288 lat (usec): min=1400, max=55220, avg=16123.38, stdev=8689.85 00:16:48.288 clat percentiles (usec): 00:16:48.288 | 1.00th=[ 2089], 5.00th=[ 6915], 10.00th=[ 9372], 20.00th=[11863], 00:16:48.288 | 30.00th=[12387], 40.00th=[12780], 50.00th=[13566], 60.00th=[14353], 00:16:48.288 | 70.00th=[16712], 80.00th=[19006], 90.00th=[23462], 95.00th=[39060], 00:16:48.288 | 99.00th=[52691], 99.50th=[54789], 99.90th=[55313], 99.95th=[55313], 00:16:48.288 | 99.99th=[55313] 00:16:48.288 bw ( KiB/s): min=16384, max=16512, per=25.03%, avg=16448.00, stdev=90.51, samples=2 00:16:48.288 iops : min= 4096, max= 4128, avg=4112.00, stdev=22.63, samples=2 00:16:48.288 lat (msec) : 2=0.42%, 4=0.41%, 10=7.03%, 20=77.79%, 50=13.52% 00:16:48.288 lat (msec) : 100=0.83% 00:16:48.288 cpu : usr=3.78%, sys=6.37%, ctx=438, majf=0, minf=1 00:16:48.288 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:48.288 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.288 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.288 issued rwts: total=4096,4239,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.288 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.288 00:16:48.288 Run status group 0 (all jobs): 00:16:48.288 READ: bw=61.0MiB/s (63.9MB/s), 14.4MiB/s-15.9MiB/s (15.1MB/s-16.7MB/s), io=61.3MiB (64.3MB), run=1003-1006msec 00:16:48.288 WRITE: bw=64.2MiB/s (67.3MB/s), 15.9MiB/s-16.5MiB/s (16.7MB/s-17.3MB/s), io=64.6MiB (67.7MB), run=1003-1006msec 00:16:48.288 00:16:48.288 Disk stats (read/write): 00:16:48.288 nvme0n1: ios=3363/3584, merge=0/0, ticks=16823/13882, in_queue=30705, util=86.87% 00:16:48.288 nvme0n2: ios=3604/3623, merge=0/0, ticks=25809/26188, in_queue=51997, util=87.41% 00:16:48.289 nvme0n3: ios=3129/3441, merge=0/0, ticks=27348/28473, in_queue=55821, util=91.05% 00:16:48.289 nvme0n4: ios=3608/3703, merge=0/0, ticks=24345/18445, in_queue=42790, util=96.12% 00:16:48.289 04:23:25 -- target/fio.sh@55 -- # sync 00:16:48.289 04:23:25 -- target/fio.sh@59 -- # fio_pid=3903047 00:16:48.289 04:23:25 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:48.289 04:23:25 -- target/fio.sh@61 -- # sleep 3 00:16:48.289 [global] 00:16:48.289 thread=1 00:16:48.289 invalidate=1 00:16:48.289 rw=read 00:16:48.289 time_based=1 00:16:48.289 runtime=10 00:16:48.289 ioengine=libaio 00:16:48.289 direct=1 00:16:48.289 bs=4096 00:16:48.289 iodepth=1 00:16:48.289 norandommap=1 00:16:48.289 numjobs=1 00:16:48.289 00:16:48.289 [job0] 00:16:48.289 filename=/dev/nvme0n1 00:16:48.289 [job1] 00:16:48.289 filename=/dev/nvme0n2 00:16:48.289 [job2] 00:16:48.289 filename=/dev/nvme0n3 00:16:48.289 [job3] 00:16:48.289 filename=/dev/nvme0n4 00:16:48.289 Could not set queue depth (nvme0n1) 00:16:48.289 Could not set queue depth (nvme0n2) 00:16:48.289 Could not set queue depth (nvme0n3) 00:16:48.289 Could not set queue depth (nvme0n4) 00:16:48.289 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.289 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.289 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.289 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:48.289 fio-3.35 00:16:48.289 Starting 4 threads 00:16:51.571 04:23:28 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:51.571 04:23:28 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:51.571 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=35696640, buflen=4096 00:16:51.571 fio: pid=3903237, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:51.571 04:23:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:51.571 04:23:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:51.571 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=36212736, buflen=4096 00:16:51.571 fio: pid=3903236, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:51.830 04:23:29 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:51.830 04:23:29 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:51.830 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=1007616, buflen=4096 00:16:51.830 fio: pid=3903234, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:52.088 04:23:29 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:52.088 04:23:29 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:52.088 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=376832, buflen=4096 00:16:52.088 fio: pid=3903235, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:52.347 00:16:52.347 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3903234: Thu Nov 28 04:23:29 2024 00:16:52.347 read: IOPS=70, BW=282KiB/s (289kB/s)(984KiB/3485msec) 00:16:52.347 slat (usec): min=5, max=17909, avg=105.32, stdev=1180.01 00:16:52.347 clat (usec): min=214, max=41112, avg=14011.82, stdev=19279.35 00:16:52.347 lat (usec): min=229, max=58969, avg=14117.50, stdev=19451.17 00:16:52.347 clat percentiles (usec): 00:16:52.347 | 1.00th=[ 235], 5.00th=[ 245], 10.00th=[ 249], 20.00th=[ 258], 00:16:52.347 | 30.00th=[ 265], 40.00th=[ 277], 50.00th=[ 289], 60.00th=[ 338], 00:16:52.347 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:52.347 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:52.347 | 99.99th=[41157] 00:16:52.347 bw ( KiB/s): min= 96, max= 1384, per=1.63%, avg=312.00, stdev=525.18, samples=6 00:16:52.347 iops : min= 24, max= 346, avg=78.00, stdev=131.30, samples=6 00:16:52.347 lat (usec) : 250=11.34%, 500=53.44%, 750=1.21% 00:16:52.347 lat (msec) : 50=33.60% 00:16:52.347 cpu : usr=0.09%, sys=0.09%, ctx=250, majf=0, minf=2 00:16:52.347 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 complete : 0=0.4%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 issued rwts: total=247,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.347 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.347 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3903235: Thu Nov 28 04:23:29 2024 00:16:52.347 read: IOPS=24, BW=98.2KiB/s (101kB/s)(368KiB/3746msec) 00:16:52.347 slat (usec): min=12, max=14835, avg=359.45, stdev=1960.48 00:16:52.347 clat (usec): min=330, max=41116, avg=40088.39, stdev=5957.98 00:16:52.347 lat (usec): min=348, max=55917, avg=40451.39, stdev=6329.52 00:16:52.347 clat percentiles (usec): 00:16:52.347 | 1.00th=[ 330], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:52.347 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:52.347 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:52.347 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:52.347 | 99.99th=[41157] 00:16:52.347 bw ( KiB/s): min= 87, max= 104, per=0.51%, avg=98.14, stdev= 6.34, samples=7 00:16:52.347 iops : min= 21, max= 26, avg=24.43, stdev= 1.81, samples=7 00:16:52.347 lat (usec) : 500=2.15% 00:16:52.347 lat (msec) : 50=96.77% 00:16:52.347 cpu : usr=0.11%, sys=0.00%, ctx=96, majf=0, minf=1 00:16:52.347 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 issued rwts: total=93,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.347 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.347 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3903236: Thu Nov 28 04:23:29 2024 00:16:52.347 read: IOPS=2763, BW=10.8MiB/s (11.3MB/s)(34.5MiB/3200msec) 00:16:52.347 slat (nsec): min=4752, max=68191, avg=17359.40, stdev=9856.22 00:16:52.347 clat (usec): min=201, max=41002, avg=338.06, stdev=1063.47 00:16:52.347 lat (usec): min=215, max=41018, avg=355.42, stdev=1063.49 00:16:52.347 clat percentiles (usec): 00:16:52.347 | 1.00th=[ 215], 5.00th=[ 227], 10.00th=[ 239], 20.00th=[ 265], 00:16:52.347 | 30.00th=[ 285], 40.00th=[ 293], 50.00th=[ 306], 60.00th=[ 314], 00:16:52.347 | 70.00th=[ 326], 80.00th=[ 351], 90.00th=[ 383], 95.00th=[ 396], 00:16:52.347 | 99.00th=[ 457], 99.50th=[ 502], 99.90th=[ 3458], 99.95th=[41157], 00:16:52.347 | 99.99th=[41157] 00:16:52.347 bw ( KiB/s): min=10832, max=12432, per=61.66%, avg=11781.33, stdev=611.67, samples=6 00:16:52.347 iops : min= 2708, max= 3108, avg=2945.33, stdev=152.92, samples=6 00:16:52.347 lat (usec) : 250=15.72%, 500=83.74%, 750=0.37%, 1000=0.05% 00:16:52.347 lat (msec) : 4=0.03%, 10=0.01%, 50=0.07% 00:16:52.347 cpu : usr=2.25%, sys=5.13%, ctx=8843, majf=0, minf=2 00:16:52.347 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 issued rwts: total=8842,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.347 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.347 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3903237: Thu Nov 28 04:23:29 2024 00:16:52.347 read: IOPS=2997, BW=11.7MiB/s (12.3MB/s)(34.0MiB/2908msec) 00:16:52.347 slat (nsec): min=6288, max=60053, avg=13475.85, stdev=6221.22 00:16:52.347 clat (usec): min=234, max=804, avg=314.30, stdev=34.79 00:16:52.347 lat (usec): min=242, max=815, avg=327.77, stdev=37.50 00:16:52.347 clat percentiles (usec): 00:16:52.347 | 1.00th=[ 258], 5.00th=[ 277], 10.00th=[ 281], 20.00th=[ 289], 00:16:52.347 | 30.00th=[ 293], 40.00th=[ 302], 50.00th=[ 310], 60.00th=[ 318], 00:16:52.347 | 70.00th=[ 326], 80.00th=[ 334], 90.00th=[ 359], 95.00th=[ 371], 00:16:52.347 | 99.00th=[ 433], 99.50th=[ 482], 99.90th=[ 594], 99.95th=[ 635], 00:16:52.347 | 99.99th=[ 807] 00:16:52.347 bw ( KiB/s): min=11440, max=12656, per=62.99%, avg=12036.80, stdev=493.46, samples=5 00:16:52.347 iops : min= 2860, max= 3164, avg=3009.20, stdev=123.37, samples=5 00:16:52.347 lat (usec) : 250=0.31%, 500=99.30%, 750=0.37%, 1000=0.01% 00:16:52.347 cpu : usr=2.41%, sys=5.88%, ctx=8717, majf=0, minf=2 00:16:52.347 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.347 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.347 issued rwts: total=8716,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.347 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.347 00:16:52.347 Run status group 0 (all jobs): 00:16:52.347 READ: bw=18.7MiB/s (19.6MB/s), 98.2KiB/s-11.7MiB/s (101kB/s-12.3MB/s), io=69.9MiB (73.3MB), run=2908-3746msec 00:16:52.347 00:16:52.347 Disk stats (read/write): 00:16:52.347 nvme0n1: ios=283/0, merge=0/0, ticks=4366/0, in_queue=4366, util=98.54% 00:16:52.347 nvme0n2: ios=88/0, merge=0/0, ticks=3526/0, in_queue=3526, util=95.66% 00:16:52.347 nvme0n3: ios=8880/0, merge=0/0, ticks=3687/0, in_queue=3687, util=99.09% 00:16:52.347 nvme0n4: ios=8643/0, merge=0/0, ticks=2793/0, in_queue=2793, util=98.98% 00:16:52.347 04:23:29 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:52.347 04:23:29 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:52.606 04:23:29 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:52.606 04:23:29 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:53.177 04:23:30 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:53.177 04:23:30 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:53.177 04:23:30 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:53.177 04:23:30 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:53.439 04:23:30 -- target/fio.sh@69 -- # fio_status=0 00:16:53.439 04:23:30 -- target/fio.sh@70 -- # wait 3903047 00:16:53.439 04:23:30 -- target/fio.sh@70 -- # fio_status=4 00:16:53.439 04:23:30 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:53.697 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:53.697 04:23:30 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:53.697 04:23:30 -- common/autotest_common.sh@1208 -- # local i=0 00:16:53.697 04:23:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:53.697 04:23:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:53.697 04:23:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:53.697 04:23:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:53.697 04:23:30 -- common/autotest_common.sh@1220 -- # return 0 00:16:53.697 04:23:30 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:53.697 04:23:30 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:53.697 nvmf hotplug test: fio failed as expected 00:16:53.697 04:23:30 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:53.953 04:23:31 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:53.953 04:23:31 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:53.953 04:23:31 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:53.953 04:23:31 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:53.953 04:23:31 -- target/fio.sh@91 -- # nvmftestfini 00:16:53.953 04:23:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:53.953 04:23:31 -- nvmf/common.sh@116 -- # sync 00:16:53.953 04:23:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:53.953 04:23:31 -- nvmf/common.sh@119 -- # set +e 00:16:53.953 04:23:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:53.953 04:23:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:53.953 rmmod nvme_tcp 00:16:53.953 rmmod nvme_fabrics 00:16:53.953 rmmod nvme_keyring 00:16:53.953 04:23:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:53.953 04:23:31 -- nvmf/common.sh@123 -- # set -e 00:16:53.953 04:23:31 -- nvmf/common.sh@124 -- # return 0 00:16:53.953 04:23:31 -- nvmf/common.sh@477 -- # '[' -n 3900924 ']' 00:16:53.953 04:23:31 -- nvmf/common.sh@478 -- # killprocess 3900924 00:16:53.953 04:23:31 -- common/autotest_common.sh@936 -- # '[' -z 3900924 ']' 00:16:53.953 04:23:31 -- common/autotest_common.sh@940 -- # kill -0 3900924 00:16:53.953 04:23:31 -- common/autotest_common.sh@941 -- # uname 00:16:53.953 04:23:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:53.953 04:23:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3900924 00:16:53.953 04:23:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:53.953 04:23:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:53.953 04:23:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3900924' 00:16:53.953 killing process with pid 3900924 00:16:53.953 04:23:31 -- common/autotest_common.sh@955 -- # kill 3900924 00:16:53.953 04:23:31 -- common/autotest_common.sh@960 -- # wait 3900924 00:16:54.518 04:23:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:54.518 04:23:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:54.518 04:23:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:54.518 04:23:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:54.518 04:23:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:54.518 04:23:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:54.518 04:23:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:54.518 04:23:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:56.419 04:23:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:56.419 00:16:56.419 real 0m24.457s 00:16:56.419 user 1m26.035s 00:16:56.419 sys 0m6.833s 00:16:56.419 04:23:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:56.419 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:16:56.419 ************************************ 00:16:56.419 END TEST nvmf_fio_target 00:16:56.419 ************************************ 00:16:56.419 04:23:33 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:56.419 04:23:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:56.419 04:23:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:56.419 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:16:56.419 ************************************ 00:16:56.419 START TEST nvmf_bdevio 00:16:56.419 ************************************ 00:16:56.419 04:23:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:56.419 * Looking for test storage... 00:16:56.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:56.419 04:23:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:56.419 04:23:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:56.419 04:23:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:56.419 04:23:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:56.419 04:23:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:56.419 04:23:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:56.419 04:23:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:56.419 04:23:33 -- scripts/common.sh@335 -- # IFS=.-: 00:16:56.419 04:23:33 -- scripts/common.sh@335 -- # read -ra ver1 00:16:56.419 04:23:33 -- scripts/common.sh@336 -- # IFS=.-: 00:16:56.419 04:23:33 -- scripts/common.sh@336 -- # read -ra ver2 00:16:56.419 04:23:33 -- scripts/common.sh@337 -- # local 'op=<' 00:16:56.419 04:23:33 -- scripts/common.sh@339 -- # ver1_l=2 00:16:56.419 04:23:33 -- scripts/common.sh@340 -- # ver2_l=1 00:16:56.419 04:23:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:56.678 04:23:33 -- scripts/common.sh@343 -- # case "$op" in 00:16:56.678 04:23:33 -- scripts/common.sh@344 -- # : 1 00:16:56.678 04:23:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:56.678 04:23:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:56.678 04:23:33 -- scripts/common.sh@364 -- # decimal 1 00:16:56.678 04:23:33 -- scripts/common.sh@352 -- # local d=1 00:16:56.678 04:23:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:56.678 04:23:33 -- scripts/common.sh@354 -- # echo 1 00:16:56.678 04:23:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:56.678 04:23:33 -- scripts/common.sh@365 -- # decimal 2 00:16:56.678 04:23:33 -- scripts/common.sh@352 -- # local d=2 00:16:56.678 04:23:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:56.678 04:23:33 -- scripts/common.sh@354 -- # echo 2 00:16:56.678 04:23:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:56.678 04:23:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:56.678 04:23:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:56.678 04:23:33 -- scripts/common.sh@367 -- # return 0 00:16:56.678 04:23:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:56.678 04:23:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:56.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.678 --rc genhtml_branch_coverage=1 00:16:56.678 --rc genhtml_function_coverage=1 00:16:56.678 --rc genhtml_legend=1 00:16:56.678 --rc geninfo_all_blocks=1 00:16:56.678 --rc geninfo_unexecuted_blocks=1 00:16:56.678 00:16:56.678 ' 00:16:56.678 04:23:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:56.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.678 --rc genhtml_branch_coverage=1 00:16:56.678 --rc genhtml_function_coverage=1 00:16:56.678 --rc genhtml_legend=1 00:16:56.678 --rc geninfo_all_blocks=1 00:16:56.678 --rc geninfo_unexecuted_blocks=1 00:16:56.678 00:16:56.678 ' 00:16:56.678 04:23:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:56.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.678 --rc genhtml_branch_coverage=1 00:16:56.678 --rc genhtml_function_coverage=1 00:16:56.678 --rc genhtml_legend=1 00:16:56.678 --rc geninfo_all_blocks=1 00:16:56.678 --rc geninfo_unexecuted_blocks=1 00:16:56.678 00:16:56.678 ' 00:16:56.678 04:23:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:56.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:56.678 --rc genhtml_branch_coverage=1 00:16:56.678 --rc genhtml_function_coverage=1 00:16:56.678 --rc genhtml_legend=1 00:16:56.678 --rc geninfo_all_blocks=1 00:16:56.678 --rc geninfo_unexecuted_blocks=1 00:16:56.678 00:16:56.678 ' 00:16:56.678 04:23:33 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:56.678 04:23:33 -- nvmf/common.sh@7 -- # uname -s 00:16:56.678 04:23:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:56.678 04:23:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:56.678 04:23:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:56.678 04:23:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:56.678 04:23:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:56.678 04:23:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:56.678 04:23:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:56.678 04:23:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:56.678 04:23:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:56.678 04:23:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:56.678 04:23:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:56.678 04:23:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:56.678 04:23:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:56.678 04:23:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:56.678 04:23:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:56.678 04:23:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:56.678 04:23:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:56.678 04:23:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:56.678 04:23:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:56.678 04:23:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.678 04:23:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.678 04:23:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.678 04:23:33 -- paths/export.sh@5 -- # export PATH 00:16:56.679 04:23:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:56.679 04:23:33 -- nvmf/common.sh@46 -- # : 0 00:16:56.679 04:23:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:56.679 04:23:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:56.679 04:23:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:56.679 04:23:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:56.679 04:23:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:56.679 04:23:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:56.679 04:23:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:56.679 04:23:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:56.679 04:23:33 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:56.679 04:23:33 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:56.679 04:23:33 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:56.679 04:23:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:56.679 04:23:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:56.679 04:23:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:56.679 04:23:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:56.679 04:23:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:56.679 04:23:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:56.679 04:23:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:56.679 04:23:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:56.679 04:23:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:56.679 04:23:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:56.679 04:23:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:56.679 04:23:33 -- common/autotest_common.sh@10 -- # set +x 00:16:58.579 04:23:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:58.580 04:23:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:58.580 04:23:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:58.580 04:23:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:58.580 04:23:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:58.580 04:23:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:58.580 04:23:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:58.580 04:23:35 -- nvmf/common.sh@294 -- # net_devs=() 00:16:58.580 04:23:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:58.580 04:23:35 -- nvmf/common.sh@295 -- # e810=() 00:16:58.580 04:23:35 -- nvmf/common.sh@295 -- # local -ga e810 00:16:58.580 04:23:35 -- nvmf/common.sh@296 -- # x722=() 00:16:58.580 04:23:35 -- nvmf/common.sh@296 -- # local -ga x722 00:16:58.580 04:23:35 -- nvmf/common.sh@297 -- # mlx=() 00:16:58.580 04:23:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:58.580 04:23:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:58.580 04:23:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:58.580 04:23:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:58.580 04:23:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:58.580 04:23:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:58.580 04:23:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:58.580 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:58.580 04:23:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:58.580 04:23:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:58.580 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:58.580 04:23:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:58.580 04:23:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:58.580 04:23:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:58.580 04:23:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:58.580 04:23:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:58.580 04:23:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:58.580 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:58.580 04:23:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:58.580 04:23:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:58.580 04:23:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:58.580 04:23:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:58.580 04:23:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:58.580 04:23:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:58.580 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:58.580 04:23:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:58.580 04:23:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:58.580 04:23:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:58.580 04:23:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:58.580 04:23:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:58.580 04:23:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:58.580 04:23:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:58.580 04:23:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:58.580 04:23:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:58.580 04:23:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:58.580 04:23:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:58.580 04:23:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:58.580 04:23:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:58.580 04:23:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:58.580 04:23:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:58.580 04:23:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:58.580 04:23:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:58.580 04:23:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:58.580 04:23:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:58.580 04:23:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:58.580 04:23:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:58.580 04:23:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:58.839 04:23:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:58.839 04:23:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:58.839 04:23:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:58.839 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:58.839 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:16:58.839 00:16:58.839 --- 10.0.0.2 ping statistics --- 00:16:58.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:58.839 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:16:58.839 04:23:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:58.839 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:58.839 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:16:58.839 00:16:58.839 --- 10.0.0.1 ping statistics --- 00:16:58.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:58.839 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:16:58.839 04:23:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:58.839 04:23:35 -- nvmf/common.sh@410 -- # return 0 00:16:58.839 04:23:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:58.839 04:23:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:58.839 04:23:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:58.839 04:23:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:58.839 04:23:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:58.839 04:23:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:58.839 04:23:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:58.839 04:23:35 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:58.839 04:23:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:58.839 04:23:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:58.839 04:23:35 -- common/autotest_common.sh@10 -- # set +x 00:16:58.839 04:23:35 -- nvmf/common.sh@469 -- # nvmfpid=3905891 00:16:58.839 04:23:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:58.839 04:23:35 -- nvmf/common.sh@470 -- # waitforlisten 3905891 00:16:58.839 04:23:35 -- common/autotest_common.sh@829 -- # '[' -z 3905891 ']' 00:16:58.839 04:23:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:58.839 04:23:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:58.839 04:23:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:58.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:58.839 04:23:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:58.839 04:23:35 -- common/autotest_common.sh@10 -- # set +x 00:16:58.839 [2024-11-28 04:23:35.986845] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:58.839 [2024-11-28 04:23:35.986926] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:58.839 EAL: No free 2048 kB hugepages reported on node 1 00:16:58.839 [2024-11-28 04:23:36.055471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:59.097 [2024-11-28 04:23:36.182196] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:59.097 [2024-11-28 04:23:36.182366] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:59.097 [2024-11-28 04:23:36.182386] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:59.097 [2024-11-28 04:23:36.182400] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:59.097 [2024-11-28 04:23:36.182681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:59.097 [2024-11-28 04:23:36.182750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:59.097 [2024-11-28 04:23:36.182816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:59.097 [2024-11-28 04:23:36.182819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:00.031 04:23:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:00.031 04:23:37 -- common/autotest_common.sh@862 -- # return 0 00:17:00.031 04:23:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:00.031 04:23:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:00.031 04:23:37 -- common/autotest_common.sh@10 -- # set +x 00:17:00.031 04:23:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:00.031 04:23:37 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:00.031 04:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.031 04:23:37 -- common/autotest_common.sh@10 -- # set +x 00:17:00.031 [2024-11-28 04:23:37.036170] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:00.031 04:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.031 04:23:37 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:00.031 04:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.031 04:23:37 -- common/autotest_common.sh@10 -- # set +x 00:17:00.031 Malloc0 00:17:00.031 04:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.031 04:23:37 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:00.031 04:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.031 04:23:37 -- common/autotest_common.sh@10 -- # set +x 00:17:00.031 04:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.031 04:23:37 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:00.031 04:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.031 04:23:37 -- common/autotest_common.sh@10 -- # set +x 00:17:00.031 04:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.031 04:23:37 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:00.031 04:23:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.031 04:23:37 -- common/autotest_common.sh@10 -- # set +x 00:17:00.031 [2024-11-28 04:23:37.089142] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:00.031 04:23:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.031 04:23:37 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:00.031 04:23:37 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:00.031 04:23:37 -- nvmf/common.sh@520 -- # config=() 00:17:00.031 04:23:37 -- nvmf/common.sh@520 -- # local subsystem config 00:17:00.031 04:23:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:00.031 04:23:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:00.031 { 00:17:00.031 "params": { 00:17:00.031 "name": "Nvme$subsystem", 00:17:00.031 "trtype": "$TEST_TRANSPORT", 00:17:00.031 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:00.031 "adrfam": "ipv4", 00:17:00.031 "trsvcid": "$NVMF_PORT", 00:17:00.031 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:00.031 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:00.031 "hdgst": ${hdgst:-false}, 00:17:00.031 "ddgst": ${ddgst:-false} 00:17:00.031 }, 00:17:00.031 "method": "bdev_nvme_attach_controller" 00:17:00.031 } 00:17:00.031 EOF 00:17:00.031 )") 00:17:00.031 04:23:37 -- nvmf/common.sh@542 -- # cat 00:17:00.031 04:23:37 -- nvmf/common.sh@544 -- # jq . 00:17:00.031 04:23:37 -- nvmf/common.sh@545 -- # IFS=, 00:17:00.031 04:23:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:00.031 "params": { 00:17:00.031 "name": "Nvme1", 00:17:00.031 "trtype": "tcp", 00:17:00.031 "traddr": "10.0.0.2", 00:17:00.031 "adrfam": "ipv4", 00:17:00.031 "trsvcid": "4420", 00:17:00.031 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:00.031 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:00.031 "hdgst": false, 00:17:00.031 "ddgst": false 00:17:00.031 }, 00:17:00.031 "method": "bdev_nvme_attach_controller" 00:17:00.031 }' 00:17:00.031 [2024-11-28 04:23:37.131017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.031 [2024-11-28 04:23:37.131090] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3906053 ] 00:17:00.031 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.031 [2024-11-28 04:23:37.192308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:00.031 [2024-11-28 04:23:37.305729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:00.031 [2024-11-28 04:23:37.305772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:00.031 [2024-11-28 04:23:37.305775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:00.290 [2024-11-28 04:23:37.481370] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:00.290 [2024-11-28 04:23:37.481429] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:00.290 I/O targets: 00:17:00.290 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:00.290 00:17:00.290 00:17:00.290 CUnit - A unit testing framework for C - Version 2.1-3 00:17:00.290 http://cunit.sourceforge.net/ 00:17:00.290 00:17:00.290 00:17:00.290 Suite: bdevio tests on: Nvme1n1 00:17:00.290 Test: blockdev write read block ...passed 00:17:00.290 Test: blockdev write zeroes read block ...passed 00:17:00.290 Test: blockdev write zeroes read no split ...passed 00:17:00.548 Test: blockdev write zeroes read split ...passed 00:17:00.548 Test: blockdev write zeroes read split partial ...passed 00:17:00.548 Test: blockdev reset ...[2024-11-28 04:23:37.640969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:00.548 [2024-11-28 04:23:37.641077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1842f20 (9): Bad file descriptor 00:17:00.548 [2024-11-28 04:23:37.791267] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:00.548 passed 00:17:00.548 Test: blockdev write read 8 blocks ...passed 00:17:00.548 Test: blockdev write read size > 128k ...passed 00:17:00.548 Test: blockdev write read invalid size ...passed 00:17:00.806 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:00.806 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:00.806 Test: blockdev write read max offset ...passed 00:17:00.806 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:00.806 Test: blockdev writev readv 8 blocks ...passed 00:17:00.806 Test: blockdev writev readv 30 x 1block ...passed 00:17:00.806 Test: blockdev writev readv block ...passed 00:17:00.806 Test: blockdev writev readv size > 128k ...passed 00:17:00.806 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:00.806 Test: blockdev comparev and writev ...[2024-11-28 04:23:38.005974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.006011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.006036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.006053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.006363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.006388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.006418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.006436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.006766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.006791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.006812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.006828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.007134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.007158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.007179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:00.806 [2024-11-28 04:23:38.007195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:00.806 passed 00:17:00.806 Test: blockdev nvme passthru rw ...passed 00:17:00.806 Test: blockdev nvme passthru vendor specific ...[2024-11-28 04:23:38.089808] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:00.806 [2024-11-28 04:23:38.089836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.090001] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:00.806 [2024-11-28 04:23:38.090025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.090177] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:00.806 [2024-11-28 04:23:38.090201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:00.806 [2024-11-28 04:23:38.090352] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:00.806 [2024-11-28 04:23:38.090375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:00.806 passed 00:17:00.806 Test: blockdev nvme admin passthru ...passed 00:17:01.064 Test: blockdev copy ...passed 00:17:01.064 00:17:01.064 Run Summary: Type Total Ran Passed Failed Inactive 00:17:01.064 suites 1 1 n/a 0 0 00:17:01.064 tests 23 23 23 0 0 00:17:01.064 asserts 152 152 152 0 n/a 00:17:01.064 00:17:01.064 Elapsed time = 1.323 seconds 00:17:01.064 04:23:38 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:01.064 04:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.064 04:23:38 -- common/autotest_common.sh@10 -- # set +x 00:17:01.322 04:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.322 04:23:38 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:01.322 04:23:38 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:01.322 04:23:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:01.322 04:23:38 -- nvmf/common.sh@116 -- # sync 00:17:01.322 04:23:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:01.322 04:23:38 -- nvmf/common.sh@119 -- # set +e 00:17:01.322 04:23:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:01.322 04:23:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:01.322 rmmod nvme_tcp 00:17:01.322 rmmod nvme_fabrics 00:17:01.322 rmmod nvme_keyring 00:17:01.322 04:23:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:01.322 04:23:38 -- nvmf/common.sh@123 -- # set -e 00:17:01.322 04:23:38 -- nvmf/common.sh@124 -- # return 0 00:17:01.322 04:23:38 -- nvmf/common.sh@477 -- # '[' -n 3905891 ']' 00:17:01.322 04:23:38 -- nvmf/common.sh@478 -- # killprocess 3905891 00:17:01.322 04:23:38 -- common/autotest_common.sh@936 -- # '[' -z 3905891 ']' 00:17:01.322 04:23:38 -- common/autotest_common.sh@940 -- # kill -0 3905891 00:17:01.322 04:23:38 -- common/autotest_common.sh@941 -- # uname 00:17:01.322 04:23:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:01.322 04:23:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3905891 00:17:01.322 04:23:38 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:01.322 04:23:38 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:01.322 04:23:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3905891' 00:17:01.322 killing process with pid 3905891 00:17:01.322 04:23:38 -- common/autotest_common.sh@955 -- # kill 3905891 00:17:01.322 04:23:38 -- common/autotest_common.sh@960 -- # wait 3905891 00:17:01.581 04:23:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:01.581 04:23:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:01.581 04:23:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:01.581 04:23:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:01.581 04:23:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:01.581 04:23:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:01.581 04:23:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:01.581 04:23:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.116 04:23:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:04.116 00:17:04.116 real 0m7.215s 00:17:04.116 user 0m13.404s 00:17:04.116 sys 0m2.190s 00:17:04.116 04:23:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:04.116 04:23:40 -- common/autotest_common.sh@10 -- # set +x 00:17:04.116 ************************************ 00:17:04.116 END TEST nvmf_bdevio 00:17:04.116 ************************************ 00:17:04.116 04:23:40 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:04.116 04:23:40 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:04.116 04:23:40 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:04.116 04:23:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:04.116 04:23:40 -- common/autotest_common.sh@10 -- # set +x 00:17:04.116 ************************************ 00:17:04.116 START TEST nvmf_bdevio_no_huge 00:17:04.116 ************************************ 00:17:04.116 04:23:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:04.116 * Looking for test storage... 00:17:04.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:04.116 04:23:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:04.116 04:23:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:04.116 04:23:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:04.116 04:23:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:04.116 04:23:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:04.116 04:23:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:04.116 04:23:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:04.116 04:23:40 -- scripts/common.sh@335 -- # IFS=.-: 00:17:04.116 04:23:40 -- scripts/common.sh@335 -- # read -ra ver1 00:17:04.116 04:23:40 -- scripts/common.sh@336 -- # IFS=.-: 00:17:04.116 04:23:40 -- scripts/common.sh@336 -- # read -ra ver2 00:17:04.116 04:23:40 -- scripts/common.sh@337 -- # local 'op=<' 00:17:04.116 04:23:40 -- scripts/common.sh@339 -- # ver1_l=2 00:17:04.116 04:23:40 -- scripts/common.sh@340 -- # ver2_l=1 00:17:04.116 04:23:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:04.116 04:23:40 -- scripts/common.sh@343 -- # case "$op" in 00:17:04.116 04:23:40 -- scripts/common.sh@344 -- # : 1 00:17:04.116 04:23:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:04.116 04:23:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:04.116 04:23:40 -- scripts/common.sh@364 -- # decimal 1 00:17:04.116 04:23:40 -- scripts/common.sh@352 -- # local d=1 00:17:04.116 04:23:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:04.116 04:23:40 -- scripts/common.sh@354 -- # echo 1 00:17:04.116 04:23:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:04.116 04:23:40 -- scripts/common.sh@365 -- # decimal 2 00:17:04.116 04:23:40 -- scripts/common.sh@352 -- # local d=2 00:17:04.116 04:23:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:04.116 04:23:40 -- scripts/common.sh@354 -- # echo 2 00:17:04.116 04:23:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:04.116 04:23:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:04.116 04:23:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:04.116 04:23:40 -- scripts/common.sh@367 -- # return 0 00:17:04.116 04:23:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:04.116 04:23:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:04.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.116 --rc genhtml_branch_coverage=1 00:17:04.116 --rc genhtml_function_coverage=1 00:17:04.116 --rc genhtml_legend=1 00:17:04.116 --rc geninfo_all_blocks=1 00:17:04.116 --rc geninfo_unexecuted_blocks=1 00:17:04.116 00:17:04.116 ' 00:17:04.116 04:23:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:04.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.116 --rc genhtml_branch_coverage=1 00:17:04.116 --rc genhtml_function_coverage=1 00:17:04.116 --rc genhtml_legend=1 00:17:04.116 --rc geninfo_all_blocks=1 00:17:04.116 --rc geninfo_unexecuted_blocks=1 00:17:04.116 00:17:04.116 ' 00:17:04.116 04:23:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:04.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.116 --rc genhtml_branch_coverage=1 00:17:04.116 --rc genhtml_function_coverage=1 00:17:04.116 --rc genhtml_legend=1 00:17:04.116 --rc geninfo_all_blocks=1 00:17:04.117 --rc geninfo_unexecuted_blocks=1 00:17:04.117 00:17:04.117 ' 00:17:04.117 04:23:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:04.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:04.117 --rc genhtml_branch_coverage=1 00:17:04.117 --rc genhtml_function_coverage=1 00:17:04.117 --rc genhtml_legend=1 00:17:04.117 --rc geninfo_all_blocks=1 00:17:04.117 --rc geninfo_unexecuted_blocks=1 00:17:04.117 00:17:04.117 ' 00:17:04.117 04:23:40 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:04.117 04:23:40 -- nvmf/common.sh@7 -- # uname -s 00:17:04.117 04:23:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:04.117 04:23:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:04.117 04:23:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:04.117 04:23:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:04.117 04:23:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:04.117 04:23:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:04.117 04:23:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:04.117 04:23:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:04.117 04:23:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:04.117 04:23:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:04.117 04:23:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.117 04:23:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:04.117 04:23:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:04.117 04:23:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:04.117 04:23:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:04.117 04:23:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:04.117 04:23:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:04.117 04:23:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:04.117 04:23:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:04.117 04:23:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.117 04:23:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.117 04:23:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.117 04:23:40 -- paths/export.sh@5 -- # export PATH 00:17:04.117 04:23:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:04.117 04:23:40 -- nvmf/common.sh@46 -- # : 0 00:17:04.117 04:23:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:04.117 04:23:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:04.117 04:23:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:04.117 04:23:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:04.117 04:23:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:04.117 04:23:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:04.117 04:23:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:04.117 04:23:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:04.117 04:23:40 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:04.117 04:23:40 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:04.117 04:23:40 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:04.117 04:23:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:04.117 04:23:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:04.117 04:23:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:04.117 04:23:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:04.117 04:23:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:04.117 04:23:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:04.117 04:23:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:04.117 04:23:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:04.117 04:23:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:04.117 04:23:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:04.117 04:23:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:04.117 04:23:41 -- common/autotest_common.sh@10 -- # set +x 00:17:06.018 04:23:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:06.018 04:23:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:06.018 04:23:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:06.018 04:23:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:06.018 04:23:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:06.018 04:23:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:06.018 04:23:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:06.018 04:23:43 -- nvmf/common.sh@294 -- # net_devs=() 00:17:06.018 04:23:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:06.018 04:23:43 -- nvmf/common.sh@295 -- # e810=() 00:17:06.018 04:23:43 -- nvmf/common.sh@295 -- # local -ga e810 00:17:06.018 04:23:43 -- nvmf/common.sh@296 -- # x722=() 00:17:06.018 04:23:43 -- nvmf/common.sh@296 -- # local -ga x722 00:17:06.018 04:23:43 -- nvmf/common.sh@297 -- # mlx=() 00:17:06.018 04:23:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:06.018 04:23:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:06.018 04:23:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:06.018 04:23:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:06.018 04:23:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:06.018 04:23:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.018 04:23:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:06.018 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:06.018 04:23:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:06.018 04:23:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:06.018 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:06.018 04:23:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:06.018 04:23:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.018 04:23:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.018 04:23:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.018 04:23:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.018 04:23:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:06.018 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:06.018 04:23:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.018 04:23:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:06.018 04:23:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:06.018 04:23:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:06.018 04:23:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:06.018 04:23:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:06.018 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:06.018 04:23:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:06.018 04:23:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:06.018 04:23:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:06.018 04:23:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:06.018 04:23:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:06.018 04:23:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:06.018 04:23:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:06.018 04:23:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:06.018 04:23:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:06.018 04:23:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:06.018 04:23:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:06.018 04:23:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:06.018 04:23:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:06.018 04:23:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:06.018 04:23:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:06.018 04:23:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:06.018 04:23:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:06.018 04:23:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:06.018 04:23:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:06.018 04:23:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:06.018 04:23:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:06.018 04:23:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:06.018 04:23:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:06.018 04:23:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:06.018 04:23:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:06.018 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:06.019 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.406 ms 00:17:06.019 00:17:06.019 --- 10.0.0.2 ping statistics --- 00:17:06.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.019 rtt min/avg/max/mdev = 0.406/0.406/0.406/0.000 ms 00:17:06.019 04:23:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:06.019 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:06.019 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:17:06.019 00:17:06.019 --- 10.0.0.1 ping statistics --- 00:17:06.019 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:06.019 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:17:06.019 04:23:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:06.019 04:23:43 -- nvmf/common.sh@410 -- # return 0 00:17:06.019 04:23:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:06.019 04:23:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:06.019 04:23:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:06.019 04:23:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:06.019 04:23:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:06.019 04:23:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:06.019 04:23:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:06.019 04:23:43 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:06.019 04:23:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:06.019 04:23:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:06.019 04:23:43 -- common/autotest_common.sh@10 -- # set +x 00:17:06.019 04:23:43 -- nvmf/common.sh@469 -- # nvmfpid=3908146 00:17:06.019 04:23:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:06.019 04:23:43 -- nvmf/common.sh@470 -- # waitforlisten 3908146 00:17:06.019 04:23:43 -- common/autotest_common.sh@829 -- # '[' -z 3908146 ']' 00:17:06.019 04:23:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:06.019 04:23:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:06.019 04:23:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:06.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:06.019 04:23:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:06.019 04:23:43 -- common/autotest_common.sh@10 -- # set +x 00:17:06.019 [2024-11-28 04:23:43.303653] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:06.019 [2024-11-28 04:23:43.303751] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:06.277 [2024-11-28 04:23:43.381430] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:06.277 [2024-11-28 04:23:43.489312] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:06.277 [2024-11-28 04:23:43.489476] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:06.277 [2024-11-28 04:23:43.489493] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:06.277 [2024-11-28 04:23:43.489505] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:06.277 [2024-11-28 04:23:43.489606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:06.277 [2024-11-28 04:23:43.489709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:06.277 [2024-11-28 04:23:43.489712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:06.277 [2024-11-28 04:23:43.489632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:07.211 04:23:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:07.211 04:23:44 -- common/autotest_common.sh@862 -- # return 0 00:17:07.211 04:23:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:07.211 04:23:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:07.211 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:17:07.211 04:23:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:07.211 04:23:44 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:07.211 04:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.211 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:17:07.211 [2024-11-28 04:23:44.337167] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:07.211 04:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.211 04:23:44 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:07.211 04:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.211 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:17:07.211 Malloc0 00:17:07.211 04:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.211 04:23:44 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:07.211 04:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.211 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:17:07.211 04:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.211 04:23:44 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:07.211 04:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.211 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:17:07.211 04:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.211 04:23:44 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:07.211 04:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.211 04:23:44 -- common/autotest_common.sh@10 -- # set +x 00:17:07.211 [2024-11-28 04:23:44.375029] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:07.211 04:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.211 04:23:44 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:07.211 04:23:44 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:07.211 04:23:44 -- nvmf/common.sh@520 -- # config=() 00:17:07.211 04:23:44 -- nvmf/common.sh@520 -- # local subsystem config 00:17:07.211 04:23:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:07.211 04:23:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:07.211 { 00:17:07.211 "params": { 00:17:07.211 "name": "Nvme$subsystem", 00:17:07.211 "trtype": "$TEST_TRANSPORT", 00:17:07.211 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:07.211 "adrfam": "ipv4", 00:17:07.211 "trsvcid": "$NVMF_PORT", 00:17:07.211 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:07.211 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:07.211 "hdgst": ${hdgst:-false}, 00:17:07.211 "ddgst": ${ddgst:-false} 00:17:07.211 }, 00:17:07.211 "method": "bdev_nvme_attach_controller" 00:17:07.211 } 00:17:07.211 EOF 00:17:07.211 )") 00:17:07.211 04:23:44 -- nvmf/common.sh@542 -- # cat 00:17:07.211 04:23:44 -- nvmf/common.sh@544 -- # jq . 00:17:07.211 04:23:44 -- nvmf/common.sh@545 -- # IFS=, 00:17:07.211 04:23:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:07.211 "params": { 00:17:07.211 "name": "Nvme1", 00:17:07.211 "trtype": "tcp", 00:17:07.211 "traddr": "10.0.0.2", 00:17:07.211 "adrfam": "ipv4", 00:17:07.211 "trsvcid": "4420", 00:17:07.211 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:07.211 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:07.211 "hdgst": false, 00:17:07.211 "ddgst": false 00:17:07.211 }, 00:17:07.211 "method": "bdev_nvme_attach_controller" 00:17:07.211 }' 00:17:07.211 [2024-11-28 04:23:44.413864] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:07.211 [2024-11-28 04:23:44.413939] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3908306 ] 00:17:07.211 [2024-11-28 04:23:44.479124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:07.473 [2024-11-28 04:23:44.595577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:07.473 [2024-11-28 04:23:44.595631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:07.473 [2024-11-28 04:23:44.595634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:07.473 [2024-11-28 04:23:44.749999] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:07.473 [2024-11-28 04:23:44.750063] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:07.473 I/O targets: 00:17:07.473 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:07.473 00:17:07.473 00:17:07.473 CUnit - A unit testing framework for C - Version 2.1-3 00:17:07.473 http://cunit.sourceforge.net/ 00:17:07.473 00:17:07.473 00:17:07.473 Suite: bdevio tests on: Nvme1n1 00:17:07.764 Test: blockdev write read block ...passed 00:17:07.764 Test: blockdev write zeroes read block ...passed 00:17:07.764 Test: blockdev write zeroes read no split ...passed 00:17:07.764 Test: blockdev write zeroes read split ...passed 00:17:07.764 Test: blockdev write zeroes read split partial ...passed 00:17:07.764 Test: blockdev reset ...[2024-11-28 04:23:44.956924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:07.764 [2024-11-28 04:23:44.957041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1dad7d0 (9): Bad file descriptor 00:17:07.764 [2024-11-28 04:23:45.009591] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:07.764 passed 00:17:07.764 Test: blockdev write read 8 blocks ...passed 00:17:07.764 Test: blockdev write read size > 128k ...passed 00:17:07.764 Test: blockdev write read invalid size ...passed 00:17:08.050 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:08.050 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:08.050 Test: blockdev write read max offset ...passed 00:17:08.050 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:08.050 Test: blockdev writev readv 8 blocks ...passed 00:17:08.050 Test: blockdev writev readv 30 x 1block ...passed 00:17:08.050 Test: blockdev writev readv block ...passed 00:17:08.050 Test: blockdev writev readv size > 128k ...passed 00:17:08.050 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:08.050 Test: blockdev comparev and writev ...[2024-11-28 04:23:45.305188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.305228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:08.050 [2024-11-28 04:23:45.305252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.305269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:08.050 [2024-11-28 04:23:45.305656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.305681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:08.050 [2024-11-28 04:23:45.305702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.305718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:08.050 [2024-11-28 04:23:45.306067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.306091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:08.050 [2024-11-28 04:23:45.306112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.306127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:08.050 [2024-11-28 04:23:45.306486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.306509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:08.050 [2024-11-28 04:23:45.306537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:08.050 [2024-11-28 04:23:45.306561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:08.050 passed 00:17:08.308 Test: blockdev nvme passthru rw ...passed 00:17:08.308 Test: blockdev nvme passthru vendor specific ...[2024-11-28 04:23:45.389819] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:08.308 [2024-11-28 04:23:45.389845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:08.308 [2024-11-28 04:23:45.390014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:08.308 [2024-11-28 04:23:45.390038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:08.308 [2024-11-28 04:23:45.390201] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:08.308 [2024-11-28 04:23:45.390224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:08.308 [2024-11-28 04:23:45.390391] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:08.308 [2024-11-28 04:23:45.390414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:08.308 passed 00:17:08.308 Test: blockdev nvme admin passthru ...passed 00:17:08.308 Test: blockdev copy ...passed 00:17:08.308 00:17:08.308 Run Summary: Type Total Ran Passed Failed Inactive 00:17:08.308 suites 1 1 n/a 0 0 00:17:08.308 tests 23 23 23 0 0 00:17:08.308 asserts 152 152 152 0 n/a 00:17:08.308 00:17:08.308 Elapsed time = 1.395 seconds 00:17:08.567 04:23:45 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:08.567 04:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.567 04:23:45 -- common/autotest_common.sh@10 -- # set +x 00:17:08.567 04:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.567 04:23:45 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:08.567 04:23:45 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:08.567 04:23:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:08.567 04:23:45 -- nvmf/common.sh@116 -- # sync 00:17:08.567 04:23:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:08.567 04:23:45 -- nvmf/common.sh@119 -- # set +e 00:17:08.567 04:23:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:08.567 04:23:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:08.567 rmmod nvme_tcp 00:17:08.567 rmmod nvme_fabrics 00:17:08.567 rmmod nvme_keyring 00:17:08.825 04:23:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:08.825 04:23:45 -- nvmf/common.sh@123 -- # set -e 00:17:08.825 04:23:45 -- nvmf/common.sh@124 -- # return 0 00:17:08.825 04:23:45 -- nvmf/common.sh@477 -- # '[' -n 3908146 ']' 00:17:08.825 04:23:45 -- nvmf/common.sh@478 -- # killprocess 3908146 00:17:08.825 04:23:45 -- common/autotest_common.sh@936 -- # '[' -z 3908146 ']' 00:17:08.825 04:23:45 -- common/autotest_common.sh@940 -- # kill -0 3908146 00:17:08.825 04:23:45 -- common/autotest_common.sh@941 -- # uname 00:17:08.825 04:23:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:08.825 04:23:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3908146 00:17:08.825 04:23:45 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:08.825 04:23:45 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:08.825 04:23:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3908146' 00:17:08.825 killing process with pid 3908146 00:17:08.825 04:23:45 -- common/autotest_common.sh@955 -- # kill 3908146 00:17:08.825 04:23:45 -- common/autotest_common.sh@960 -- # wait 3908146 00:17:09.084 04:23:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:09.084 04:23:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:09.084 04:23:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:09.084 04:23:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:09.084 04:23:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:09.084 04:23:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:09.084 04:23:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:09.084 04:23:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.622 04:23:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:11.622 00:17:11.622 real 0m7.549s 00:17:11.622 user 0m14.239s 00:17:11.622 sys 0m2.709s 00:17:11.622 04:23:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:11.622 04:23:48 -- common/autotest_common.sh@10 -- # set +x 00:17:11.622 ************************************ 00:17:11.622 END TEST nvmf_bdevio_no_huge 00:17:11.622 ************************************ 00:17:11.622 04:23:48 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:11.622 04:23:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:11.622 04:23:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:11.622 04:23:48 -- common/autotest_common.sh@10 -- # set +x 00:17:11.622 ************************************ 00:17:11.622 START TEST nvmf_tls 00:17:11.622 ************************************ 00:17:11.622 04:23:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:11.622 * Looking for test storage... 00:17:11.622 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:11.622 04:23:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:11.622 04:23:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:11.622 04:23:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:11.622 04:23:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:11.622 04:23:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:11.622 04:23:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:11.622 04:23:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:11.622 04:23:48 -- scripts/common.sh@335 -- # IFS=.-: 00:17:11.622 04:23:48 -- scripts/common.sh@335 -- # read -ra ver1 00:17:11.622 04:23:48 -- scripts/common.sh@336 -- # IFS=.-: 00:17:11.622 04:23:48 -- scripts/common.sh@336 -- # read -ra ver2 00:17:11.622 04:23:48 -- scripts/common.sh@337 -- # local 'op=<' 00:17:11.622 04:23:48 -- scripts/common.sh@339 -- # ver1_l=2 00:17:11.622 04:23:48 -- scripts/common.sh@340 -- # ver2_l=1 00:17:11.622 04:23:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:11.622 04:23:48 -- scripts/common.sh@343 -- # case "$op" in 00:17:11.622 04:23:48 -- scripts/common.sh@344 -- # : 1 00:17:11.622 04:23:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:11.622 04:23:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:11.622 04:23:48 -- scripts/common.sh@364 -- # decimal 1 00:17:11.622 04:23:48 -- scripts/common.sh@352 -- # local d=1 00:17:11.622 04:23:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:11.622 04:23:48 -- scripts/common.sh@354 -- # echo 1 00:17:11.622 04:23:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:11.622 04:23:48 -- scripts/common.sh@365 -- # decimal 2 00:17:11.622 04:23:48 -- scripts/common.sh@352 -- # local d=2 00:17:11.622 04:23:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:11.622 04:23:48 -- scripts/common.sh@354 -- # echo 2 00:17:11.622 04:23:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:11.622 04:23:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:11.622 04:23:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:11.622 04:23:48 -- scripts/common.sh@367 -- # return 0 00:17:11.622 04:23:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:11.622 04:23:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:11.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.622 --rc genhtml_branch_coverage=1 00:17:11.622 --rc genhtml_function_coverage=1 00:17:11.622 --rc genhtml_legend=1 00:17:11.622 --rc geninfo_all_blocks=1 00:17:11.622 --rc geninfo_unexecuted_blocks=1 00:17:11.622 00:17:11.622 ' 00:17:11.622 04:23:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:11.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.622 --rc genhtml_branch_coverage=1 00:17:11.622 --rc genhtml_function_coverage=1 00:17:11.622 --rc genhtml_legend=1 00:17:11.622 --rc geninfo_all_blocks=1 00:17:11.622 --rc geninfo_unexecuted_blocks=1 00:17:11.622 00:17:11.622 ' 00:17:11.622 04:23:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:11.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.622 --rc genhtml_branch_coverage=1 00:17:11.622 --rc genhtml_function_coverage=1 00:17:11.622 --rc genhtml_legend=1 00:17:11.622 --rc geninfo_all_blocks=1 00:17:11.622 --rc geninfo_unexecuted_blocks=1 00:17:11.622 00:17:11.622 ' 00:17:11.622 04:23:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:11.622 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.622 --rc genhtml_branch_coverage=1 00:17:11.622 --rc genhtml_function_coverage=1 00:17:11.622 --rc genhtml_legend=1 00:17:11.622 --rc geninfo_all_blocks=1 00:17:11.622 --rc geninfo_unexecuted_blocks=1 00:17:11.622 00:17:11.622 ' 00:17:11.622 04:23:48 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:11.622 04:23:48 -- nvmf/common.sh@7 -- # uname -s 00:17:11.622 04:23:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:11.622 04:23:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:11.622 04:23:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:11.622 04:23:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:11.622 04:23:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:11.622 04:23:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:11.623 04:23:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:11.623 04:23:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:11.623 04:23:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:11.623 04:23:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:11.623 04:23:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.623 04:23:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.623 04:23:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:11.623 04:23:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:11.623 04:23:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:11.623 04:23:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:11.623 04:23:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:11.623 04:23:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:11.623 04:23:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:11.623 04:23:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.623 04:23:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.623 04:23:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.623 04:23:48 -- paths/export.sh@5 -- # export PATH 00:17:11.623 04:23:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.623 04:23:48 -- nvmf/common.sh@46 -- # : 0 00:17:11.623 04:23:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:11.623 04:23:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:11.623 04:23:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:11.623 04:23:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:11.623 04:23:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:11.623 04:23:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:11.623 04:23:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:11.623 04:23:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:11.623 04:23:48 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.623 04:23:48 -- target/tls.sh@71 -- # nvmftestinit 00:17:11.623 04:23:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:11.623 04:23:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:11.623 04:23:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:11.623 04:23:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:11.623 04:23:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:11.623 04:23:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:11.623 04:23:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:11.623 04:23:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.623 04:23:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:11.623 04:23:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:11.623 04:23:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:11.623 04:23:48 -- common/autotest_common.sh@10 -- # set +x 00:17:13.524 04:23:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:13.524 04:23:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:13.524 04:23:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:13.524 04:23:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:13.524 04:23:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:13.524 04:23:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:13.524 04:23:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:13.524 04:23:50 -- nvmf/common.sh@294 -- # net_devs=() 00:17:13.524 04:23:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:13.524 04:23:50 -- nvmf/common.sh@295 -- # e810=() 00:17:13.524 04:23:50 -- nvmf/common.sh@295 -- # local -ga e810 00:17:13.524 04:23:50 -- nvmf/common.sh@296 -- # x722=() 00:17:13.524 04:23:50 -- nvmf/common.sh@296 -- # local -ga x722 00:17:13.524 04:23:50 -- nvmf/common.sh@297 -- # mlx=() 00:17:13.524 04:23:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:13.524 04:23:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:13.524 04:23:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:13.524 04:23:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:13.524 04:23:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:13.524 04:23:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.524 04:23:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:13.524 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:13.524 04:23:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.524 04:23:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:13.524 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:13.524 04:23:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:13.524 04:23:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.524 04:23:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.524 04:23:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.524 04:23:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.524 04:23:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:13.524 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:13.524 04:23:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.524 04:23:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.524 04:23:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.524 04:23:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.524 04:23:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.524 04:23:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:13.524 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:13.524 04:23:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.524 04:23:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:13.524 04:23:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:13.524 04:23:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:13.524 04:23:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:13.524 04:23:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:13.524 04:23:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:13.524 04:23:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:13.524 04:23:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:13.524 04:23:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:13.524 04:23:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:13.524 04:23:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:13.524 04:23:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:13.524 04:23:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:13.524 04:23:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:13.524 04:23:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:13.524 04:23:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:13.524 04:23:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:13.524 04:23:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:13.524 04:23:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:13.524 04:23:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:13.524 04:23:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:13.524 04:23:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:13.524 04:23:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:13.524 04:23:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:13.524 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:13.524 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.177 ms 00:17:13.524 00:17:13.524 --- 10.0.0.2 ping statistics --- 00:17:13.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:13.524 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:17:13.524 04:23:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:13.524 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:13.524 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:17:13.524 00:17:13.525 --- 10.0.0.1 ping statistics --- 00:17:13.525 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:13.525 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:17:13.525 04:23:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:13.525 04:23:50 -- nvmf/common.sh@410 -- # return 0 00:17:13.525 04:23:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:13.525 04:23:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:13.525 04:23:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:13.525 04:23:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:13.525 04:23:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:13.525 04:23:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:13.525 04:23:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:13.525 04:23:50 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:13.525 04:23:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:13.525 04:23:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:13.525 04:23:50 -- common/autotest_common.sh@10 -- # set +x 00:17:13.525 04:23:50 -- nvmf/common.sh@469 -- # nvmfpid=3910526 00:17:13.525 04:23:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:13.525 04:23:50 -- nvmf/common.sh@470 -- # waitforlisten 3910526 00:17:13.525 04:23:50 -- common/autotest_common.sh@829 -- # '[' -z 3910526 ']' 00:17:13.525 04:23:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:13.525 04:23:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:13.525 04:23:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:13.525 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:13.525 04:23:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:13.525 04:23:50 -- common/autotest_common.sh@10 -- # set +x 00:17:13.525 [2024-11-28 04:23:50.742075] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:13.525 [2024-11-28 04:23:50.742143] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:13.525 EAL: No free 2048 kB hugepages reported on node 1 00:17:13.525 [2024-11-28 04:23:50.811052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:13.783 [2024-11-28 04:23:50.931577] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:13.783 [2024-11-28 04:23:50.931739] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:13.783 [2024-11-28 04:23:50.931756] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:13.783 [2024-11-28 04:23:50.931777] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:13.783 [2024-11-28 04:23:50.931806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:13.783 04:23:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:13.783 04:23:50 -- common/autotest_common.sh@862 -- # return 0 00:17:13.783 04:23:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:13.783 04:23:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:13.783 04:23:50 -- common/autotest_common.sh@10 -- # set +x 00:17:13.783 04:23:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:13.783 04:23:51 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:13.783 04:23:51 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:14.040 true 00:17:14.040 04:23:51 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:14.040 04:23:51 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:14.298 04:23:51 -- target/tls.sh@82 -- # version=0 00:17:14.298 04:23:51 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:14.298 04:23:51 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:14.556 04:23:51 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:14.556 04:23:51 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:14.814 04:23:52 -- target/tls.sh@90 -- # version=13 00:17:14.814 04:23:52 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:14.814 04:23:52 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:15.072 04:23:52 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:15.072 04:23:52 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:15.330 04:23:52 -- target/tls.sh@98 -- # version=7 00:17:15.330 04:23:52 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:15.330 04:23:52 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:15.330 04:23:52 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:15.589 04:23:52 -- target/tls.sh@105 -- # ktls=false 00:17:15.589 04:23:52 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:15.589 04:23:52 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:16.155 04:23:53 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:16.155 04:23:53 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:16.155 04:23:53 -- target/tls.sh@113 -- # ktls=true 00:17:16.155 04:23:53 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:16.155 04:23:53 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:16.413 04:23:53 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:16.413 04:23:53 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:16.671 04:23:53 -- target/tls.sh@121 -- # ktls=false 00:17:16.671 04:23:53 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:16.671 04:23:53 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:16.671 04:23:53 -- target/tls.sh@49 -- # local key hash crc 00:17:16.671 04:23:53 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:16.671 04:23:53 -- target/tls.sh@51 -- # hash=01 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # gzip -1 -c 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # tail -c8 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # head -c 4 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # crc='p$H�' 00:17:16.671 04:23:53 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:16.671 04:23:53 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:16.671 04:23:53 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:16.671 04:23:53 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:16.671 04:23:53 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:16.671 04:23:53 -- target/tls.sh@49 -- # local key hash crc 00:17:16.671 04:23:53 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:16.671 04:23:53 -- target/tls.sh@51 -- # hash=01 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # gzip -1 -c 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # tail -c8 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # head -c 4 00:17:16.671 04:23:53 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:16.671 04:23:53 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:16.671 04:23:53 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:16.671 04:23:53 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:16.671 04:23:53 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:16.671 04:23:53 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:16.671 04:23:53 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:16.671 04:23:53 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:16.671 04:23:53 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:16.671 04:23:53 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:16.671 04:23:53 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:16.671 04:23:53 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:17.238 04:23:54 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:17.497 04:23:54 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:17.497 04:23:54 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:17.497 04:23:54 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:17.755 [2024-11-28 04:23:54.873833] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:17.755 04:23:54 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:18.012 04:23:55 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:18.270 [2024-11-28 04:23:55.363151] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:18.270 [2024-11-28 04:23:55.363424] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:18.270 04:23:55 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:18.528 malloc0 00:17:18.528 04:23:55 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:18.787 04:23:55 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.046 04:23:56 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.046 EAL: No free 2048 kB hugepages reported on node 1 00:17:31.246 Initializing NVMe Controllers 00:17:31.246 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:31.246 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:31.246 Initialization complete. Launching workers. 00:17:31.246 ======================================================== 00:17:31.246 Latency(us) 00:17:31.246 Device Information : IOPS MiB/s Average min max 00:17:31.246 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7786.20 30.41 8222.28 1292.92 9840.54 00:17:31.246 ======================================================== 00:17:31.246 Total : 7786.20 30.41 8222.28 1292.92 9840.54 00:17:31.246 00:17:31.246 04:24:06 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:31.246 04:24:06 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:31.246 04:24:06 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:31.246 04:24:06 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:31.246 04:24:06 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:31.246 04:24:06 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:31.246 04:24:06 -- target/tls.sh@28 -- # bdevperf_pid=3912600 00:17:31.246 04:24:06 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:31.246 04:24:06 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:31.246 04:24:06 -- target/tls.sh@31 -- # waitforlisten 3912600 /var/tmp/bdevperf.sock 00:17:31.246 04:24:06 -- common/autotest_common.sh@829 -- # '[' -z 3912600 ']' 00:17:31.246 04:24:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:31.246 04:24:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:31.246 04:24:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:31.246 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:31.246 04:24:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:31.246 04:24:06 -- common/autotest_common.sh@10 -- # set +x 00:17:31.246 [2024-11-28 04:24:06.404305] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:31.246 [2024-11-28 04:24:06.404384] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3912600 ] 00:17:31.246 EAL: No free 2048 kB hugepages reported on node 1 00:17:31.246 [2024-11-28 04:24:06.460918] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:31.246 [2024-11-28 04:24:06.563869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:31.246 04:24:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:31.246 04:24:07 -- common/autotest_common.sh@862 -- # return 0 00:17:31.246 04:24:07 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:31.246 [2024-11-28 04:24:07.641081] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:31.246 TLSTESTn1 00:17:31.246 04:24:07 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:31.246 Running I/O for 10 seconds... 00:17:41.224 00:17:41.224 Latency(us) 00:17:41.224 [2024-11-28T03:24:18.535Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:41.224 [2024-11-28T03:24:18.535Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:41.224 Verification LBA range: start 0x0 length 0x2000 00:17:41.224 TLSTESTn1 : 10.01 4349.35 16.99 0.00 0.00 29394.34 4199.16 45632.47 00:17:41.224 [2024-11-28T03:24:18.535Z] =================================================================================================================== 00:17:41.224 [2024-11-28T03:24:18.535Z] Total : 4349.35 16.99 0.00 0.00 29394.34 4199.16 45632.47 00:17:41.224 0 00:17:41.224 04:24:17 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:41.224 04:24:17 -- target/tls.sh@45 -- # killprocess 3912600 00:17:41.225 04:24:17 -- common/autotest_common.sh@936 -- # '[' -z 3912600 ']' 00:17:41.225 04:24:17 -- common/autotest_common.sh@940 -- # kill -0 3912600 00:17:41.225 04:24:17 -- common/autotest_common.sh@941 -- # uname 00:17:41.225 04:24:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:41.225 04:24:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3912600 00:17:41.225 04:24:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:41.225 04:24:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:41.225 04:24:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3912600' 00:17:41.225 killing process with pid 3912600 00:17:41.225 04:24:17 -- common/autotest_common.sh@955 -- # kill 3912600 00:17:41.225 Received shutdown signal, test time was about 10.000000 seconds 00:17:41.225 00:17:41.225 Latency(us) 00:17:41.225 [2024-11-28T03:24:18.536Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:41.225 [2024-11-28T03:24:18.536Z] =================================================================================================================== 00:17:41.225 [2024-11-28T03:24:18.536Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:41.225 04:24:17 -- common/autotest_common.sh@960 -- # wait 3912600 00:17:41.225 04:24:18 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:41.225 04:24:18 -- common/autotest_common.sh@650 -- # local es=0 00:17:41.225 04:24:18 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:41.225 04:24:18 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:41.225 04:24:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:41.225 04:24:18 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:41.225 04:24:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:41.225 04:24:18 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:41.225 04:24:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:41.225 04:24:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:41.225 04:24:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:41.225 04:24:18 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:41.225 04:24:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:41.225 04:24:18 -- target/tls.sh@28 -- # bdevperf_pid=3914478 00:17:41.225 04:24:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:41.225 04:24:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:41.225 04:24:18 -- target/tls.sh@31 -- # waitforlisten 3914478 /var/tmp/bdevperf.sock 00:17:41.225 04:24:18 -- common/autotest_common.sh@829 -- # '[' -z 3914478 ']' 00:17:41.225 04:24:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:41.225 04:24:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:41.225 04:24:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:41.225 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:41.225 04:24:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:41.225 04:24:18 -- common/autotest_common.sh@10 -- # set +x 00:17:41.225 [2024-11-28 04:24:18.242311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:41.225 [2024-11-28 04:24:18.242390] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914478 ] 00:17:41.225 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.225 [2024-11-28 04:24:18.299944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.225 [2024-11-28 04:24:18.406315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:42.158 04:24:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:42.158 04:24:19 -- common/autotest_common.sh@862 -- # return 0 00:17:42.158 04:24:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:42.416 [2024-11-28 04:24:19.525736] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:42.416 [2024-11-28 04:24:19.535100] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:42.416 [2024-11-28 04:24:19.535769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13311f0 (107): Transport endpoint is not connected 00:17:42.416 [2024-11-28 04:24:19.536761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13311f0 (9): Bad file descriptor 00:17:42.416 [2024-11-28 04:24:19.537760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:42.416 [2024-11-28 04:24:19.537783] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:42.416 [2024-11-28 04:24:19.537798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:42.416 request: 00:17:42.416 { 00:17:42.416 "name": "TLSTEST", 00:17:42.416 "trtype": "tcp", 00:17:42.416 "traddr": "10.0.0.2", 00:17:42.416 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:42.416 "adrfam": "ipv4", 00:17:42.416 "trsvcid": "4420", 00:17:42.416 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.416 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:42.416 "method": "bdev_nvme_attach_controller", 00:17:42.416 "req_id": 1 00:17:42.416 } 00:17:42.416 Got JSON-RPC error response 00:17:42.416 response: 00:17:42.416 { 00:17:42.416 "code": -32602, 00:17:42.416 "message": "Invalid parameters" 00:17:42.416 } 00:17:42.416 04:24:19 -- target/tls.sh@36 -- # killprocess 3914478 00:17:42.416 04:24:19 -- common/autotest_common.sh@936 -- # '[' -z 3914478 ']' 00:17:42.416 04:24:19 -- common/autotest_common.sh@940 -- # kill -0 3914478 00:17:42.416 04:24:19 -- common/autotest_common.sh@941 -- # uname 00:17:42.416 04:24:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.416 04:24:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3914478 00:17:42.416 04:24:19 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:42.416 04:24:19 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:42.416 04:24:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3914478' 00:17:42.416 killing process with pid 3914478 00:17:42.416 04:24:19 -- common/autotest_common.sh@955 -- # kill 3914478 00:17:42.416 Received shutdown signal, test time was about 10.000000 seconds 00:17:42.416 00:17:42.416 Latency(us) 00:17:42.416 [2024-11-28T03:24:19.727Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.416 [2024-11-28T03:24:19.727Z] =================================================================================================================== 00:17:42.416 [2024-11-28T03:24:19.727Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:42.416 04:24:19 -- common/autotest_common.sh@960 -- # wait 3914478 00:17:42.674 04:24:19 -- target/tls.sh@37 -- # return 1 00:17:42.674 04:24:19 -- common/autotest_common.sh@653 -- # es=1 00:17:42.674 04:24:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:42.674 04:24:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:42.674 04:24:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:42.674 04:24:19 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:42.674 04:24:19 -- common/autotest_common.sh@650 -- # local es=0 00:17:42.674 04:24:19 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:42.674 04:24:19 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:42.674 04:24:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:42.674 04:24:19 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:42.674 04:24:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:42.674 04:24:19 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:42.674 04:24:19 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:42.674 04:24:19 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:42.674 04:24:19 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:42.674 04:24:19 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:42.674 04:24:19 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:42.674 04:24:19 -- target/tls.sh@28 -- # bdevperf_pid=3914748 00:17:42.674 04:24:19 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:42.674 04:24:19 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:42.675 04:24:19 -- target/tls.sh@31 -- # waitforlisten 3914748 /var/tmp/bdevperf.sock 00:17:42.675 04:24:19 -- common/autotest_common.sh@829 -- # '[' -z 3914748 ']' 00:17:42.675 04:24:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:42.675 04:24:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:42.675 04:24:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:42.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:42.675 04:24:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:42.675 04:24:19 -- common/autotest_common.sh@10 -- # set +x 00:17:42.675 [2024-11-28 04:24:19.898605] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:42.675 [2024-11-28 04:24:19.898697] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914748 ] 00:17:42.675 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.675 [2024-11-28 04:24:19.959262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.933 [2024-11-28 04:24:20.084886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:43.863 04:24:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:43.863 04:24:20 -- common/autotest_common.sh@862 -- # return 0 00:17:43.863 04:24:20 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.121 [2024-11-28 04:24:21.183865] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:44.121 [2024-11-28 04:24:21.189369] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:44.121 [2024-11-28 04:24:21.189416] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:44.121 [2024-11-28 04:24:21.189454] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:44.121 [2024-11-28 04:24:21.189664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa511f0 (107): Transport endpoint is not connected 00:17:44.121 [2024-11-28 04:24:21.190652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa511f0 (9): Bad file descriptor 00:17:44.121 [2024-11-28 04:24:21.191651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:44.121 [2024-11-28 04:24:21.191671] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:44.121 [2024-11-28 04:24:21.191685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:44.121 request: 00:17:44.121 { 00:17:44.121 "name": "TLSTEST", 00:17:44.121 "trtype": "tcp", 00:17:44.121 "traddr": "10.0.0.2", 00:17:44.121 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:44.121 "adrfam": "ipv4", 00:17:44.121 "trsvcid": "4420", 00:17:44.121 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.121 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:44.121 "method": "bdev_nvme_attach_controller", 00:17:44.121 "req_id": 1 00:17:44.121 } 00:17:44.121 Got JSON-RPC error response 00:17:44.121 response: 00:17:44.121 { 00:17:44.122 "code": -32602, 00:17:44.122 "message": "Invalid parameters" 00:17:44.122 } 00:17:44.122 04:24:21 -- target/tls.sh@36 -- # killprocess 3914748 00:17:44.122 04:24:21 -- common/autotest_common.sh@936 -- # '[' -z 3914748 ']' 00:17:44.122 04:24:21 -- common/autotest_common.sh@940 -- # kill -0 3914748 00:17:44.122 04:24:21 -- common/autotest_common.sh@941 -- # uname 00:17:44.122 04:24:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:44.122 04:24:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3914748 00:17:44.122 04:24:21 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:44.122 04:24:21 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:44.122 04:24:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3914748' 00:17:44.122 killing process with pid 3914748 00:17:44.122 04:24:21 -- common/autotest_common.sh@955 -- # kill 3914748 00:17:44.122 Received shutdown signal, test time was about 10.000000 seconds 00:17:44.122 00:17:44.122 Latency(us) 00:17:44.122 [2024-11-28T03:24:21.433Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:44.122 [2024-11-28T03:24:21.433Z] =================================================================================================================== 00:17:44.122 [2024-11-28T03:24:21.433Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:44.122 04:24:21 -- common/autotest_common.sh@960 -- # wait 3914748 00:17:44.380 04:24:21 -- target/tls.sh@37 -- # return 1 00:17:44.380 04:24:21 -- common/autotest_common.sh@653 -- # es=1 00:17:44.380 04:24:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:44.380 04:24:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:44.380 04:24:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:44.380 04:24:21 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.380 04:24:21 -- common/autotest_common.sh@650 -- # local es=0 00:17:44.380 04:24:21 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.380 04:24:21 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:44.380 04:24:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:44.380 04:24:21 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:44.380 04:24:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:44.380 04:24:21 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.380 04:24:21 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:44.380 04:24:21 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:44.380 04:24:21 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:44.380 04:24:21 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:44.380 04:24:21 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:44.380 04:24:21 -- target/tls.sh@28 -- # bdevperf_pid=3914903 00:17:44.380 04:24:21 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:44.380 04:24:21 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:44.380 04:24:21 -- target/tls.sh@31 -- # waitforlisten 3914903 /var/tmp/bdevperf.sock 00:17:44.380 04:24:21 -- common/autotest_common.sh@829 -- # '[' -z 3914903 ']' 00:17:44.380 04:24:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:44.380 04:24:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.380 04:24:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:44.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:44.380 04:24:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.380 04:24:21 -- common/autotest_common.sh@10 -- # set +x 00:17:44.380 [2024-11-28 04:24:21.513034] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.380 [2024-11-28 04:24:21.513111] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914903 ] 00:17:44.380 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.380 [2024-11-28 04:24:21.585100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:44.638 [2024-11-28 04:24:21.717387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:44.638 04:24:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:44.638 04:24:21 -- common/autotest_common.sh@862 -- # return 0 00:17:44.638 04:24:21 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.896 [2024-11-28 04:24:22.156309] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:44.896 [2024-11-28 04:24:22.161898] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:44.896 [2024-11-28 04:24:22.161929] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:44.896 [2024-11-28 04:24:22.161988] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:44.896 [2024-11-28 04:24:22.162108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17821f0 (107): Transport endpoint is not connected 00:17:44.896 [2024-11-28 04:24:22.163089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17821f0 (9): Bad file descriptor 00:17:44.896 [2024-11-28 04:24:22.164089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:44.896 [2024-11-28 04:24:22.164106] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:44.896 [2024-11-28 04:24:22.164133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:44.896 request: 00:17:44.896 { 00:17:44.896 "name": "TLSTEST", 00:17:44.896 "trtype": "tcp", 00:17:44.896 "traddr": "10.0.0.2", 00:17:44.896 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:44.896 "adrfam": "ipv4", 00:17:44.896 "trsvcid": "4420", 00:17:44.896 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:44.896 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:44.896 "method": "bdev_nvme_attach_controller", 00:17:44.896 "req_id": 1 00:17:44.896 } 00:17:44.896 Got JSON-RPC error response 00:17:44.896 response: 00:17:44.896 { 00:17:44.896 "code": -32602, 00:17:44.896 "message": "Invalid parameters" 00:17:44.896 } 00:17:44.896 04:24:22 -- target/tls.sh@36 -- # killprocess 3914903 00:17:44.896 04:24:22 -- common/autotest_common.sh@936 -- # '[' -z 3914903 ']' 00:17:44.896 04:24:22 -- common/autotest_common.sh@940 -- # kill -0 3914903 00:17:44.896 04:24:22 -- common/autotest_common.sh@941 -- # uname 00:17:44.896 04:24:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:44.896 04:24:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3914903 00:17:45.154 04:24:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:45.154 04:24:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:45.154 04:24:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3914903' 00:17:45.154 killing process with pid 3914903 00:17:45.154 04:24:22 -- common/autotest_common.sh@955 -- # kill 3914903 00:17:45.154 Received shutdown signal, test time was about 10.000000 seconds 00:17:45.154 00:17:45.154 Latency(us) 00:17:45.154 [2024-11-28T03:24:22.465Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.154 [2024-11-28T03:24:22.465Z] =================================================================================================================== 00:17:45.154 [2024-11-28T03:24:22.465Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:45.154 04:24:22 -- common/autotest_common.sh@960 -- # wait 3914903 00:17:45.412 04:24:22 -- target/tls.sh@37 -- # return 1 00:17:45.413 04:24:22 -- common/autotest_common.sh@653 -- # es=1 00:17:45.413 04:24:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:45.413 04:24:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:45.413 04:24:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:45.413 04:24:22 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:45.413 04:24:22 -- common/autotest_common.sh@650 -- # local es=0 00:17:45.413 04:24:22 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:45.413 04:24:22 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:45.413 04:24:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:45.413 04:24:22 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:45.413 04:24:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:45.413 04:24:22 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:45.413 04:24:22 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:45.413 04:24:22 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:45.413 04:24:22 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:45.413 04:24:22 -- target/tls.sh@23 -- # psk= 00:17:45.413 04:24:22 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:45.413 04:24:22 -- target/tls.sh@28 -- # bdevperf_pid=3915046 00:17:45.413 04:24:22 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:45.413 04:24:22 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:45.413 04:24:22 -- target/tls.sh@31 -- # waitforlisten 3915046 /var/tmp/bdevperf.sock 00:17:45.413 04:24:22 -- common/autotest_common.sh@829 -- # '[' -z 3915046 ']' 00:17:45.413 04:24:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:45.413 04:24:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:45.413 04:24:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:45.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:45.413 04:24:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:45.413 04:24:22 -- common/autotest_common.sh@10 -- # set +x 00:17:45.413 [2024-11-28 04:24:22.526775] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:45.413 [2024-11-28 04:24:22.526850] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3915046 ] 00:17:45.413 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.413 [2024-11-28 04:24:22.582120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.413 [2024-11-28 04:24:22.681799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:46.347 04:24:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.347 04:24:23 -- common/autotest_common.sh@862 -- # return 0 00:17:46.348 04:24:23 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:46.606 [2024-11-28 04:24:23.726067] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:46.606 [2024-11-28 04:24:23.727463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1245050 (9): Bad file descriptor 00:17:46.606 [2024-11-28 04:24:23.728458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:46.606 [2024-11-28 04:24:23.728478] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:46.606 [2024-11-28 04:24:23.728506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:46.606 request: 00:17:46.606 { 00:17:46.606 "name": "TLSTEST", 00:17:46.606 "trtype": "tcp", 00:17:46.606 "traddr": "10.0.0.2", 00:17:46.606 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:46.606 "adrfam": "ipv4", 00:17:46.606 "trsvcid": "4420", 00:17:46.606 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:46.606 "method": "bdev_nvme_attach_controller", 00:17:46.606 "req_id": 1 00:17:46.606 } 00:17:46.606 Got JSON-RPC error response 00:17:46.606 response: 00:17:46.606 { 00:17:46.606 "code": -32602, 00:17:46.606 "message": "Invalid parameters" 00:17:46.606 } 00:17:46.606 04:24:23 -- target/tls.sh@36 -- # killprocess 3915046 00:17:46.606 04:24:23 -- common/autotest_common.sh@936 -- # '[' -z 3915046 ']' 00:17:46.606 04:24:23 -- common/autotest_common.sh@940 -- # kill -0 3915046 00:17:46.606 04:24:23 -- common/autotest_common.sh@941 -- # uname 00:17:46.606 04:24:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:46.606 04:24:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3915046 00:17:46.606 04:24:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:46.606 04:24:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:46.606 04:24:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3915046' 00:17:46.606 killing process with pid 3915046 00:17:46.606 04:24:23 -- common/autotest_common.sh@955 -- # kill 3915046 00:17:46.606 Received shutdown signal, test time was about 10.000000 seconds 00:17:46.606 00:17:46.606 Latency(us) 00:17:46.606 [2024-11-28T03:24:23.917Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:46.606 [2024-11-28T03:24:23.917Z] =================================================================================================================== 00:17:46.606 [2024-11-28T03:24:23.917Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:46.606 04:24:23 -- common/autotest_common.sh@960 -- # wait 3915046 00:17:46.864 04:24:24 -- target/tls.sh@37 -- # return 1 00:17:46.864 04:24:24 -- common/autotest_common.sh@653 -- # es=1 00:17:46.864 04:24:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:46.864 04:24:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:46.864 04:24:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:46.864 04:24:24 -- target/tls.sh@167 -- # killprocess 3910526 00:17:46.864 04:24:24 -- common/autotest_common.sh@936 -- # '[' -z 3910526 ']' 00:17:46.864 04:24:24 -- common/autotest_common.sh@940 -- # kill -0 3910526 00:17:46.864 04:24:24 -- common/autotest_common.sh@941 -- # uname 00:17:46.864 04:24:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:46.864 04:24:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3910526 00:17:46.864 04:24:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:46.864 04:24:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:46.864 04:24:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3910526' 00:17:46.864 killing process with pid 3910526 00:17:46.864 04:24:24 -- common/autotest_common.sh@955 -- # kill 3910526 00:17:46.864 04:24:24 -- common/autotest_common.sh@960 -- # wait 3910526 00:17:47.122 04:24:24 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:47.122 04:24:24 -- target/tls.sh@49 -- # local key hash crc 00:17:47.122 04:24:24 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:47.122 04:24:24 -- target/tls.sh@51 -- # hash=02 00:17:47.122 04:24:24 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:47.122 04:24:24 -- target/tls.sh@52 -- # gzip -1 -c 00:17:47.122 04:24:24 -- target/tls.sh@52 -- # tail -c8 00:17:47.122 04:24:24 -- target/tls.sh@52 -- # head -c 4 00:17:47.122 04:24:24 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:47.122 04:24:24 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:47.122 04:24:24 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:47.122 04:24:24 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:47.122 04:24:24 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:47.122 04:24:24 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:47.123 04:24:24 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:47.123 04:24:24 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:47.123 04:24:24 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:47.123 04:24:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:47.123 04:24:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:47.123 04:24:24 -- common/autotest_common.sh@10 -- # set +x 00:17:47.123 04:24:24 -- nvmf/common.sh@469 -- # nvmfpid=3915337 00:17:47.123 04:24:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:47.123 04:24:24 -- nvmf/common.sh@470 -- # waitforlisten 3915337 00:17:47.123 04:24:24 -- common/autotest_common.sh@829 -- # '[' -z 3915337 ']' 00:17:47.123 04:24:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:47.123 04:24:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:47.123 04:24:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:47.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:47.123 04:24:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:47.123 04:24:24 -- common/autotest_common.sh@10 -- # set +x 00:17:47.380 [2024-11-28 04:24:24.437226] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:47.380 [2024-11-28 04:24:24.437301] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:47.380 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.380 [2024-11-28 04:24:24.501087] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:47.380 [2024-11-28 04:24:24.606670] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:47.380 [2024-11-28 04:24:24.606840] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:47.380 [2024-11-28 04:24:24.606857] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:47.380 [2024-11-28 04:24:24.606869] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:47.380 [2024-11-28 04:24:24.606898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:48.314 04:24:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:48.314 04:24:25 -- common/autotest_common.sh@862 -- # return 0 00:17:48.314 04:24:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:48.314 04:24:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:48.314 04:24:25 -- common/autotest_common.sh@10 -- # set +x 00:17:48.314 04:24:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:48.314 04:24:25 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:48.314 04:24:25 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:48.314 04:24:25 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:48.573 [2024-11-28 04:24:25.700293] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:48.573 04:24:25 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:48.831 04:24:25 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:49.090 [2024-11-28 04:24:26.189643] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:49.090 [2024-11-28 04:24:26.189896] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:49.090 04:24:26 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:49.347 malloc0 00:17:49.347 04:24:26 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:49.605 04:24:26 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:49.863 04:24:27 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:49.863 04:24:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:49.863 04:24:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:49.863 04:24:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:49.863 04:24:27 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:49.863 04:24:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:49.864 04:24:27 -- target/tls.sh@28 -- # bdevperf_pid=3915643 00:17:49.864 04:24:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:49.864 04:24:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:49.864 04:24:27 -- target/tls.sh@31 -- # waitforlisten 3915643 /var/tmp/bdevperf.sock 00:17:49.864 04:24:27 -- common/autotest_common.sh@829 -- # '[' -z 3915643 ']' 00:17:49.864 04:24:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:49.864 04:24:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:49.864 04:24:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:49.864 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:49.864 04:24:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:49.864 04:24:27 -- common/autotest_common.sh@10 -- # set +x 00:17:49.864 [2024-11-28 04:24:27.127373] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:49.864 [2024-11-28 04:24:27.127443] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3915643 ] 00:17:49.864 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.122 [2024-11-28 04:24:27.183950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.122 [2024-11-28 04:24:27.285855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:51.056 04:24:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:51.056 04:24:28 -- common/autotest_common.sh@862 -- # return 0 00:17:51.056 04:24:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:51.056 [2024-11-28 04:24:28.305428] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:51.315 TLSTESTn1 00:17:51.315 04:24:28 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:51.315 Running I/O for 10 seconds... 00:18:01.347 00:18:01.347 Latency(us) 00:18:01.347 [2024-11-28T03:24:38.658Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.347 [2024-11-28T03:24:38.658Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:01.347 Verification LBA range: start 0x0 length 0x2000 00:18:01.347 TLSTESTn1 : 10.02 4274.61 16.70 0.00 0.00 29903.69 4805.97 233016.89 00:18:01.347 [2024-11-28T03:24:38.658Z] =================================================================================================================== 00:18:01.347 [2024-11-28T03:24:38.658Z] Total : 4274.61 16.70 0.00 0.00 29903.69 4805.97 233016.89 00:18:01.347 0 00:18:01.347 04:24:38 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:01.347 04:24:38 -- target/tls.sh@45 -- # killprocess 3915643 00:18:01.347 04:24:38 -- common/autotest_common.sh@936 -- # '[' -z 3915643 ']' 00:18:01.347 04:24:38 -- common/autotest_common.sh@940 -- # kill -0 3915643 00:18:01.347 04:24:38 -- common/autotest_common.sh@941 -- # uname 00:18:01.347 04:24:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:01.347 04:24:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3915643 00:18:01.347 04:24:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:01.347 04:24:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:01.347 04:24:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3915643' 00:18:01.347 killing process with pid 3915643 00:18:01.347 04:24:38 -- common/autotest_common.sh@955 -- # kill 3915643 00:18:01.347 Received shutdown signal, test time was about 10.000000 seconds 00:18:01.347 00:18:01.347 Latency(us) 00:18:01.347 [2024-11-28T03:24:38.658Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.347 [2024-11-28T03:24:38.658Z] =================================================================================================================== 00:18:01.347 [2024-11-28T03:24:38.658Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:01.347 04:24:38 -- common/autotest_common.sh@960 -- # wait 3915643 00:18:01.605 04:24:38 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.605 04:24:38 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.605 04:24:38 -- common/autotest_common.sh@650 -- # local es=0 00:18:01.605 04:24:38 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.605 04:24:38 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:01.606 04:24:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.606 04:24:38 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:01.606 04:24:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.606 04:24:38 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.606 04:24:38 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:01.606 04:24:38 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:01.606 04:24:38 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:01.606 04:24:38 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:01.606 04:24:38 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:01.606 04:24:38 -- target/tls.sh@28 -- # bdevperf_pid=3917029 00:18:01.606 04:24:38 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:01.606 04:24:38 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:01.606 04:24:38 -- target/tls.sh@31 -- # waitforlisten 3917029 /var/tmp/bdevperf.sock 00:18:01.606 04:24:38 -- common/autotest_common.sh@829 -- # '[' -z 3917029 ']' 00:18:01.606 04:24:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:01.606 04:24:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:01.606 04:24:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:01.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:01.606 04:24:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:01.606 04:24:38 -- common/autotest_common.sh@10 -- # set +x 00:18:01.606 [2024-11-28 04:24:38.900154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:01.606 [2024-11-28 04:24:38.900245] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3917029 ] 00:18:01.864 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.864 [2024-11-28 04:24:38.960447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:01.864 [2024-11-28 04:24:39.063137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:02.797 04:24:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:02.797 04:24:39 -- common/autotest_common.sh@862 -- # return 0 00:18:02.797 04:24:39 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.055 [2024-11-28 04:24:40.131265] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:03.055 [2024-11-28 04:24:40.131335] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:03.055 request: 00:18:03.055 { 00:18:03.056 "name": "TLSTEST", 00:18:03.056 "trtype": "tcp", 00:18:03.056 "traddr": "10.0.0.2", 00:18:03.056 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:03.056 "adrfam": "ipv4", 00:18:03.056 "trsvcid": "4420", 00:18:03.056 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:03.056 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:03.056 "method": "bdev_nvme_attach_controller", 00:18:03.056 "req_id": 1 00:18:03.056 } 00:18:03.056 Got JSON-RPC error response 00:18:03.056 response: 00:18:03.056 { 00:18:03.056 "code": -22, 00:18:03.056 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:03.056 } 00:18:03.056 04:24:40 -- target/tls.sh@36 -- # killprocess 3917029 00:18:03.056 04:24:40 -- common/autotest_common.sh@936 -- # '[' -z 3917029 ']' 00:18:03.056 04:24:40 -- common/autotest_common.sh@940 -- # kill -0 3917029 00:18:03.056 04:24:40 -- common/autotest_common.sh@941 -- # uname 00:18:03.056 04:24:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:03.056 04:24:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3917029 00:18:03.056 04:24:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:03.056 04:24:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:03.056 04:24:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3917029' 00:18:03.056 killing process with pid 3917029 00:18:03.056 04:24:40 -- common/autotest_common.sh@955 -- # kill 3917029 00:18:03.056 Received shutdown signal, test time was about 10.000000 seconds 00:18:03.056 00:18:03.056 Latency(us) 00:18:03.056 [2024-11-28T03:24:40.367Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:03.056 [2024-11-28T03:24:40.367Z] =================================================================================================================== 00:18:03.056 [2024-11-28T03:24:40.367Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:03.056 04:24:40 -- common/autotest_common.sh@960 -- # wait 3917029 00:18:03.314 04:24:40 -- target/tls.sh@37 -- # return 1 00:18:03.314 04:24:40 -- common/autotest_common.sh@653 -- # es=1 00:18:03.314 04:24:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:03.314 04:24:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:03.314 04:24:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:03.314 04:24:40 -- target/tls.sh@183 -- # killprocess 3915337 00:18:03.314 04:24:40 -- common/autotest_common.sh@936 -- # '[' -z 3915337 ']' 00:18:03.314 04:24:40 -- common/autotest_common.sh@940 -- # kill -0 3915337 00:18:03.314 04:24:40 -- common/autotest_common.sh@941 -- # uname 00:18:03.314 04:24:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:03.314 04:24:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3915337 00:18:03.314 04:24:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:03.314 04:24:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:03.314 04:24:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3915337' 00:18:03.314 killing process with pid 3915337 00:18:03.314 04:24:40 -- common/autotest_common.sh@955 -- # kill 3915337 00:18:03.314 04:24:40 -- common/autotest_common.sh@960 -- # wait 3915337 00:18:03.572 04:24:40 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:03.572 04:24:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:03.572 04:24:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:03.572 04:24:40 -- common/autotest_common.sh@10 -- # set +x 00:18:03.572 04:24:40 -- nvmf/common.sh@469 -- # nvmfpid=3917298 00:18:03.572 04:24:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:03.572 04:24:40 -- nvmf/common.sh@470 -- # waitforlisten 3917298 00:18:03.572 04:24:40 -- common/autotest_common.sh@829 -- # '[' -z 3917298 ']' 00:18:03.572 04:24:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:03.572 04:24:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:03.572 04:24:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:03.572 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:03.573 04:24:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:03.573 04:24:40 -- common/autotest_common.sh@10 -- # set +x 00:18:03.573 [2024-11-28 04:24:40.850767] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:03.573 [2024-11-28 04:24:40.850874] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:03.573 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.831 [2024-11-28 04:24:40.917617] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.831 [2024-11-28 04:24:41.028870] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:03.831 [2024-11-28 04:24:41.029034] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:03.831 [2024-11-28 04:24:41.029053] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:03.831 [2024-11-28 04:24:41.029075] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:03.831 [2024-11-28 04:24:41.029115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:04.765 04:24:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:04.765 04:24:41 -- common/autotest_common.sh@862 -- # return 0 00:18:04.765 04:24:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:04.765 04:24:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:04.765 04:24:41 -- common/autotest_common.sh@10 -- # set +x 00:18:04.765 04:24:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:04.765 04:24:41 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.765 04:24:41 -- common/autotest_common.sh@650 -- # local es=0 00:18:04.765 04:24:41 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.765 04:24:41 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:04.765 04:24:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:04.765 04:24:41 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:04.765 04:24:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:04.765 04:24:41 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.765 04:24:41 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.765 04:24:41 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:04.765 [2024-11-28 04:24:42.053979] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:04.765 04:24:42 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:05.023 04:24:42 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:05.282 [2024-11-28 04:24:42.559360] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:05.282 [2024-11-28 04:24:42.559672] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:05.282 04:24:42 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:05.540 malloc0 00:18:05.540 04:24:42 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:05.798 04:24:43 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.056 [2024-11-28 04:24:43.328573] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:06.056 [2024-11-28 04:24:43.328616] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:06.056 [2024-11-28 04:24:43.328640] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:06.056 request: 00:18:06.056 { 00:18:06.056 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.056 "host": "nqn.2016-06.io.spdk:host1", 00:18:06.056 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:06.056 "method": "nvmf_subsystem_add_host", 00:18:06.056 "req_id": 1 00:18:06.056 } 00:18:06.056 Got JSON-RPC error response 00:18:06.056 response: 00:18:06.056 { 00:18:06.056 "code": -32603, 00:18:06.056 "message": "Internal error" 00:18:06.056 } 00:18:06.056 04:24:43 -- common/autotest_common.sh@653 -- # es=1 00:18:06.056 04:24:43 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:06.056 04:24:43 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:06.056 04:24:43 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:06.056 04:24:43 -- target/tls.sh@189 -- # killprocess 3917298 00:18:06.056 04:24:43 -- common/autotest_common.sh@936 -- # '[' -z 3917298 ']' 00:18:06.056 04:24:43 -- common/autotest_common.sh@940 -- # kill -0 3917298 00:18:06.056 04:24:43 -- common/autotest_common.sh@941 -- # uname 00:18:06.056 04:24:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:06.056 04:24:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3917298 00:18:06.314 04:24:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:06.314 04:24:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:06.314 04:24:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3917298' 00:18:06.314 killing process with pid 3917298 00:18:06.314 04:24:43 -- common/autotest_common.sh@955 -- # kill 3917298 00:18:06.314 04:24:43 -- common/autotest_common.sh@960 -- # wait 3917298 00:18:06.573 04:24:43 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.573 04:24:43 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:06.573 04:24:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:06.573 04:24:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:06.573 04:24:43 -- common/autotest_common.sh@10 -- # set +x 00:18:06.573 04:24:43 -- nvmf/common.sh@469 -- # nvmfpid=3917730 00:18:06.573 04:24:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:06.573 04:24:43 -- nvmf/common.sh@470 -- # waitforlisten 3917730 00:18:06.573 04:24:43 -- common/autotest_common.sh@829 -- # '[' -z 3917730 ']' 00:18:06.573 04:24:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:06.573 04:24:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.573 04:24:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:06.573 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:06.573 04:24:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.573 04:24:43 -- common/autotest_common.sh@10 -- # set +x 00:18:06.573 [2024-11-28 04:24:43.717025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:06.573 [2024-11-28 04:24:43.717117] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:06.573 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.573 [2024-11-28 04:24:43.783734] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.831 [2024-11-28 04:24:43.894434] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:06.831 [2024-11-28 04:24:43.894602] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:06.831 [2024-11-28 04:24:43.894622] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:06.831 [2024-11-28 04:24:43.894634] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:06.831 [2024-11-28 04:24:43.894662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:07.396 04:24:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:07.396 04:24:44 -- common/autotest_common.sh@862 -- # return 0 00:18:07.396 04:24:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:07.396 04:24:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:07.396 04:24:44 -- common/autotest_common.sh@10 -- # set +x 00:18:07.396 04:24:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:07.396 04:24:44 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.396 04:24:44 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.654 04:24:44 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:07.654 [2024-11-28 04:24:44.943227] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:07.654 04:24:44 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:07.912 04:24:45 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:08.169 [2024-11-28 04:24:45.444586] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:08.169 [2024-11-28 04:24:45.444862] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:08.169 04:24:45 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:08.427 malloc0 00:18:08.427 04:24:45 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:08.685 04:24:45 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:08.943 04:24:46 -- target/tls.sh@197 -- # bdevperf_pid=3918030 00:18:08.943 04:24:46 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:08.943 04:24:46 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:08.943 04:24:46 -- target/tls.sh@200 -- # waitforlisten 3918030 /var/tmp/bdevperf.sock 00:18:08.943 04:24:46 -- common/autotest_common.sh@829 -- # '[' -z 3918030 ']' 00:18:08.943 04:24:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:08.943 04:24:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.943 04:24:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:08.943 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:08.943 04:24:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.943 04:24:46 -- common/autotest_common.sh@10 -- # set +x 00:18:09.202 [2024-11-28 04:24:46.260013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:09.202 [2024-11-28 04:24:46.260075] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3918030 ] 00:18:09.202 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.202 [2024-11-28 04:24:46.317060] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:09.202 [2024-11-28 04:24:46.421586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:10.135 04:24:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:10.135 04:24:47 -- common/autotest_common.sh@862 -- # return 0 00:18:10.135 04:24:47 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.393 [2024-11-28 04:24:47.514177] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:10.393 TLSTESTn1 00:18:10.393 04:24:47 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:10.960 04:24:47 -- target/tls.sh@205 -- # tgtconf='{ 00:18:10.960 "subsystems": [ 00:18:10.960 { 00:18:10.960 "subsystem": "iobuf", 00:18:10.960 "config": [ 00:18:10.960 { 00:18:10.960 "method": "iobuf_set_options", 00:18:10.960 "params": { 00:18:10.960 "small_pool_count": 8192, 00:18:10.960 "large_pool_count": 1024, 00:18:10.960 "small_bufsize": 8192, 00:18:10.960 "large_bufsize": 135168 00:18:10.960 } 00:18:10.960 } 00:18:10.960 ] 00:18:10.960 }, 00:18:10.960 { 00:18:10.960 "subsystem": "sock", 00:18:10.960 "config": [ 00:18:10.960 { 00:18:10.960 "method": "sock_impl_set_options", 00:18:10.960 "params": { 00:18:10.960 "impl_name": "posix", 00:18:10.960 "recv_buf_size": 2097152, 00:18:10.960 "send_buf_size": 2097152, 00:18:10.960 "enable_recv_pipe": true, 00:18:10.960 "enable_quickack": false, 00:18:10.960 "enable_placement_id": 0, 00:18:10.960 "enable_zerocopy_send_server": true, 00:18:10.960 "enable_zerocopy_send_client": false, 00:18:10.960 "zerocopy_threshold": 0, 00:18:10.960 "tls_version": 0, 00:18:10.960 "enable_ktls": false 00:18:10.960 } 00:18:10.960 }, 00:18:10.960 { 00:18:10.960 "method": "sock_impl_set_options", 00:18:10.960 "params": { 00:18:10.960 "impl_name": "ssl", 00:18:10.960 "recv_buf_size": 4096, 00:18:10.960 "send_buf_size": 4096, 00:18:10.960 "enable_recv_pipe": true, 00:18:10.960 "enable_quickack": false, 00:18:10.960 "enable_placement_id": 0, 00:18:10.961 "enable_zerocopy_send_server": true, 00:18:10.961 "enable_zerocopy_send_client": false, 00:18:10.961 "zerocopy_threshold": 0, 00:18:10.961 "tls_version": 0, 00:18:10.961 "enable_ktls": false 00:18:10.961 } 00:18:10.961 } 00:18:10.961 ] 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "subsystem": "vmd", 00:18:10.961 "config": [] 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "subsystem": "accel", 00:18:10.961 "config": [ 00:18:10.961 { 00:18:10.961 "method": "accel_set_options", 00:18:10.961 "params": { 00:18:10.961 "small_cache_size": 128, 00:18:10.961 "large_cache_size": 16, 00:18:10.961 "task_count": 2048, 00:18:10.961 "sequence_count": 2048, 00:18:10.961 "buf_count": 2048 00:18:10.961 } 00:18:10.961 } 00:18:10.961 ] 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "subsystem": "bdev", 00:18:10.961 "config": [ 00:18:10.961 { 00:18:10.961 "method": "bdev_set_options", 00:18:10.961 "params": { 00:18:10.961 "bdev_io_pool_size": 65535, 00:18:10.961 "bdev_io_cache_size": 256, 00:18:10.961 "bdev_auto_examine": true, 00:18:10.961 "iobuf_small_cache_size": 128, 00:18:10.961 "iobuf_large_cache_size": 16 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "bdev_raid_set_options", 00:18:10.961 "params": { 00:18:10.961 "process_window_size_kb": 1024 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "bdev_iscsi_set_options", 00:18:10.961 "params": { 00:18:10.961 "timeout_sec": 30 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "bdev_nvme_set_options", 00:18:10.961 "params": { 00:18:10.961 "action_on_timeout": "none", 00:18:10.961 "timeout_us": 0, 00:18:10.961 "timeout_admin_us": 0, 00:18:10.961 "keep_alive_timeout_ms": 10000, 00:18:10.961 "transport_retry_count": 4, 00:18:10.961 "arbitration_burst": 0, 00:18:10.961 "low_priority_weight": 0, 00:18:10.961 "medium_priority_weight": 0, 00:18:10.961 "high_priority_weight": 0, 00:18:10.961 "nvme_adminq_poll_period_us": 10000, 00:18:10.961 "nvme_ioq_poll_period_us": 0, 00:18:10.961 "io_queue_requests": 0, 00:18:10.961 "delay_cmd_submit": true, 00:18:10.961 "bdev_retry_count": 3, 00:18:10.961 "transport_ack_timeout": 0, 00:18:10.961 "ctrlr_loss_timeout_sec": 0, 00:18:10.961 "reconnect_delay_sec": 0, 00:18:10.961 "fast_io_fail_timeout_sec": 0, 00:18:10.961 "generate_uuids": false, 00:18:10.961 "transport_tos": 0, 00:18:10.961 "io_path_stat": false, 00:18:10.961 "allow_accel_sequence": false 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "bdev_nvme_set_hotplug", 00:18:10.961 "params": { 00:18:10.961 "period_us": 100000, 00:18:10.961 "enable": false 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "bdev_malloc_create", 00:18:10.961 "params": { 00:18:10.961 "name": "malloc0", 00:18:10.961 "num_blocks": 8192, 00:18:10.961 "block_size": 4096, 00:18:10.961 "physical_block_size": 4096, 00:18:10.961 "uuid": "ea538214-b93c-46b5-a140-31ccb5fe4797", 00:18:10.961 "optimal_io_boundary": 0 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "bdev_wait_for_examine" 00:18:10.961 } 00:18:10.961 ] 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "subsystem": "nbd", 00:18:10.961 "config": [] 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "subsystem": "scheduler", 00:18:10.961 "config": [ 00:18:10.961 { 00:18:10.961 "method": "framework_set_scheduler", 00:18:10.961 "params": { 00:18:10.961 "name": "static" 00:18:10.961 } 00:18:10.961 } 00:18:10.961 ] 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "subsystem": "nvmf", 00:18:10.961 "config": [ 00:18:10.961 { 00:18:10.961 "method": "nvmf_set_config", 00:18:10.961 "params": { 00:18:10.961 "discovery_filter": "match_any", 00:18:10.961 "admin_cmd_passthru": { 00:18:10.961 "identify_ctrlr": false 00:18:10.961 } 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "nvmf_set_max_subsystems", 00:18:10.961 "params": { 00:18:10.961 "max_subsystems": 1024 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "nvmf_set_crdt", 00:18:10.961 "params": { 00:18:10.961 "crdt1": 0, 00:18:10.961 "crdt2": 0, 00:18:10.961 "crdt3": 0 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "nvmf_create_transport", 00:18:10.961 "params": { 00:18:10.961 "trtype": "TCP", 00:18:10.961 "max_queue_depth": 128, 00:18:10.961 "max_io_qpairs_per_ctrlr": 127, 00:18:10.961 "in_capsule_data_size": 4096, 00:18:10.961 "max_io_size": 131072, 00:18:10.961 "io_unit_size": 131072, 00:18:10.961 "max_aq_depth": 128, 00:18:10.961 "num_shared_buffers": 511, 00:18:10.961 "buf_cache_size": 4294967295, 00:18:10.961 "dif_insert_or_strip": false, 00:18:10.961 "zcopy": false, 00:18:10.961 "c2h_success": false, 00:18:10.961 "sock_priority": 0, 00:18:10.961 "abort_timeout_sec": 1 00:18:10.961 } 00:18:10.961 }, 00:18:10.961 { 00:18:10.961 "method": "nvmf_create_subsystem", 00:18:10.961 "params": { 00:18:10.961 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.961 "allow_any_host": false, 00:18:10.962 "serial_number": "SPDK00000000000001", 00:18:10.962 "model_number": "SPDK bdev Controller", 00:18:10.962 "max_namespaces": 10, 00:18:10.962 "min_cntlid": 1, 00:18:10.962 "max_cntlid": 65519, 00:18:10.962 "ana_reporting": false 00:18:10.962 } 00:18:10.962 }, 00:18:10.962 { 00:18:10.962 "method": "nvmf_subsystem_add_host", 00:18:10.962 "params": { 00:18:10.962 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.962 "host": "nqn.2016-06.io.spdk:host1", 00:18:10.962 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:10.962 } 00:18:10.962 }, 00:18:10.962 { 00:18:10.962 "method": "nvmf_subsystem_add_ns", 00:18:10.962 "params": { 00:18:10.962 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.962 "namespace": { 00:18:10.962 "nsid": 1, 00:18:10.962 "bdev_name": "malloc0", 00:18:10.962 "nguid": "EA538214B93C46B5A14031CCB5FE4797", 00:18:10.962 "uuid": "ea538214-b93c-46b5-a140-31ccb5fe4797" 00:18:10.962 } 00:18:10.962 } 00:18:10.962 }, 00:18:10.962 { 00:18:10.962 "method": "nvmf_subsystem_add_listener", 00:18:10.962 "params": { 00:18:10.962 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:10.962 "listen_address": { 00:18:10.962 "trtype": "TCP", 00:18:10.962 "adrfam": "IPv4", 00:18:10.962 "traddr": "10.0.0.2", 00:18:10.962 "trsvcid": "4420" 00:18:10.962 }, 00:18:10.962 "secure_channel": true 00:18:10.962 } 00:18:10.962 } 00:18:10.962 ] 00:18:10.962 } 00:18:10.962 ] 00:18:10.962 }' 00:18:10.962 04:24:47 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:11.221 04:24:48 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:11.221 "subsystems": [ 00:18:11.221 { 00:18:11.221 "subsystem": "iobuf", 00:18:11.221 "config": [ 00:18:11.221 { 00:18:11.221 "method": "iobuf_set_options", 00:18:11.221 "params": { 00:18:11.221 "small_pool_count": 8192, 00:18:11.221 "large_pool_count": 1024, 00:18:11.221 "small_bufsize": 8192, 00:18:11.221 "large_bufsize": 135168 00:18:11.221 } 00:18:11.221 } 00:18:11.221 ] 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "subsystem": "sock", 00:18:11.221 "config": [ 00:18:11.221 { 00:18:11.221 "method": "sock_impl_set_options", 00:18:11.221 "params": { 00:18:11.221 "impl_name": "posix", 00:18:11.221 "recv_buf_size": 2097152, 00:18:11.221 "send_buf_size": 2097152, 00:18:11.221 "enable_recv_pipe": true, 00:18:11.221 "enable_quickack": false, 00:18:11.221 "enable_placement_id": 0, 00:18:11.221 "enable_zerocopy_send_server": true, 00:18:11.221 "enable_zerocopy_send_client": false, 00:18:11.221 "zerocopy_threshold": 0, 00:18:11.221 "tls_version": 0, 00:18:11.221 "enable_ktls": false 00:18:11.221 } 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "method": "sock_impl_set_options", 00:18:11.221 "params": { 00:18:11.221 "impl_name": "ssl", 00:18:11.221 "recv_buf_size": 4096, 00:18:11.221 "send_buf_size": 4096, 00:18:11.221 "enable_recv_pipe": true, 00:18:11.221 "enable_quickack": false, 00:18:11.221 "enable_placement_id": 0, 00:18:11.221 "enable_zerocopy_send_server": true, 00:18:11.221 "enable_zerocopy_send_client": false, 00:18:11.221 "zerocopy_threshold": 0, 00:18:11.221 "tls_version": 0, 00:18:11.221 "enable_ktls": false 00:18:11.221 } 00:18:11.221 } 00:18:11.221 ] 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "subsystem": "vmd", 00:18:11.221 "config": [] 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "subsystem": "accel", 00:18:11.221 "config": [ 00:18:11.221 { 00:18:11.221 "method": "accel_set_options", 00:18:11.221 "params": { 00:18:11.221 "small_cache_size": 128, 00:18:11.221 "large_cache_size": 16, 00:18:11.221 "task_count": 2048, 00:18:11.221 "sequence_count": 2048, 00:18:11.221 "buf_count": 2048 00:18:11.221 } 00:18:11.221 } 00:18:11.221 ] 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "subsystem": "bdev", 00:18:11.221 "config": [ 00:18:11.221 { 00:18:11.221 "method": "bdev_set_options", 00:18:11.221 "params": { 00:18:11.221 "bdev_io_pool_size": 65535, 00:18:11.221 "bdev_io_cache_size": 256, 00:18:11.221 "bdev_auto_examine": true, 00:18:11.221 "iobuf_small_cache_size": 128, 00:18:11.221 "iobuf_large_cache_size": 16 00:18:11.221 } 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "method": "bdev_raid_set_options", 00:18:11.221 "params": { 00:18:11.221 "process_window_size_kb": 1024 00:18:11.221 } 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "method": "bdev_iscsi_set_options", 00:18:11.221 "params": { 00:18:11.221 "timeout_sec": 30 00:18:11.221 } 00:18:11.221 }, 00:18:11.221 { 00:18:11.221 "method": "bdev_nvme_set_options", 00:18:11.221 "params": { 00:18:11.221 "action_on_timeout": "none", 00:18:11.221 "timeout_us": 0, 00:18:11.221 "timeout_admin_us": 0, 00:18:11.221 "keep_alive_timeout_ms": 10000, 00:18:11.221 "transport_retry_count": 4, 00:18:11.221 "arbitration_burst": 0, 00:18:11.221 "low_priority_weight": 0, 00:18:11.221 "medium_priority_weight": 0, 00:18:11.221 "high_priority_weight": 0, 00:18:11.221 "nvme_adminq_poll_period_us": 10000, 00:18:11.221 "nvme_ioq_poll_period_us": 0, 00:18:11.221 "io_queue_requests": 512, 00:18:11.221 "delay_cmd_submit": true, 00:18:11.221 "bdev_retry_count": 3, 00:18:11.221 "transport_ack_timeout": 0, 00:18:11.221 "ctrlr_loss_timeout_sec": 0, 00:18:11.221 "reconnect_delay_sec": 0, 00:18:11.221 "fast_io_fail_timeout_sec": 0, 00:18:11.221 "generate_uuids": false, 00:18:11.221 "transport_tos": 0, 00:18:11.221 "io_path_stat": false, 00:18:11.221 "allow_accel_sequence": false 00:18:11.222 } 00:18:11.222 }, 00:18:11.222 { 00:18:11.222 "method": "bdev_nvme_attach_controller", 00:18:11.222 "params": { 00:18:11.222 "name": "TLSTEST", 00:18:11.222 "trtype": "TCP", 00:18:11.222 "adrfam": "IPv4", 00:18:11.222 "traddr": "10.0.0.2", 00:18:11.222 "trsvcid": "4420", 00:18:11.222 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.222 "prchk_reftag": false, 00:18:11.222 "prchk_guard": false, 00:18:11.222 "ctrlr_loss_timeout_sec": 0, 00:18:11.222 "reconnect_delay_sec": 0, 00:18:11.222 "fast_io_fail_timeout_sec": 0, 00:18:11.222 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:11.222 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:11.222 "hdgst": false, 00:18:11.222 "ddgst": false 00:18:11.222 } 00:18:11.222 }, 00:18:11.222 { 00:18:11.222 "method": "bdev_nvme_set_hotplug", 00:18:11.222 "params": { 00:18:11.222 "period_us": 100000, 00:18:11.222 "enable": false 00:18:11.222 } 00:18:11.222 }, 00:18:11.222 { 00:18:11.222 "method": "bdev_wait_for_examine" 00:18:11.222 } 00:18:11.222 ] 00:18:11.222 }, 00:18:11.222 { 00:18:11.222 "subsystem": "nbd", 00:18:11.222 "config": [] 00:18:11.222 } 00:18:11.222 ] 00:18:11.222 }' 00:18:11.222 04:24:48 -- target/tls.sh@208 -- # killprocess 3918030 00:18:11.222 04:24:48 -- common/autotest_common.sh@936 -- # '[' -z 3918030 ']' 00:18:11.222 04:24:48 -- common/autotest_common.sh@940 -- # kill -0 3918030 00:18:11.222 04:24:48 -- common/autotest_common.sh@941 -- # uname 00:18:11.222 04:24:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:11.222 04:24:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3918030 00:18:11.222 04:24:48 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:11.222 04:24:48 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:11.222 04:24:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3918030' 00:18:11.222 killing process with pid 3918030 00:18:11.222 04:24:48 -- common/autotest_common.sh@955 -- # kill 3918030 00:18:11.222 Received shutdown signal, test time was about 10.000000 seconds 00:18:11.222 00:18:11.222 Latency(us) 00:18:11.222 [2024-11-28T03:24:48.533Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:11.222 [2024-11-28T03:24:48.533Z] =================================================================================================================== 00:18:11.222 [2024-11-28T03:24:48.533Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:11.222 04:24:48 -- common/autotest_common.sh@960 -- # wait 3918030 00:18:11.480 04:24:48 -- target/tls.sh@209 -- # killprocess 3917730 00:18:11.480 04:24:48 -- common/autotest_common.sh@936 -- # '[' -z 3917730 ']' 00:18:11.480 04:24:48 -- common/autotest_common.sh@940 -- # kill -0 3917730 00:18:11.480 04:24:48 -- common/autotest_common.sh@941 -- # uname 00:18:11.480 04:24:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:11.480 04:24:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3917730 00:18:11.480 04:24:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:11.480 04:24:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:11.480 04:24:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3917730' 00:18:11.480 killing process with pid 3917730 00:18:11.480 04:24:48 -- common/autotest_common.sh@955 -- # kill 3917730 00:18:11.480 04:24:48 -- common/autotest_common.sh@960 -- # wait 3917730 00:18:11.739 04:24:48 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:11.739 04:24:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:11.739 04:24:48 -- target/tls.sh@212 -- # echo '{ 00:18:11.739 "subsystems": [ 00:18:11.739 { 00:18:11.739 "subsystem": "iobuf", 00:18:11.739 "config": [ 00:18:11.739 { 00:18:11.739 "method": "iobuf_set_options", 00:18:11.739 "params": { 00:18:11.739 "small_pool_count": 8192, 00:18:11.739 "large_pool_count": 1024, 00:18:11.739 "small_bufsize": 8192, 00:18:11.739 "large_bufsize": 135168 00:18:11.739 } 00:18:11.739 } 00:18:11.739 ] 00:18:11.739 }, 00:18:11.739 { 00:18:11.739 "subsystem": "sock", 00:18:11.739 "config": [ 00:18:11.739 { 00:18:11.739 "method": "sock_impl_set_options", 00:18:11.739 "params": { 00:18:11.739 "impl_name": "posix", 00:18:11.739 "recv_buf_size": 2097152, 00:18:11.739 "send_buf_size": 2097152, 00:18:11.740 "enable_recv_pipe": true, 00:18:11.740 "enable_quickack": false, 00:18:11.740 "enable_placement_id": 0, 00:18:11.740 "enable_zerocopy_send_server": true, 00:18:11.740 "enable_zerocopy_send_client": false, 00:18:11.740 "zerocopy_threshold": 0, 00:18:11.740 "tls_version": 0, 00:18:11.740 "enable_ktls": false 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "sock_impl_set_options", 00:18:11.740 "params": { 00:18:11.740 "impl_name": "ssl", 00:18:11.740 "recv_buf_size": 4096, 00:18:11.740 "send_buf_size": 4096, 00:18:11.740 "enable_recv_pipe": true, 00:18:11.740 "enable_quickack": false, 00:18:11.740 "enable_placement_id": 0, 00:18:11.740 "enable_zerocopy_send_server": true, 00:18:11.740 "enable_zerocopy_send_client": false, 00:18:11.740 "zerocopy_threshold": 0, 00:18:11.740 "tls_version": 0, 00:18:11.740 "enable_ktls": false 00:18:11.740 } 00:18:11.740 } 00:18:11.740 ] 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "subsystem": "vmd", 00:18:11.740 "config": [] 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "subsystem": "accel", 00:18:11.740 "config": [ 00:18:11.740 { 00:18:11.740 "method": "accel_set_options", 00:18:11.740 "params": { 00:18:11.740 "small_cache_size": 128, 00:18:11.740 "large_cache_size": 16, 00:18:11.740 "task_count": 2048, 00:18:11.740 "sequence_count": 2048, 00:18:11.740 "buf_count": 2048 00:18:11.740 } 00:18:11.740 } 00:18:11.740 ] 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "subsystem": "bdev", 00:18:11.740 "config": [ 00:18:11.740 { 00:18:11.740 "method": "bdev_set_options", 00:18:11.740 "params": { 00:18:11.740 "bdev_io_pool_size": 65535, 00:18:11.740 "bdev_io_cache_size": 256, 00:18:11.740 "bdev_auto_examine": true, 00:18:11.740 "iobuf_small_cache_size": 128, 00:18:11.740 "iobuf_large_cache_size": 16 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "bdev_raid_set_options", 00:18:11.740 "params": { 00:18:11.740 "process_window_size_kb": 1024 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "bdev_iscsi_set_options", 00:18:11.740 "params": { 00:18:11.740 "timeout_sec": 30 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "bdev_nvme_set_options", 00:18:11.740 "params": { 00:18:11.740 "action_on_timeout": "none", 00:18:11.740 "timeout_us": 0, 00:18:11.740 "timeout_admin_us": 0, 00:18:11.740 "keep_alive_timeout_ms": 10000, 00:18:11.740 "transport_retry_count": 4, 00:18:11.740 "arbitration_burst": 0, 00:18:11.740 "low_priority_weight": 0, 00:18:11.740 "medium_priority_weight": 0, 00:18:11.740 "high_priority_weight": 0, 00:18:11.740 "nvme_adminq_poll_period_us": 10000, 00:18:11.740 "nvme_ioq_poll_period_us": 0, 00:18:11.740 "io_queue_requests": 0, 00:18:11.740 "delay_cmd_submit": true, 00:18:11.740 "bdev_retry_count": 3, 00:18:11.740 "transport_ack_timeout": 0, 00:18:11.740 "ctrlr_loss_timeout_sec": 0, 00:18:11.740 "reconnect_delay_sec": 0, 00:18:11.740 "fast_io_fail_timeout_sec": 0, 00:18:11.740 "generate_uuids": false, 00:18:11.740 "transport_tos": 0, 00:18:11.740 "io_path_stat": false, 00:18:11.740 "allow_accel_sequence": false 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "bdev_nvme_set_hotplug", 00:18:11.740 "params": { 00:18:11.740 "period_us": 100000, 00:18:11.740 "enable": false 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "bdev_malloc_create", 00:18:11.740 "params": { 00:18:11.740 "name": "malloc0", 00:18:11.740 "num_blocks": 8192, 00:18:11.740 "block_size": 4096, 00:18:11.740 "physical_block_size": 4096, 00:18:11.740 "uuid": "ea538214-b93c-46b5-a140-31ccb5fe4797", 00:18:11.740 "optimal_io_boundary": 0 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "bdev_wait_for_examine" 00:18:11.740 } 00:18:11.740 ] 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "subsystem": "nbd", 00:18:11.740 "config": [] 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "subsystem": "scheduler", 00:18:11.740 "config": [ 00:18:11.740 { 00:18:11.740 "method": "framework_set_scheduler", 00:18:11.740 "params": { 00:18:11.740 "name": "static" 00:18:11.740 } 00:18:11.740 } 00:18:11.740 ] 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "subsystem": "nvmf", 00:18:11.740 "config": [ 00:18:11.740 { 00:18:11.740 "method": "nvmf_set_config", 00:18:11.740 "params": { 00:18:11.740 "discovery_filter": "match_any", 00:18:11.740 "admin_cmd_passthru": { 00:18:11.740 "identify_ctrlr": false 00:18:11.740 } 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "nvmf_set_max_subsystems", 00:18:11.740 "params": { 00:18:11.740 "max_subsystems": 1024 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "nvmf_set_crdt", 00:18:11.740 "params": { 00:18:11.740 "crdt1": 0, 00:18:11.740 "crdt2": 0, 00:18:11.740 "crdt3": 0 00:18:11.740 } 00:18:11.740 }, 00:18:11.740 { 00:18:11.740 "method": "nvmf_create_transport", 00:18:11.740 "params": { 00:18:11.740 "trtype": "TCP", 00:18:11.740 "max_queue_depth": 128, 00:18:11.740 "max_io_qpairs_per_ctrlr": 127, 00:18:11.740 "in_capsule_data_size": 4096, 00:18:11.741 "max_io_size": 131072, 00:18:11.741 "io_unit_size": 131072, 00:18:11.741 "max_aq_depth": 128, 00:18:11.741 "num_shared_buffers": 511, 00:18:11.741 "buf_cache_size": 4294967295, 00:18:11.741 "dif_insert_or_strip": false, 00:18:11.741 "zcopy": false, 00:18:11.741 "c2h_success": false, 00:18:11.741 "sock_priority": 0, 00:18:11.741 "abort_timeout_sec": 1 00:18:11.741 } 00:18:11.741 }, 00:18:11.741 { 00:18:11.741 "method": "nvmf_create_subsystem", 00:18:11.741 "params": { 00:18:11.741 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.741 "allow_any_host": false, 00:18:11.741 "serial_number": "SPDK00000000000001", 00:18:11.741 "model_number": "SPDK bdev Controller", 00:18:11.741 "max_namespaces": 10, 00:18:11.741 "min_cntlid": 1, 00:18:11.741 "max_cntlid": 65519, 00:18:11.741 "ana_reporting": false 00:18:11.741 } 00:18:11.741 }, 00:18:11.741 { 00:18:11.741 "method": "nvmf_subsystem_add_host", 00:18:11.741 "params": { 00:18:11.741 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.741 "host": "nqn.2016-06.io.spdk:host1", 00:18:11.741 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:11.741 } 00:18:11.741 }, 00:18:11.741 { 00:18:11.741 "method": "nvmf_subsystem_add_ns", 00:18:11.741 "params": { 00:18:11.741 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.741 "namespace": { 00:18:11.741 "nsid": 1, 00:18:11.741 "bdev_name": "malloc0", 00:18:11.741 "nguid": "EA538214B93C46B5A14031CCB5FE4797", 00:18:11.741 "uuid": "ea538214-b93c-46b5-a140-31ccb5fe4797" 00:18:11.741 } 00:18:11.741 } 00:18:11.741 }, 00:18:11.741 { 00:18:11.741 "method": "nvmf_subsystem_add_listener", 00:18:11.741 "params": { 00:18:11.741 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:11.741 "listen_address": { 00:18:11.741 "trtype": "TCP", 00:18:11.741 "adrfam": "IPv4", 00:18:11.741 "traddr": "10.0.0.2", 00:18:11.741 "trsvcid": "4420" 00:18:11.741 }, 00:18:11.741 "secure_channel": true 00:18:11.741 } 00:18:11.741 } 00:18:11.741 ] 00:18:11.741 } 00:18:11.741 ] 00:18:11.741 }' 00:18:11.741 04:24:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:11.741 04:24:48 -- common/autotest_common.sh@10 -- # set +x 00:18:11.741 04:24:48 -- nvmf/common.sh@469 -- # nvmfpid=3918326 00:18:11.741 04:24:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:11.741 04:24:48 -- nvmf/common.sh@470 -- # waitforlisten 3918326 00:18:11.741 04:24:48 -- common/autotest_common.sh@829 -- # '[' -z 3918326 ']' 00:18:11.741 04:24:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:11.741 04:24:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:11.741 04:24:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:11.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:11.741 04:24:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:11.741 04:24:48 -- common/autotest_common.sh@10 -- # set +x 00:18:11.741 [2024-11-28 04:24:48.980270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:11.741 [2024-11-28 04:24:48.980357] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:11.741 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.741 [2024-11-28 04:24:49.046235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:11.999 [2024-11-28 04:24:49.165521] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:11.999 [2024-11-28 04:24:49.165693] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:12.000 [2024-11-28 04:24:49.165712] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:12.000 [2024-11-28 04:24:49.165724] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:12.000 [2024-11-28 04:24:49.165752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:12.257 [2024-11-28 04:24:49.389978] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:12.258 [2024-11-28 04:24:49.421991] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:12.258 [2024-11-28 04:24:49.422244] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:12.824 04:24:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:12.824 04:24:49 -- common/autotest_common.sh@862 -- # return 0 00:18:12.824 04:24:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:12.824 04:24:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:12.824 04:24:49 -- common/autotest_common.sh@10 -- # set +x 00:18:12.824 04:24:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:12.824 04:24:49 -- target/tls.sh@216 -- # bdevperf_pid=3918485 00:18:12.824 04:24:49 -- target/tls.sh@217 -- # waitforlisten 3918485 /var/tmp/bdevperf.sock 00:18:12.824 04:24:49 -- common/autotest_common.sh@829 -- # '[' -z 3918485 ']' 00:18:12.824 04:24:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:12.824 04:24:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:12.824 04:24:49 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:12.824 04:24:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:12.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:12.824 04:24:49 -- target/tls.sh@213 -- # echo '{ 00:18:12.824 "subsystems": [ 00:18:12.824 { 00:18:12.824 "subsystem": "iobuf", 00:18:12.824 "config": [ 00:18:12.824 { 00:18:12.824 "method": "iobuf_set_options", 00:18:12.824 "params": { 00:18:12.824 "small_pool_count": 8192, 00:18:12.824 "large_pool_count": 1024, 00:18:12.824 "small_bufsize": 8192, 00:18:12.824 "large_bufsize": 135168 00:18:12.824 } 00:18:12.824 } 00:18:12.824 ] 00:18:12.824 }, 00:18:12.824 { 00:18:12.824 "subsystem": "sock", 00:18:12.824 "config": [ 00:18:12.824 { 00:18:12.824 "method": "sock_impl_set_options", 00:18:12.824 "params": { 00:18:12.824 "impl_name": "posix", 00:18:12.824 "recv_buf_size": 2097152, 00:18:12.824 "send_buf_size": 2097152, 00:18:12.824 "enable_recv_pipe": true, 00:18:12.824 "enable_quickack": false, 00:18:12.824 "enable_placement_id": 0, 00:18:12.824 "enable_zerocopy_send_server": true, 00:18:12.824 "enable_zerocopy_send_client": false, 00:18:12.824 "zerocopy_threshold": 0, 00:18:12.824 "tls_version": 0, 00:18:12.824 "enable_ktls": false 00:18:12.824 } 00:18:12.824 }, 00:18:12.824 { 00:18:12.824 "method": "sock_impl_set_options", 00:18:12.824 "params": { 00:18:12.824 "impl_name": "ssl", 00:18:12.824 "recv_buf_size": 4096, 00:18:12.824 "send_buf_size": 4096, 00:18:12.824 "enable_recv_pipe": true, 00:18:12.824 "enable_quickack": false, 00:18:12.824 "enable_placement_id": 0, 00:18:12.824 "enable_zerocopy_send_server": true, 00:18:12.824 "enable_zerocopy_send_client": false, 00:18:12.824 "zerocopy_threshold": 0, 00:18:12.824 "tls_version": 0, 00:18:12.824 "enable_ktls": false 00:18:12.824 } 00:18:12.824 } 00:18:12.824 ] 00:18:12.824 }, 00:18:12.824 { 00:18:12.824 "subsystem": "vmd", 00:18:12.824 "config": [] 00:18:12.824 }, 00:18:12.824 { 00:18:12.824 "subsystem": "accel", 00:18:12.824 "config": [ 00:18:12.824 { 00:18:12.824 "method": "accel_set_options", 00:18:12.824 "params": { 00:18:12.824 "small_cache_size": 128, 00:18:12.824 "large_cache_size": 16, 00:18:12.824 "task_count": 2048, 00:18:12.824 "sequence_count": 2048, 00:18:12.824 "buf_count": 2048 00:18:12.824 } 00:18:12.824 } 00:18:12.824 ] 00:18:12.824 }, 00:18:12.824 { 00:18:12.824 "subsystem": "bdev", 00:18:12.824 "config": [ 00:18:12.824 { 00:18:12.824 "method": "bdev_set_options", 00:18:12.824 "params": { 00:18:12.824 "bdev_io_pool_size": 65535, 00:18:12.824 "bdev_io_cache_size": 256, 00:18:12.824 "bdev_auto_examine": true, 00:18:12.825 "iobuf_small_cache_size": 128, 00:18:12.825 "iobuf_large_cache_size": 16 00:18:12.825 } 00:18:12.825 }, 00:18:12.825 { 00:18:12.825 "method": "bdev_raid_set_options", 00:18:12.825 "params": { 00:18:12.825 "process_window_size_kb": 1024 00:18:12.825 } 00:18:12.825 }, 00:18:12.825 { 00:18:12.825 "method": "bdev_iscsi_set_options", 00:18:12.825 "params": { 00:18:12.825 "timeout_sec": 30 00:18:12.825 } 00:18:12.825 }, 00:18:12.825 { 00:18:12.825 "method": "bdev_nvme_set_options", 00:18:12.825 "params": { 00:18:12.825 "action_on_timeout": "none", 00:18:12.825 "timeout_us": 0, 00:18:12.825 "timeout_admin_us": 0, 00:18:12.825 "keep_alive_timeout_ms": 10000, 00:18:12.825 "transport_retry_count": 4, 00:18:12.825 "arbitration_burst": 0, 00:18:12.825 "low_priority_weight": 0, 00:18:12.825 "medium_priority_weight": 0, 00:18:12.825 "high_priority_weight": 0, 00:18:12.825 "nvme_adminq_poll_period_us": 10000, 00:18:12.825 "nvme_ioq_poll_period_us": 0, 00:18:12.825 "io_queue_requests": 512, 00:18:12.825 "delay_cmd_submit": true, 00:18:12.825 "bdev_retry_count": 3, 00:18:12.825 "transport_ack_timeout": 0, 00:18:12.825 "ctrlr_loss_timeout_sec": 0, 00:18:12.825 "reconnect_delay_sec": 0, 00:18:12.825 "fast_io_fail_timeout_sec": 0, 00:18:12.825 "generate_uuids": false, 00:18:12.825 "transport_tos": 0, 00:18:12.825 "io_path_stat": false, 00:18:12.825 "allow_accel_sequence": false 00:18:12.825 } 00:18:12.825 }, 00:18:12.825 { 00:18:12.825 "method": "bdev_nvme_attach_controller", 00:18:12.825 "params": { 00:18:12.825 "name": "TLSTEST", 00:18:12.825 "trtype": "TCP", 00:18:12.825 "adrfam": "IPv4", 00:18:12.825 "traddr": "10.0.0.2", 00:18:12.825 "trsvcid": "4420", 00:18:12.825 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:12.825 "prchk_reftag": false, 00:18:12.825 "prchk_guard": false, 00:18:12.825 "ctrlr_loss_timeout_sec": 0, 00:18:12.825 "reconnect_delay_sec": 0, 00:18:12.825 "fast_io_fail_timeout_sec": 0, 00:18:12.825 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:12.825 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:12.825 "hdgst": false, 00:18:12.825 "ddgst": false 00:18:12.825 } 00:18:12.825 }, 00:18:12.825 { 00:18:12.825 "method": "bdev_nvme_set_hotplug", 00:18:12.825 "params": { 00:18:12.825 "period_us": 100000, 00:18:12.825 "enable": false 00:18:12.825 } 00:18:12.825 }, 00:18:12.825 { 00:18:12.825 "method": "bdev_wait_for_examine" 00:18:12.825 } 00:18:12.825 ] 00:18:12.825 }, 00:18:12.825 { 00:18:12.825 "subsystem": "nbd", 00:18:12.825 "config": [] 00:18:12.825 } 00:18:12.825 ] 00:18:12.825 }' 00:18:12.825 04:24:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:12.825 04:24:49 -- common/autotest_common.sh@10 -- # set +x 00:18:12.825 [2024-11-28 04:24:50.002656] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:12.825 [2024-11-28 04:24:50.002737] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3918485 ] 00:18:12.825 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.825 [2024-11-28 04:24:50.064377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:13.083 [2024-11-28 04:24:50.170758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:13.084 [2024-11-28 04:24:50.329425] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:14.019 04:24:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:14.019 04:24:50 -- common/autotest_common.sh@862 -- # return 0 00:18:14.019 04:24:50 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:14.019 Running I/O for 10 seconds... 00:18:23.985 00:18:23.985 Latency(us) 00:18:23.985 [2024-11-28T03:25:01.296Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:23.985 [2024-11-28T03:25:01.296Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:23.985 Verification LBA range: start 0x0 length 0x2000 00:18:23.985 TLSTESTn1 : 10.01 4398.41 17.18 0.00 0.00 29063.51 4563.25 43108.12 00:18:23.985 [2024-11-28T03:25:01.297Z] =================================================================================================================== 00:18:23.986 [2024-11-28T03:25:01.297Z] Total : 4398.41 17.18 0.00 0.00 29063.51 4563.25 43108.12 00:18:23.986 0 00:18:23.986 04:25:01 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:23.986 04:25:01 -- target/tls.sh@223 -- # killprocess 3918485 00:18:23.986 04:25:01 -- common/autotest_common.sh@936 -- # '[' -z 3918485 ']' 00:18:23.986 04:25:01 -- common/autotest_common.sh@940 -- # kill -0 3918485 00:18:23.986 04:25:01 -- common/autotest_common.sh@941 -- # uname 00:18:23.986 04:25:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:23.986 04:25:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3918485 00:18:23.986 04:25:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:23.986 04:25:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:23.986 04:25:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3918485' 00:18:23.986 killing process with pid 3918485 00:18:23.986 04:25:01 -- common/autotest_common.sh@955 -- # kill 3918485 00:18:23.986 Received shutdown signal, test time was about 10.000000 seconds 00:18:23.986 00:18:23.986 Latency(us) 00:18:23.986 [2024-11-28T03:25:01.297Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:23.986 [2024-11-28T03:25:01.297Z] =================================================================================================================== 00:18:23.986 [2024-11-28T03:25:01.297Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:23.986 04:25:01 -- common/autotest_common.sh@960 -- # wait 3918485 00:18:24.243 04:25:01 -- target/tls.sh@224 -- # killprocess 3918326 00:18:24.243 04:25:01 -- common/autotest_common.sh@936 -- # '[' -z 3918326 ']' 00:18:24.243 04:25:01 -- common/autotest_common.sh@940 -- # kill -0 3918326 00:18:24.243 04:25:01 -- common/autotest_common.sh@941 -- # uname 00:18:24.243 04:25:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:24.243 04:25:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3918326 00:18:24.243 04:25:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:24.243 04:25:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:24.243 04:25:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3918326' 00:18:24.243 killing process with pid 3918326 00:18:24.243 04:25:01 -- common/autotest_common.sh@955 -- # kill 3918326 00:18:24.243 04:25:01 -- common/autotest_common.sh@960 -- # wait 3918326 00:18:24.501 04:25:01 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:24.501 04:25:01 -- target/tls.sh@227 -- # cleanup 00:18:24.501 04:25:01 -- target/tls.sh@15 -- # process_shm --id 0 00:18:24.501 04:25:01 -- common/autotest_common.sh@806 -- # type=--id 00:18:24.501 04:25:01 -- common/autotest_common.sh@807 -- # id=0 00:18:24.501 04:25:01 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:24.501 04:25:01 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:24.501 04:25:01 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:24.501 04:25:01 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:24.501 04:25:01 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:24.501 04:25:01 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:24.501 nvmf_trace.0 00:18:24.501 04:25:01 -- common/autotest_common.sh@821 -- # return 0 00:18:24.501 04:25:01 -- target/tls.sh@16 -- # killprocess 3918485 00:18:24.501 04:25:01 -- common/autotest_common.sh@936 -- # '[' -z 3918485 ']' 00:18:24.501 04:25:01 -- common/autotest_common.sh@940 -- # kill -0 3918485 00:18:24.501 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3918485) - No such process 00:18:24.501 04:25:01 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3918485 is not found' 00:18:24.501 Process with pid 3918485 is not found 00:18:24.501 04:25:01 -- target/tls.sh@17 -- # nvmftestfini 00:18:24.501 04:25:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:24.501 04:25:01 -- nvmf/common.sh@116 -- # sync 00:18:24.759 04:25:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:24.759 04:25:01 -- nvmf/common.sh@119 -- # set +e 00:18:24.759 04:25:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:24.759 04:25:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:24.759 rmmod nvme_tcp 00:18:24.759 rmmod nvme_fabrics 00:18:24.759 rmmod nvme_keyring 00:18:24.759 04:25:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:24.759 04:25:01 -- nvmf/common.sh@123 -- # set -e 00:18:24.759 04:25:01 -- nvmf/common.sh@124 -- # return 0 00:18:24.759 04:25:01 -- nvmf/common.sh@477 -- # '[' -n 3918326 ']' 00:18:24.759 04:25:01 -- nvmf/common.sh@478 -- # killprocess 3918326 00:18:24.759 04:25:01 -- common/autotest_common.sh@936 -- # '[' -z 3918326 ']' 00:18:24.759 04:25:01 -- common/autotest_common.sh@940 -- # kill -0 3918326 00:18:24.759 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3918326) - No such process 00:18:24.759 04:25:01 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3918326 is not found' 00:18:24.759 Process with pid 3918326 is not found 00:18:24.759 04:25:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:24.759 04:25:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:24.759 04:25:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:24.759 04:25:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:24.759 04:25:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:24.759 04:25:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:24.759 04:25:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:24.759 04:25:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:26.660 04:25:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:26.660 04:25:03 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:26.660 00:18:26.660 real 1m15.503s 00:18:26.660 user 2m2.705s 00:18:26.660 sys 0m23.388s 00:18:26.660 04:25:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:26.660 04:25:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.660 ************************************ 00:18:26.660 END TEST nvmf_tls 00:18:26.660 ************************************ 00:18:26.660 04:25:03 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:26.660 04:25:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:26.660 04:25:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:26.660 04:25:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.660 ************************************ 00:18:26.660 START TEST nvmf_fips 00:18:26.660 ************************************ 00:18:26.660 04:25:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:26.919 * Looking for test storage... 00:18:26.919 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:26.919 04:25:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:26.919 04:25:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:26.919 04:25:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:26.919 04:25:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:26.919 04:25:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:26.919 04:25:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:26.919 04:25:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:26.919 04:25:04 -- scripts/common.sh@335 -- # IFS=.-: 00:18:26.919 04:25:04 -- scripts/common.sh@335 -- # read -ra ver1 00:18:26.919 04:25:04 -- scripts/common.sh@336 -- # IFS=.-: 00:18:26.919 04:25:04 -- scripts/common.sh@336 -- # read -ra ver2 00:18:26.919 04:25:04 -- scripts/common.sh@337 -- # local 'op=<' 00:18:26.919 04:25:04 -- scripts/common.sh@339 -- # ver1_l=2 00:18:26.919 04:25:04 -- scripts/common.sh@340 -- # ver2_l=1 00:18:26.919 04:25:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:26.919 04:25:04 -- scripts/common.sh@343 -- # case "$op" in 00:18:26.919 04:25:04 -- scripts/common.sh@344 -- # : 1 00:18:26.919 04:25:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:26.919 04:25:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:26.919 04:25:04 -- scripts/common.sh@364 -- # decimal 1 00:18:26.919 04:25:04 -- scripts/common.sh@352 -- # local d=1 00:18:26.919 04:25:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:26.919 04:25:04 -- scripts/common.sh@354 -- # echo 1 00:18:26.919 04:25:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:26.919 04:25:04 -- scripts/common.sh@365 -- # decimal 2 00:18:26.919 04:25:04 -- scripts/common.sh@352 -- # local d=2 00:18:26.919 04:25:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:26.919 04:25:04 -- scripts/common.sh@354 -- # echo 2 00:18:26.919 04:25:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:26.919 04:25:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:26.919 04:25:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:26.919 04:25:04 -- scripts/common.sh@367 -- # return 0 00:18:26.919 04:25:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:26.919 04:25:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:26.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.919 --rc genhtml_branch_coverage=1 00:18:26.919 --rc genhtml_function_coverage=1 00:18:26.919 --rc genhtml_legend=1 00:18:26.919 --rc geninfo_all_blocks=1 00:18:26.919 --rc geninfo_unexecuted_blocks=1 00:18:26.919 00:18:26.919 ' 00:18:26.919 04:25:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:26.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.919 --rc genhtml_branch_coverage=1 00:18:26.919 --rc genhtml_function_coverage=1 00:18:26.919 --rc genhtml_legend=1 00:18:26.919 --rc geninfo_all_blocks=1 00:18:26.919 --rc geninfo_unexecuted_blocks=1 00:18:26.919 00:18:26.919 ' 00:18:26.919 04:25:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:26.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.919 --rc genhtml_branch_coverage=1 00:18:26.919 --rc genhtml_function_coverage=1 00:18:26.919 --rc genhtml_legend=1 00:18:26.919 --rc geninfo_all_blocks=1 00:18:26.919 --rc geninfo_unexecuted_blocks=1 00:18:26.919 00:18:26.919 ' 00:18:26.919 04:25:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:26.919 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.919 --rc genhtml_branch_coverage=1 00:18:26.919 --rc genhtml_function_coverage=1 00:18:26.919 --rc genhtml_legend=1 00:18:26.919 --rc geninfo_all_blocks=1 00:18:26.919 --rc geninfo_unexecuted_blocks=1 00:18:26.919 00:18:26.919 ' 00:18:26.919 04:25:04 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:26.919 04:25:04 -- nvmf/common.sh@7 -- # uname -s 00:18:26.919 04:25:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:26.919 04:25:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:26.919 04:25:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:26.919 04:25:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:26.919 04:25:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:26.919 04:25:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:26.919 04:25:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:26.919 04:25:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:26.919 04:25:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:26.919 04:25:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:26.919 04:25:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:26.919 04:25:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:26.919 04:25:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:26.919 04:25:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:26.919 04:25:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:26.919 04:25:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:26.919 04:25:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:26.919 04:25:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:26.919 04:25:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:26.919 04:25:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.919 04:25:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.919 04:25:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.920 04:25:04 -- paths/export.sh@5 -- # export PATH 00:18:26.920 04:25:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.920 04:25:04 -- nvmf/common.sh@46 -- # : 0 00:18:26.920 04:25:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:26.920 04:25:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:26.920 04:25:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:26.920 04:25:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:26.920 04:25:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:26.920 04:25:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:26.920 04:25:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:26.920 04:25:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:26.920 04:25:04 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:26.920 04:25:04 -- fips/fips.sh@89 -- # check_openssl_version 00:18:26.920 04:25:04 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:26.920 04:25:04 -- fips/fips.sh@85 -- # openssl version 00:18:26.920 04:25:04 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:26.920 04:25:04 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:26.920 04:25:04 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:26.920 04:25:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:26.920 04:25:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:26.920 04:25:04 -- scripts/common.sh@335 -- # IFS=.-: 00:18:26.920 04:25:04 -- scripts/common.sh@335 -- # read -ra ver1 00:18:26.920 04:25:04 -- scripts/common.sh@336 -- # IFS=.-: 00:18:26.920 04:25:04 -- scripts/common.sh@336 -- # read -ra ver2 00:18:26.920 04:25:04 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:26.920 04:25:04 -- scripts/common.sh@339 -- # ver1_l=3 00:18:26.920 04:25:04 -- scripts/common.sh@340 -- # ver2_l=3 00:18:26.920 04:25:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:26.920 04:25:04 -- scripts/common.sh@343 -- # case "$op" in 00:18:26.920 04:25:04 -- scripts/common.sh@347 -- # : 1 00:18:26.920 04:25:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:26.920 04:25:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:26.920 04:25:04 -- scripts/common.sh@364 -- # decimal 3 00:18:26.920 04:25:04 -- scripts/common.sh@352 -- # local d=3 00:18:26.920 04:25:04 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:26.920 04:25:04 -- scripts/common.sh@354 -- # echo 3 00:18:26.920 04:25:04 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:26.920 04:25:04 -- scripts/common.sh@365 -- # decimal 3 00:18:26.920 04:25:04 -- scripts/common.sh@352 -- # local d=3 00:18:26.920 04:25:04 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:26.920 04:25:04 -- scripts/common.sh@354 -- # echo 3 00:18:26.920 04:25:04 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:26.920 04:25:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:26.920 04:25:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:26.920 04:25:04 -- scripts/common.sh@363 -- # (( v++ )) 00:18:26.920 04:25:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:26.920 04:25:04 -- scripts/common.sh@364 -- # decimal 1 00:18:26.920 04:25:04 -- scripts/common.sh@352 -- # local d=1 00:18:26.920 04:25:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:26.920 04:25:04 -- scripts/common.sh@354 -- # echo 1 00:18:26.920 04:25:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:26.920 04:25:04 -- scripts/common.sh@365 -- # decimal 0 00:18:26.920 04:25:04 -- scripts/common.sh@352 -- # local d=0 00:18:26.920 04:25:04 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:26.920 04:25:04 -- scripts/common.sh@354 -- # echo 0 00:18:26.920 04:25:04 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:26.920 04:25:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:26.920 04:25:04 -- scripts/common.sh@366 -- # return 0 00:18:26.920 04:25:04 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:26.920 04:25:04 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:26.920 04:25:04 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:26.920 04:25:04 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:26.920 04:25:04 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:26.920 04:25:04 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:26.920 04:25:04 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:26.920 04:25:04 -- fips/fips.sh@113 -- # build_openssl_config 00:18:26.920 04:25:04 -- fips/fips.sh@37 -- # cat 00:18:26.920 04:25:04 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:26.920 04:25:04 -- fips/fips.sh@58 -- # cat - 00:18:26.920 04:25:04 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:26.920 04:25:04 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:26.920 04:25:04 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:26.920 04:25:04 -- fips/fips.sh@116 -- # openssl list -providers 00:18:26.920 04:25:04 -- fips/fips.sh@116 -- # grep name 00:18:26.920 04:25:04 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:26.920 04:25:04 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:26.920 04:25:04 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:26.920 04:25:04 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:26.920 04:25:04 -- fips/fips.sh@127 -- # : 00:18:26.920 04:25:04 -- common/autotest_common.sh@650 -- # local es=0 00:18:26.920 04:25:04 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:26.920 04:25:04 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:26.920 04:25:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:26.920 04:25:04 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:26.920 04:25:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:26.920 04:25:04 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:26.920 04:25:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:26.920 04:25:04 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:26.920 04:25:04 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:26.920 04:25:04 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:27.178 Error setting digest 00:18:27.178 40D2E1E8267F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:27.178 40D2E1E8267F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:27.178 04:25:04 -- common/autotest_common.sh@653 -- # es=1 00:18:27.178 04:25:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:27.178 04:25:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:27.178 04:25:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:27.178 04:25:04 -- fips/fips.sh@130 -- # nvmftestinit 00:18:27.178 04:25:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:27.178 04:25:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:27.178 04:25:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:27.178 04:25:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:27.178 04:25:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:27.178 04:25:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:27.178 04:25:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:27.178 04:25:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:27.178 04:25:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:27.178 04:25:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:27.178 04:25:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:27.178 04:25:04 -- common/autotest_common.sh@10 -- # set +x 00:18:29.078 04:25:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:29.078 04:25:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:29.078 04:25:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:29.078 04:25:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:29.078 04:25:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:29.078 04:25:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:29.078 04:25:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:29.078 04:25:06 -- nvmf/common.sh@294 -- # net_devs=() 00:18:29.078 04:25:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:29.078 04:25:06 -- nvmf/common.sh@295 -- # e810=() 00:18:29.078 04:25:06 -- nvmf/common.sh@295 -- # local -ga e810 00:18:29.078 04:25:06 -- nvmf/common.sh@296 -- # x722=() 00:18:29.078 04:25:06 -- nvmf/common.sh@296 -- # local -ga x722 00:18:29.079 04:25:06 -- nvmf/common.sh@297 -- # mlx=() 00:18:29.079 04:25:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:29.079 04:25:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:29.079 04:25:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:29.079 04:25:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:29.079 04:25:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:29.079 04:25:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:29.079 04:25:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:29.079 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:29.079 04:25:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:29.079 04:25:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:29.079 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:29.079 04:25:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:29.079 04:25:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:29.079 04:25:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:29.079 04:25:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:29.079 04:25:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:29.079 04:25:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:29.079 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:29.079 04:25:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:29.079 04:25:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:29.079 04:25:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:29.079 04:25:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:29.079 04:25:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:29.079 04:25:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:29.079 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:29.079 04:25:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:29.079 04:25:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:29.079 04:25:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:29.079 04:25:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:29.079 04:25:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:29.079 04:25:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:29.079 04:25:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:29.079 04:25:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:29.079 04:25:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:29.079 04:25:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:29.079 04:25:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:29.079 04:25:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:29.079 04:25:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:29.079 04:25:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:29.079 04:25:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:29.079 04:25:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:29.079 04:25:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:29.079 04:25:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:29.079 04:25:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:29.079 04:25:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:29.079 04:25:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:29.079 04:25:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:29.079 04:25:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:29.079 04:25:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:29.079 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:29.079 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:18:29.079 00:18:29.079 --- 10.0.0.2 ping statistics --- 00:18:29.079 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:29.079 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:18:29.079 04:25:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:29.079 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:29.079 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:18:29.079 00:18:29.079 --- 10.0.0.1 ping statistics --- 00:18:29.079 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:29.079 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:18:29.079 04:25:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:29.079 04:25:06 -- nvmf/common.sh@410 -- # return 0 00:18:29.079 04:25:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:29.079 04:25:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:29.079 04:25:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:29.079 04:25:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:29.079 04:25:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:29.079 04:25:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:29.339 04:25:06 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:29.339 04:25:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:29.339 04:25:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:29.339 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:18:29.339 04:25:06 -- nvmf/common.sh@469 -- # nvmfpid=3921943 00:18:29.339 04:25:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:29.339 04:25:06 -- nvmf/common.sh@470 -- # waitforlisten 3921943 00:18:29.339 04:25:06 -- common/autotest_common.sh@829 -- # '[' -z 3921943 ']' 00:18:29.339 04:25:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:29.339 04:25:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:29.339 04:25:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:29.339 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:29.339 04:25:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:29.339 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:18:29.339 [2024-11-28 04:25:06.464187] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:29.339 [2024-11-28 04:25:06.464271] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:29.339 EAL: No free 2048 kB hugepages reported on node 1 00:18:29.339 [2024-11-28 04:25:06.526923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.339 [2024-11-28 04:25:06.631722] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:29.339 [2024-11-28 04:25:06.631897] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:29.339 [2024-11-28 04:25:06.631914] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:29.339 [2024-11-28 04:25:06.631938] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:29.339 [2024-11-28 04:25:06.631967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:30.271 04:25:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:30.271 04:25:07 -- common/autotest_common.sh@862 -- # return 0 00:18:30.271 04:25:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:30.271 04:25:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:30.271 04:25:07 -- common/autotest_common.sh@10 -- # set +x 00:18:30.271 04:25:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:30.271 04:25:07 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:30.271 04:25:07 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:30.271 04:25:07 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:30.271 04:25:07 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:30.271 04:25:07 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:30.271 04:25:07 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:30.271 04:25:07 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:30.271 04:25:07 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:30.529 [2024-11-28 04:25:07.749409] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:30.529 [2024-11-28 04:25:07.765406] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:30.529 [2024-11-28 04:25:07.765652] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:30.529 malloc0 00:18:30.529 04:25:07 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:30.529 04:25:07 -- fips/fips.sh@147 -- # bdevperf_pid=3922106 00:18:30.529 04:25:07 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:30.529 04:25:07 -- fips/fips.sh@148 -- # waitforlisten 3922106 /var/tmp/bdevperf.sock 00:18:30.529 04:25:07 -- common/autotest_common.sh@829 -- # '[' -z 3922106 ']' 00:18:30.529 04:25:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:30.529 04:25:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:30.529 04:25:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:30.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:30.529 04:25:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:30.529 04:25:07 -- common/autotest_common.sh@10 -- # set +x 00:18:30.788 [2024-11-28 04:25:07.885304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:30.788 [2024-11-28 04:25:07.885388] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3922106 ] 00:18:30.788 EAL: No free 2048 kB hugepages reported on node 1 00:18:30.788 [2024-11-28 04:25:07.944018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:30.788 [2024-11-28 04:25:08.053103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:31.721 04:25:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:31.721 04:25:08 -- common/autotest_common.sh@862 -- # return 0 00:18:31.721 04:25:08 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:31.979 [2024-11-28 04:25:09.145950] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:31.979 TLSTESTn1 00:18:31.979 04:25:09 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:32.237 Running I/O for 10 seconds... 00:18:42.201 00:18:42.201 Latency(us) 00:18:42.201 [2024-11-28T03:25:19.512Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:42.201 [2024-11-28T03:25:19.512Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:42.201 Verification LBA range: start 0x0 length 0x2000 00:18:42.201 TLSTESTn1 : 10.02 4231.44 16.53 0.00 0.00 30205.28 4975.88 45438.29 00:18:42.201 [2024-11-28T03:25:19.512Z] =================================================================================================================== 00:18:42.201 [2024-11-28T03:25:19.512Z] Total : 4231.44 16.53 0.00 0.00 30205.28 4975.88 45438.29 00:18:42.201 0 00:18:42.201 04:25:19 -- fips/fips.sh@1 -- # cleanup 00:18:42.201 04:25:19 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:42.201 04:25:19 -- common/autotest_common.sh@806 -- # type=--id 00:18:42.201 04:25:19 -- common/autotest_common.sh@807 -- # id=0 00:18:42.201 04:25:19 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:42.201 04:25:19 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:42.201 04:25:19 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:42.201 04:25:19 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:42.201 04:25:19 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:42.201 04:25:19 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:42.201 nvmf_trace.0 00:18:42.201 04:25:19 -- common/autotest_common.sh@821 -- # return 0 00:18:42.201 04:25:19 -- fips/fips.sh@16 -- # killprocess 3922106 00:18:42.201 04:25:19 -- common/autotest_common.sh@936 -- # '[' -z 3922106 ']' 00:18:42.201 04:25:19 -- common/autotest_common.sh@940 -- # kill -0 3922106 00:18:42.201 04:25:19 -- common/autotest_common.sh@941 -- # uname 00:18:42.201 04:25:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:42.201 04:25:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3922106 00:18:42.201 04:25:19 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:42.201 04:25:19 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:42.201 04:25:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3922106' 00:18:42.201 killing process with pid 3922106 00:18:42.201 04:25:19 -- common/autotest_common.sh@955 -- # kill 3922106 00:18:42.201 Received shutdown signal, test time was about 10.000000 seconds 00:18:42.201 00:18:42.201 Latency(us) 00:18:42.201 [2024-11-28T03:25:19.512Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:42.201 [2024-11-28T03:25:19.512Z] =================================================================================================================== 00:18:42.201 [2024-11-28T03:25:19.512Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:42.201 04:25:19 -- common/autotest_common.sh@960 -- # wait 3922106 00:18:42.459 04:25:19 -- fips/fips.sh@17 -- # nvmftestfini 00:18:42.459 04:25:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:42.459 04:25:19 -- nvmf/common.sh@116 -- # sync 00:18:42.459 04:25:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:42.459 04:25:19 -- nvmf/common.sh@119 -- # set +e 00:18:42.459 04:25:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:42.459 04:25:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:42.459 rmmod nvme_tcp 00:18:42.717 rmmod nvme_fabrics 00:18:42.717 rmmod nvme_keyring 00:18:42.717 04:25:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:42.717 04:25:19 -- nvmf/common.sh@123 -- # set -e 00:18:42.717 04:25:19 -- nvmf/common.sh@124 -- # return 0 00:18:42.717 04:25:19 -- nvmf/common.sh@477 -- # '[' -n 3921943 ']' 00:18:42.717 04:25:19 -- nvmf/common.sh@478 -- # killprocess 3921943 00:18:42.717 04:25:19 -- common/autotest_common.sh@936 -- # '[' -z 3921943 ']' 00:18:42.717 04:25:19 -- common/autotest_common.sh@940 -- # kill -0 3921943 00:18:42.717 04:25:19 -- common/autotest_common.sh@941 -- # uname 00:18:42.717 04:25:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:42.717 04:25:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3921943 00:18:42.717 04:25:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:42.717 04:25:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:42.717 04:25:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3921943' 00:18:42.717 killing process with pid 3921943 00:18:42.717 04:25:19 -- common/autotest_common.sh@955 -- # kill 3921943 00:18:42.717 04:25:19 -- common/autotest_common.sh@960 -- # wait 3921943 00:18:42.975 04:25:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:42.975 04:25:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:42.975 04:25:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:42.975 04:25:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:42.975 04:25:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:42.975 04:25:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:42.975 04:25:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:42.975 04:25:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:44.949 04:25:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:44.949 04:25:22 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:44.949 00:18:44.949 real 0m18.269s 00:18:44.949 user 0m23.478s 00:18:44.949 sys 0m6.264s 00:18:44.949 04:25:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:44.949 04:25:22 -- common/autotest_common.sh@10 -- # set +x 00:18:44.949 ************************************ 00:18:44.949 END TEST nvmf_fips 00:18:44.949 ************************************ 00:18:44.949 04:25:22 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:44.949 04:25:22 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:44.949 04:25:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:44.949 04:25:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:44.949 04:25:22 -- common/autotest_common.sh@10 -- # set +x 00:18:44.949 ************************************ 00:18:44.949 START TEST nvmf_fuzz 00:18:44.949 ************************************ 00:18:44.949 04:25:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:45.207 * Looking for test storage... 00:18:45.207 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:45.207 04:25:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:45.207 04:25:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:45.207 04:25:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:45.207 04:25:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:45.207 04:25:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:45.207 04:25:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:45.207 04:25:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:45.207 04:25:22 -- scripts/common.sh@335 -- # IFS=.-: 00:18:45.207 04:25:22 -- scripts/common.sh@335 -- # read -ra ver1 00:18:45.207 04:25:22 -- scripts/common.sh@336 -- # IFS=.-: 00:18:45.207 04:25:22 -- scripts/common.sh@336 -- # read -ra ver2 00:18:45.207 04:25:22 -- scripts/common.sh@337 -- # local 'op=<' 00:18:45.207 04:25:22 -- scripts/common.sh@339 -- # ver1_l=2 00:18:45.207 04:25:22 -- scripts/common.sh@340 -- # ver2_l=1 00:18:45.207 04:25:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:45.207 04:25:22 -- scripts/common.sh@343 -- # case "$op" in 00:18:45.207 04:25:22 -- scripts/common.sh@344 -- # : 1 00:18:45.207 04:25:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:45.207 04:25:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:45.207 04:25:22 -- scripts/common.sh@364 -- # decimal 1 00:18:45.207 04:25:22 -- scripts/common.sh@352 -- # local d=1 00:18:45.207 04:25:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:45.207 04:25:22 -- scripts/common.sh@354 -- # echo 1 00:18:45.207 04:25:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:45.207 04:25:22 -- scripts/common.sh@365 -- # decimal 2 00:18:45.207 04:25:22 -- scripts/common.sh@352 -- # local d=2 00:18:45.207 04:25:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:45.207 04:25:22 -- scripts/common.sh@354 -- # echo 2 00:18:45.207 04:25:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:45.207 04:25:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:45.207 04:25:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:45.207 04:25:22 -- scripts/common.sh@367 -- # return 0 00:18:45.207 04:25:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:45.207 04:25:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:45.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.207 --rc genhtml_branch_coverage=1 00:18:45.207 --rc genhtml_function_coverage=1 00:18:45.207 --rc genhtml_legend=1 00:18:45.207 --rc geninfo_all_blocks=1 00:18:45.207 --rc geninfo_unexecuted_blocks=1 00:18:45.207 00:18:45.207 ' 00:18:45.207 04:25:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:45.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.207 --rc genhtml_branch_coverage=1 00:18:45.207 --rc genhtml_function_coverage=1 00:18:45.207 --rc genhtml_legend=1 00:18:45.207 --rc geninfo_all_blocks=1 00:18:45.207 --rc geninfo_unexecuted_blocks=1 00:18:45.207 00:18:45.207 ' 00:18:45.207 04:25:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:45.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.207 --rc genhtml_branch_coverage=1 00:18:45.207 --rc genhtml_function_coverage=1 00:18:45.207 --rc genhtml_legend=1 00:18:45.207 --rc geninfo_all_blocks=1 00:18:45.207 --rc geninfo_unexecuted_blocks=1 00:18:45.207 00:18:45.207 ' 00:18:45.207 04:25:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:45.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:45.207 --rc genhtml_branch_coverage=1 00:18:45.207 --rc genhtml_function_coverage=1 00:18:45.207 --rc genhtml_legend=1 00:18:45.207 --rc geninfo_all_blocks=1 00:18:45.207 --rc geninfo_unexecuted_blocks=1 00:18:45.207 00:18:45.207 ' 00:18:45.207 04:25:22 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.207 04:25:22 -- nvmf/common.sh@7 -- # uname -s 00:18:45.207 04:25:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.207 04:25:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.207 04:25:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.207 04:25:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.207 04:25:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.207 04:25:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.207 04:25:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.207 04:25:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.207 04:25:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.207 04:25:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.207 04:25:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.207 04:25:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:45.207 04:25:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.207 04:25:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.207 04:25:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.207 04:25:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:45.207 04:25:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.207 04:25:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.207 04:25:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.207 04:25:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.207 04:25:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.207 04:25:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.207 04:25:22 -- paths/export.sh@5 -- # export PATH 00:18:45.207 04:25:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.207 04:25:22 -- nvmf/common.sh@46 -- # : 0 00:18:45.207 04:25:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:45.207 04:25:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:45.207 04:25:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:45.208 04:25:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.208 04:25:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.208 04:25:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:45.208 04:25:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:45.208 04:25:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:45.208 04:25:22 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:45.208 04:25:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:45.208 04:25:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:45.208 04:25:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:45.208 04:25:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:45.208 04:25:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:45.208 04:25:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.208 04:25:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.208 04:25:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.208 04:25:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:45.208 04:25:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:45.208 04:25:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:45.208 04:25:22 -- common/autotest_common.sh@10 -- # set +x 00:18:47.132 04:25:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:47.132 04:25:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:47.132 04:25:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:47.132 04:25:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:47.132 04:25:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:47.132 04:25:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:47.132 04:25:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:47.132 04:25:24 -- nvmf/common.sh@294 -- # net_devs=() 00:18:47.133 04:25:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:47.133 04:25:24 -- nvmf/common.sh@295 -- # e810=() 00:18:47.133 04:25:24 -- nvmf/common.sh@295 -- # local -ga e810 00:18:47.133 04:25:24 -- nvmf/common.sh@296 -- # x722=() 00:18:47.133 04:25:24 -- nvmf/common.sh@296 -- # local -ga x722 00:18:47.133 04:25:24 -- nvmf/common.sh@297 -- # mlx=() 00:18:47.133 04:25:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:47.133 04:25:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:47.133 04:25:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:47.133 04:25:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:47.133 04:25:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:47.133 04:25:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.133 04:25:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:47.133 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:47.133 04:25:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.133 04:25:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:47.133 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:47.133 04:25:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:47.133 04:25:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.133 04:25:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.133 04:25:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.133 04:25:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.133 04:25:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:47.133 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:47.133 04:25:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.133 04:25:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.133 04:25:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.133 04:25:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.133 04:25:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.133 04:25:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:47.133 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:47.133 04:25:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.133 04:25:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:47.133 04:25:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:47.133 04:25:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:47.133 04:25:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:47.133 04:25:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:47.133 04:25:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:47.133 04:25:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:47.133 04:25:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:47.133 04:25:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:47.133 04:25:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:47.133 04:25:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:47.133 04:25:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:47.133 04:25:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:47.133 04:25:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:47.133 04:25:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:47.133 04:25:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:47.133 04:25:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:47.133 04:25:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:47.133 04:25:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:47.133 04:25:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:47.133 04:25:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:47.391 04:25:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:47.391 04:25:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:47.391 04:25:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:47.391 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:47.391 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:18:47.391 00:18:47.391 --- 10.0.0.2 ping statistics --- 00:18:47.391 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.391 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:18:47.391 04:25:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:47.391 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:47.391 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:18:47.391 00:18:47.391 --- 10.0.0.1 ping statistics --- 00:18:47.391 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.391 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:18:47.391 04:25:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:47.391 04:25:24 -- nvmf/common.sh@410 -- # return 0 00:18:47.391 04:25:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:47.391 04:25:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:47.391 04:25:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:47.391 04:25:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:47.391 04:25:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:47.391 04:25:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:47.391 04:25:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:47.391 04:25:24 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3925550 00:18:47.391 04:25:24 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:47.391 04:25:24 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:47.391 04:25:24 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3925550 00:18:47.391 04:25:24 -- common/autotest_common.sh@829 -- # '[' -z 3925550 ']' 00:18:47.391 04:25:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:47.391 04:25:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:47.391 04:25:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:47.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:47.391 04:25:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:47.391 04:25:24 -- common/autotest_common.sh@10 -- # set +x 00:18:48.330 04:25:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:48.330 04:25:25 -- common/autotest_common.sh@862 -- # return 0 00:18:48.330 04:25:25 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:48.330 04:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.330 04:25:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.330 04:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.330 04:25:25 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:48.330 04:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.330 04:25:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.330 Malloc0 00:18:48.330 04:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.330 04:25:25 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:48.330 04:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.330 04:25:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.330 04:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.330 04:25:25 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:48.330 04:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.330 04:25:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.330 04:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.330 04:25:25 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:48.330 04:25:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.330 04:25:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.330 04:25:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.330 04:25:25 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:48.330 04:25:25 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:20.399 Fuzzing completed. Shutting down the fuzz application 00:19:20.399 00:19:20.399 Dumping successful admin opcodes: 00:19:20.399 8, 9, 10, 24, 00:19:20.399 Dumping successful io opcodes: 00:19:20.399 0, 9, 00:19:20.399 NS: 0x200003aeff00 I/O qp, Total commands completed: 480360, total successful commands: 2776, random_seed: 1412590656 00:19:20.399 NS: 0x200003aeff00 admin qp, Total commands completed: 58448, total successful commands: 464, random_seed: 1422753856 00:19:20.399 04:25:56 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:20.399 Fuzzing completed. Shutting down the fuzz application 00:19:20.399 00:19:20.399 Dumping successful admin opcodes: 00:19:20.399 24, 00:19:20.399 Dumping successful io opcodes: 00:19:20.399 00:19:20.399 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2711115115 00:19:20.399 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2711262879 00:19:20.399 04:25:57 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:20.399 04:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.399 04:25:57 -- common/autotest_common.sh@10 -- # set +x 00:19:20.399 04:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.399 04:25:57 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:20.399 04:25:57 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:20.399 04:25:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:20.399 04:25:57 -- nvmf/common.sh@116 -- # sync 00:19:20.399 04:25:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:20.399 04:25:57 -- nvmf/common.sh@119 -- # set +e 00:19:20.399 04:25:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:20.399 04:25:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:20.399 rmmod nvme_tcp 00:19:20.399 rmmod nvme_fabrics 00:19:20.399 rmmod nvme_keyring 00:19:20.399 04:25:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:20.399 04:25:57 -- nvmf/common.sh@123 -- # set -e 00:19:20.399 04:25:57 -- nvmf/common.sh@124 -- # return 0 00:19:20.399 04:25:57 -- nvmf/common.sh@477 -- # '[' -n 3925550 ']' 00:19:20.399 04:25:57 -- nvmf/common.sh@478 -- # killprocess 3925550 00:19:20.399 04:25:57 -- common/autotest_common.sh@936 -- # '[' -z 3925550 ']' 00:19:20.399 04:25:57 -- common/autotest_common.sh@940 -- # kill -0 3925550 00:19:20.399 04:25:57 -- common/autotest_common.sh@941 -- # uname 00:19:20.399 04:25:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:20.399 04:25:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3925550 00:19:20.399 04:25:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:20.399 04:25:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:20.399 04:25:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3925550' 00:19:20.399 killing process with pid 3925550 00:19:20.399 04:25:57 -- common/autotest_common.sh@955 -- # kill 3925550 00:19:20.399 04:25:57 -- common/autotest_common.sh@960 -- # wait 3925550 00:19:20.657 04:25:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:20.657 04:25:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:20.657 04:25:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:20.657 04:25:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:20.657 04:25:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:20.657 04:25:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:20.657 04:25:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:20.657 04:25:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:23.192 04:25:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:23.192 04:25:59 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:23.192 00:19:23.192 real 0m37.674s 00:19:23.192 user 0m52.485s 00:19:23.192 sys 0m14.647s 00:19:23.192 04:25:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:23.192 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:19:23.192 ************************************ 00:19:23.192 END TEST nvmf_fuzz 00:19:23.192 ************************************ 00:19:23.192 04:25:59 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:23.192 04:25:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:23.192 04:25:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:23.192 04:25:59 -- common/autotest_common.sh@10 -- # set +x 00:19:23.192 ************************************ 00:19:23.192 START TEST nvmf_multiconnection 00:19:23.192 ************************************ 00:19:23.192 04:25:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:23.192 * Looking for test storage... 00:19:23.192 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:23.192 04:25:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:23.192 04:25:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:23.192 04:25:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:23.192 04:26:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:23.192 04:26:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:23.192 04:26:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:23.192 04:26:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:23.192 04:26:00 -- scripts/common.sh@335 -- # IFS=.-: 00:19:23.192 04:26:00 -- scripts/common.sh@335 -- # read -ra ver1 00:19:23.192 04:26:00 -- scripts/common.sh@336 -- # IFS=.-: 00:19:23.192 04:26:00 -- scripts/common.sh@336 -- # read -ra ver2 00:19:23.192 04:26:00 -- scripts/common.sh@337 -- # local 'op=<' 00:19:23.192 04:26:00 -- scripts/common.sh@339 -- # ver1_l=2 00:19:23.192 04:26:00 -- scripts/common.sh@340 -- # ver2_l=1 00:19:23.192 04:26:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:23.192 04:26:00 -- scripts/common.sh@343 -- # case "$op" in 00:19:23.192 04:26:00 -- scripts/common.sh@344 -- # : 1 00:19:23.192 04:26:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:23.192 04:26:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:23.192 04:26:00 -- scripts/common.sh@364 -- # decimal 1 00:19:23.192 04:26:00 -- scripts/common.sh@352 -- # local d=1 00:19:23.192 04:26:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:23.192 04:26:00 -- scripts/common.sh@354 -- # echo 1 00:19:23.192 04:26:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:23.192 04:26:00 -- scripts/common.sh@365 -- # decimal 2 00:19:23.192 04:26:00 -- scripts/common.sh@352 -- # local d=2 00:19:23.192 04:26:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:23.192 04:26:00 -- scripts/common.sh@354 -- # echo 2 00:19:23.192 04:26:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:23.192 04:26:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:23.192 04:26:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:23.192 04:26:00 -- scripts/common.sh@367 -- # return 0 00:19:23.192 04:26:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:23.192 04:26:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:23.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.192 --rc genhtml_branch_coverage=1 00:19:23.192 --rc genhtml_function_coverage=1 00:19:23.192 --rc genhtml_legend=1 00:19:23.192 --rc geninfo_all_blocks=1 00:19:23.192 --rc geninfo_unexecuted_blocks=1 00:19:23.192 00:19:23.192 ' 00:19:23.192 04:26:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:23.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.192 --rc genhtml_branch_coverage=1 00:19:23.192 --rc genhtml_function_coverage=1 00:19:23.192 --rc genhtml_legend=1 00:19:23.192 --rc geninfo_all_blocks=1 00:19:23.192 --rc geninfo_unexecuted_blocks=1 00:19:23.192 00:19:23.192 ' 00:19:23.192 04:26:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:23.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.192 --rc genhtml_branch_coverage=1 00:19:23.192 --rc genhtml_function_coverage=1 00:19:23.192 --rc genhtml_legend=1 00:19:23.192 --rc geninfo_all_blocks=1 00:19:23.192 --rc geninfo_unexecuted_blocks=1 00:19:23.192 00:19:23.192 ' 00:19:23.192 04:26:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:23.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.192 --rc genhtml_branch_coverage=1 00:19:23.192 --rc genhtml_function_coverage=1 00:19:23.192 --rc genhtml_legend=1 00:19:23.192 --rc geninfo_all_blocks=1 00:19:23.192 --rc geninfo_unexecuted_blocks=1 00:19:23.192 00:19:23.192 ' 00:19:23.192 04:26:00 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:23.192 04:26:00 -- nvmf/common.sh@7 -- # uname -s 00:19:23.192 04:26:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:23.192 04:26:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:23.192 04:26:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:23.193 04:26:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:23.193 04:26:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:23.193 04:26:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:23.193 04:26:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:23.193 04:26:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:23.193 04:26:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:23.193 04:26:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:23.193 04:26:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:23.193 04:26:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:23.193 04:26:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:23.193 04:26:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:23.193 04:26:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:23.193 04:26:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:23.193 04:26:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:23.193 04:26:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:23.193 04:26:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:23.193 04:26:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.193 04:26:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.193 04:26:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.193 04:26:00 -- paths/export.sh@5 -- # export PATH 00:19:23.193 04:26:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.193 04:26:00 -- nvmf/common.sh@46 -- # : 0 00:19:23.193 04:26:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:23.193 04:26:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:23.193 04:26:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:23.193 04:26:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:23.193 04:26:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:23.193 04:26:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:23.193 04:26:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:23.193 04:26:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:23.193 04:26:00 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:23.193 04:26:00 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:23.193 04:26:00 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:23.193 04:26:00 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:23.193 04:26:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:23.193 04:26:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:23.193 04:26:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:23.193 04:26:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:23.193 04:26:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:23.193 04:26:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.193 04:26:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.193 04:26:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:23.193 04:26:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:23.193 04:26:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:23.193 04:26:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:23.193 04:26:00 -- common/autotest_common.sh@10 -- # set +x 00:19:25.094 04:26:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:25.094 04:26:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:25.095 04:26:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:25.095 04:26:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:25.095 04:26:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:25.095 04:26:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:25.095 04:26:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:25.095 04:26:02 -- nvmf/common.sh@294 -- # net_devs=() 00:19:25.095 04:26:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:25.095 04:26:02 -- nvmf/common.sh@295 -- # e810=() 00:19:25.095 04:26:02 -- nvmf/common.sh@295 -- # local -ga e810 00:19:25.095 04:26:02 -- nvmf/common.sh@296 -- # x722=() 00:19:25.095 04:26:02 -- nvmf/common.sh@296 -- # local -ga x722 00:19:25.095 04:26:02 -- nvmf/common.sh@297 -- # mlx=() 00:19:25.095 04:26:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:25.095 04:26:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:25.095 04:26:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:25.095 04:26:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:25.095 04:26:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:25.095 04:26:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:25.095 04:26:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:25.095 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:25.095 04:26:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:25.095 04:26:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:25.095 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:25.095 04:26:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:25.095 04:26:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:25.095 04:26:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:25.095 04:26:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:25.095 04:26:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:25.095 04:26:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:25.095 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:25.095 04:26:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:25.095 04:26:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:25.095 04:26:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:25.095 04:26:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:25.095 04:26:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:25.095 04:26:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:25.095 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:25.095 04:26:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:25.095 04:26:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:25.095 04:26:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:25.095 04:26:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:25.095 04:26:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:25.095 04:26:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:25.095 04:26:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:25.095 04:26:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:25.095 04:26:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:25.095 04:26:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:25.095 04:26:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:25.095 04:26:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:25.095 04:26:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:25.095 04:26:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:25.095 04:26:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:25.095 04:26:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:25.095 04:26:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:25.095 04:26:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:25.095 04:26:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:25.095 04:26:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:25.095 04:26:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:25.095 04:26:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:25.095 04:26:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:25.095 04:26:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:25.095 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:25.095 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:19:25.095 00:19:25.095 --- 10.0.0.2 ping statistics --- 00:19:25.095 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:25.095 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:19:25.095 04:26:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:25.095 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:25.095 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:19:25.095 00:19:25.095 --- 10.0.0.1 ping statistics --- 00:19:25.095 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:25.095 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:19:25.095 04:26:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:25.095 04:26:02 -- nvmf/common.sh@410 -- # return 0 00:19:25.095 04:26:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:25.095 04:26:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:25.095 04:26:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:25.095 04:26:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:25.095 04:26:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:25.095 04:26:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:25.354 04:26:02 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:25.354 04:26:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:25.354 04:26:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:25.354 04:26:02 -- common/autotest_common.sh@10 -- # set +x 00:19:25.354 04:26:02 -- nvmf/common.sh@469 -- # nvmfpid=3931442 00:19:25.354 04:26:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:25.354 04:26:02 -- nvmf/common.sh@470 -- # waitforlisten 3931442 00:19:25.354 04:26:02 -- common/autotest_common.sh@829 -- # '[' -z 3931442 ']' 00:19:25.354 04:26:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:25.354 04:26:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:25.354 04:26:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:25.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:25.354 04:26:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:25.354 04:26:02 -- common/autotest_common.sh@10 -- # set +x 00:19:25.354 [2024-11-28 04:26:02.459905] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:25.354 [2024-11-28 04:26:02.459983] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:25.354 EAL: No free 2048 kB hugepages reported on node 1 00:19:25.354 [2024-11-28 04:26:02.530696] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:25.354 [2024-11-28 04:26:02.651985] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:25.354 [2024-11-28 04:26:02.652151] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:25.354 [2024-11-28 04:26:02.652170] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:25.354 [2024-11-28 04:26:02.652183] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:25.354 [2024-11-28 04:26:02.652267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:25.354 [2024-11-28 04:26:02.652347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:25.354 [2024-11-28 04:26:02.652322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:25.354 [2024-11-28 04:26:02.652353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:26.288 04:26:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:26.288 04:26:03 -- common/autotest_common.sh@862 -- # return 0 00:19:26.288 04:26:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:26.288 04:26:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:26.288 04:26:03 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 [2024-11-28 04:26:03.447071] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:26.288 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.288 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 Malloc1 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 [2024-11-28 04:26:03.504728] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.288 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 Malloc2 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.288 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 Malloc3 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.288 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:26.288 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.288 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.288 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.547 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 Malloc4 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.547 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 Malloc5 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.547 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 Malloc6 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.547 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 Malloc7 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.547 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.547 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.547 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.547 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:26.547 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.548 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.548 Malloc8 00:19:26.548 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.548 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:26.548 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.548 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.548 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.548 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:26.548 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.548 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.548 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.548 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:26.548 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.548 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.806 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.806 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.806 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:26.806 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.806 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.806 Malloc9 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.807 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 Malloc10 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.807 04:26:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 Malloc11 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:26.807 04:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.807 04:26:03 -- common/autotest_common.sh@10 -- # set +x 00:19:26.807 04:26:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.807 04:26:04 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:26.807 04:26:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.807 04:26:04 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:27.373 04:26:04 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:27.373 04:26:04 -- common/autotest_common.sh@1187 -- # local i=0 00:19:27.373 04:26:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:27.374 04:26:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:27.374 04:26:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:29.920 04:26:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:29.920 04:26:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:29.920 04:26:06 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:29.920 04:26:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:29.920 04:26:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:29.920 04:26:06 -- common/autotest_common.sh@1197 -- # return 0 00:19:29.920 04:26:06 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.920 04:26:06 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:30.178 04:26:07 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:30.178 04:26:07 -- common/autotest_common.sh@1187 -- # local i=0 00:19:30.178 04:26:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:30.178 04:26:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:30.178 04:26:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:32.077 04:26:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:32.077 04:26:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:32.077 04:26:09 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:32.077 04:26:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:32.077 04:26:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:32.077 04:26:09 -- common/autotest_common.sh@1197 -- # return 0 00:19:32.077 04:26:09 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.077 04:26:09 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:32.644 04:26:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:32.644 04:26:09 -- common/autotest_common.sh@1187 -- # local i=0 00:19:32.644 04:26:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:32.644 04:26:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:32.644 04:26:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:35.173 04:26:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:35.173 04:26:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:35.173 04:26:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:35.173 04:26:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:35.173 04:26:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.173 04:26:11 -- common/autotest_common.sh@1197 -- # return 0 00:19:35.173 04:26:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.173 04:26:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:35.431 04:26:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:35.431 04:26:12 -- common/autotest_common.sh@1187 -- # local i=0 00:19:35.431 04:26:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:35.431 04:26:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:35.431 04:26:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:37.330 04:26:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:37.330 04:26:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:37.330 04:26:14 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:37.330 04:26:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:37.330 04:26:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.330 04:26:14 -- common/autotest_common.sh@1197 -- # return 0 00:19:37.330 04:26:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:37.330 04:26:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:38.269 04:26:15 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:38.269 04:26:15 -- common/autotest_common.sh@1187 -- # local i=0 00:19:38.269 04:26:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:38.269 04:26:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:38.269 04:26:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:40.164 04:26:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:40.164 04:26:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:40.164 04:26:17 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:40.164 04:26:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:40.164 04:26:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:40.164 04:26:17 -- common/autotest_common.sh@1197 -- # return 0 00:19:40.164 04:26:17 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:40.164 04:26:17 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:41.097 04:26:18 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:41.097 04:26:18 -- common/autotest_common.sh@1187 -- # local i=0 00:19:41.097 04:26:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.097 04:26:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:41.097 04:26:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:42.995 04:26:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:42.995 04:26:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:42.995 04:26:20 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:42.995 04:26:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:42.995 04:26:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:42.995 04:26:20 -- common/autotest_common.sh@1197 -- # return 0 00:19:42.995 04:26:20 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.995 04:26:20 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:43.561 04:26:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:43.561 04:26:20 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.561 04:26:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.561 04:26:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.561 04:26:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:46.089 04:26:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:46.089 04:26:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:46.089 04:26:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:46.089 04:26:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:46.089 04:26:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:46.089 04:26:22 -- common/autotest_common.sh@1197 -- # return 0 00:19:46.089 04:26:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:46.089 04:26:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:46.655 04:26:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:46.655 04:26:23 -- common/autotest_common.sh@1187 -- # local i=0 00:19:46.655 04:26:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.655 04:26:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:46.655 04:26:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:48.554 04:26:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:48.554 04:26:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:48.554 04:26:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:48.554 04:26:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:48.554 04:26:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:48.554 04:26:25 -- common/autotest_common.sh@1197 -- # return 0 00:19:48.554 04:26:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.554 04:26:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:49.565 04:26:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:49.565 04:26:26 -- common/autotest_common.sh@1187 -- # local i=0 00:19:49.565 04:26:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.565 04:26:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:49.565 04:26:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.465 04:26:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.465 04:26:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.465 04:26:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:51.465 04:26:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.465 04:26:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.465 04:26:28 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.465 04:26:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.465 04:26:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:52.399 04:26:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:52.399 04:26:29 -- common/autotest_common.sh@1187 -- # local i=0 00:19:52.399 04:26:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:52.399 04:26:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:52.399 04:26:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:54.300 04:26:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:54.300 04:26:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:54.300 04:26:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:54.300 04:26:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:54.300 04:26:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:54.300 04:26:31 -- common/autotest_common.sh@1197 -- # return 0 00:19:54.300 04:26:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.300 04:26:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:55.235 04:26:32 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:55.235 04:26:32 -- common/autotest_common.sh@1187 -- # local i=0 00:19:55.235 04:26:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:55.235 04:26:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:55.235 04:26:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:57.135 04:26:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:57.135 04:26:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:57.135 04:26:34 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:57.135 04:26:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:57.135 04:26:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:57.135 04:26:34 -- common/autotest_common.sh@1197 -- # return 0 00:19:57.135 04:26:34 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:57.135 [global] 00:19:57.135 thread=1 00:19:57.135 invalidate=1 00:19:57.135 rw=read 00:19:57.135 time_based=1 00:19:57.135 runtime=10 00:19:57.135 ioengine=libaio 00:19:57.135 direct=1 00:19:57.135 bs=262144 00:19:57.135 iodepth=64 00:19:57.135 norandommap=1 00:19:57.135 numjobs=1 00:19:57.135 00:19:57.135 [job0] 00:19:57.135 filename=/dev/nvme0n1 00:19:57.135 [job1] 00:19:57.135 filename=/dev/nvme10n1 00:19:57.135 [job2] 00:19:57.135 filename=/dev/nvme1n1 00:19:57.135 [job3] 00:19:57.135 filename=/dev/nvme2n1 00:19:57.135 [job4] 00:19:57.135 filename=/dev/nvme3n1 00:19:57.135 [job5] 00:19:57.135 filename=/dev/nvme4n1 00:19:57.135 [job6] 00:19:57.135 filename=/dev/nvme5n1 00:19:57.135 [job7] 00:19:57.135 filename=/dev/nvme6n1 00:19:57.135 [job8] 00:19:57.135 filename=/dev/nvme7n1 00:19:57.135 [job9] 00:19:57.135 filename=/dev/nvme8n1 00:19:57.135 [job10] 00:19:57.135 filename=/dev/nvme9n1 00:19:57.392 Could not set queue depth (nvme0n1) 00:19:57.392 Could not set queue depth (nvme10n1) 00:19:57.392 Could not set queue depth (nvme1n1) 00:19:57.392 Could not set queue depth (nvme2n1) 00:19:57.392 Could not set queue depth (nvme3n1) 00:19:57.392 Could not set queue depth (nvme4n1) 00:19:57.392 Could not set queue depth (nvme5n1) 00:19:57.392 Could not set queue depth (nvme6n1) 00:19:57.392 Could not set queue depth (nvme7n1) 00:19:57.392 Could not set queue depth (nvme8n1) 00:19:57.392 Could not set queue depth (nvme9n1) 00:19:57.392 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:57.392 fio-3.35 00:19:57.392 Starting 11 threads 00:20:09.590 00:20:09.590 job0: (groupid=0, jobs=1): err= 0: pid=3935838: Thu Nov 28 04:26:45 2024 00:20:09.590 read: IOPS=497, BW=124MiB/s (130MB/s)(1255MiB/10081msec) 00:20:09.590 slat (usec): min=14, max=74828, avg=1728.23, stdev=5583.51 00:20:09.590 clat (msec): min=46, max=332, avg=126.74, stdev=46.69 00:20:09.590 lat (msec): min=46, max=348, avg=128.47, stdev=47.44 00:20:09.590 clat percentiles (msec): 00:20:09.590 | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 91], 00:20:09.590 | 30.00th=[ 97], 40.00th=[ 106], 50.00th=[ 116], 60.00th=[ 129], 00:20:09.590 | 70.00th=[ 140], 80.00th=[ 161], 90.00th=[ 190], 95.00th=[ 220], 00:20:09.590 | 99.00th=[ 275], 99.50th=[ 292], 99.90th=[ 313], 99.95th=[ 334], 00:20:09.590 | 99.99th=[ 334] 00:20:09.590 bw ( KiB/s): min=62976, max=210522, per=6.68%, avg=126802.85, stdev=38369.68, samples=20 00:20:09.590 iops : min= 246, max= 822, avg=495.25, stdev=149.88, samples=20 00:20:09.590 lat (msec) : 50=0.30%, 100=33.98%, 250=62.85%, 500=2.87% 00:20:09.590 cpu : usr=0.37%, sys=1.82%, ctx=938, majf=0, minf=4098 00:20:09.590 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:09.590 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.590 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.590 issued rwts: total=5018,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.590 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.590 job1: (groupid=0, jobs=1): err= 0: pid=3935893: Thu Nov 28 04:26:45 2024 00:20:09.590 read: IOPS=642, BW=161MiB/s (169MB/s)(1621MiB/10081msec) 00:20:09.590 slat (usec): min=13, max=55561, avg=1384.06, stdev=3897.58 00:20:09.590 clat (msec): min=19, max=210, avg=98.08, stdev=39.31 00:20:09.590 lat (msec): min=22, max=215, avg=99.46, stdev=39.83 00:20:09.590 clat percentiles (msec): 00:20:09.590 | 1.00th=[ 28], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 59], 00:20:09.590 | 30.00th=[ 71], 40.00th=[ 93], 50.00th=[ 105], 60.00th=[ 113], 00:20:09.590 | 70.00th=[ 123], 80.00th=[ 134], 90.00th=[ 148], 95.00th=[ 157], 00:20:09.590 | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 207], 99.95th=[ 209], 00:20:09.590 | 99.99th=[ 211] 00:20:09.590 bw ( KiB/s): min=100352, max=427008, per=8.66%, avg=164279.60, stdev=76858.73, samples=20 00:20:09.590 iops : min= 392, max= 1668, avg=641.55, stdev=300.21, samples=20 00:20:09.590 lat (msec) : 20=0.02%, 50=14.13%, 100=30.93%, 250=54.92% 00:20:09.590 cpu : usr=0.36%, sys=2.41%, ctx=1245, majf=0, minf=4097 00:20:09.590 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:09.590 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.590 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.590 issued rwts: total=6482,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.590 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.590 job2: (groupid=0, jobs=1): err= 0: pid=3935947: Thu Nov 28 04:26:45 2024 00:20:09.590 read: IOPS=476, BW=119MiB/s (125MB/s)(1202MiB/10088msec) 00:20:09.590 slat (usec): min=13, max=74193, avg=2053.57, stdev=6079.00 00:20:09.590 clat (msec): min=11, max=316, avg=132.10, stdev=47.23 00:20:09.590 lat (msec): min=11, max=335, avg=134.16, stdev=48.16 00:20:09.590 clat percentiles (msec): 00:20:09.590 | 1.00th=[ 34], 5.00th=[ 78], 10.00th=[ 86], 20.00th=[ 101], 00:20:09.590 | 30.00th=[ 110], 40.00th=[ 116], 50.00th=[ 123], 60.00th=[ 129], 00:20:09.590 | 70.00th=[ 140], 80.00th=[ 161], 90.00th=[ 199], 95.00th=[ 236], 00:20:09.590 | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 309], 99.95th=[ 309], 00:20:09.590 | 99.99th=[ 317] 00:20:09.590 bw ( KiB/s): min=62976, max=181760, per=6.40%, avg=121440.25, stdev=33937.97, samples=20 00:20:09.590 iops : min= 246, max= 710, avg=474.25, stdev=132.50, samples=20 00:20:09.590 lat (msec) : 20=0.35%, 50=1.68%, 100=18.24%, 250=75.53%, 500=4.20% 00:20:09.590 cpu : usr=0.37%, sys=1.67%, ctx=768, majf=0, minf=4097 00:20:09.590 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:09.590 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.590 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.590 issued rwts: total=4809,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.590 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.590 job3: (groupid=0, jobs=1): err= 0: pid=3935959: Thu Nov 28 04:26:45 2024 00:20:09.590 read: IOPS=1050, BW=263MiB/s (275MB/s)(2638MiB/10046msec) 00:20:09.590 slat (usec): min=9, max=71710, avg=786.72, stdev=2743.68 00:20:09.590 clat (usec): min=683, max=189452, avg=60102.95, stdev=33432.41 00:20:09.590 lat (usec): min=700, max=239042, avg=60889.67, stdev=33768.13 00:20:09.590 clat percentiles (msec): 00:20:09.590 | 1.00th=[ 14], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 33], 00:20:09.590 | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], 00:20:09.590 | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 129], 00:20:09.590 | 99.00th=[ 157], 99.50th=[ 167], 99.90th=[ 190], 99.95th=[ 190], 00:20:09.590 | 99.99th=[ 190] 00:20:09.590 bw ( KiB/s): min=132096, max=436224, per=14.15%, avg=268418.80, stdev=100267.10, samples=20 00:20:09.590 iops : min= 516, max= 1704, avg=1048.40, stdev=391.70, samples=20 00:20:09.590 lat (usec) : 750=0.03%, 1000=0.01% 00:20:09.590 lat (msec) : 2=0.02%, 4=0.10%, 10=0.48%, 20=1.07%, 50=50.50% 00:20:09.590 lat (msec) : 100=33.92%, 250=13.86% 00:20:09.590 cpu : usr=0.65%, sys=3.32%, ctx=1890, majf=0, minf=4097 00:20:09.590 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:09.590 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.590 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.590 issued rwts: total=10552,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.590 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.590 job4: (groupid=0, jobs=1): err= 0: pid=3935960: Thu Nov 28 04:26:45 2024 00:20:09.590 read: IOPS=958, BW=240MiB/s (251MB/s)(2400MiB/10011msec) 00:20:09.590 slat (usec): min=9, max=114479, avg=848.40, stdev=3532.73 00:20:09.590 clat (usec): min=1864, max=253783, avg=65859.12, stdev=50575.60 00:20:09.590 lat (usec): min=1886, max=253795, avg=66707.51, stdev=51185.06 00:20:09.590 clat percentiles (msec): 00:20:09.590 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 27], 20.00th=[ 29], 00:20:09.590 | 30.00th=[ 30], 40.00th=[ 31], 50.00th=[ 33], 60.00th=[ 47], 00:20:09.590 | 70.00th=[ 101], 80.00th=[ 123], 90.00th=[ 144], 95.00th=[ 159], 00:20:09.590 | 99.00th=[ 197], 99.50th=[ 209], 99.90th=[ 232], 99.95th=[ 239], 00:20:09.590 | 99.99th=[ 255] 00:20:09.590 bw ( KiB/s): min=94720, max=546304, per=12.17%, avg=230819.00, stdev=162133.84, samples=19 00:20:09.590 iops : min= 370, max= 2134, avg=901.53, stdev=633.29, samples=19 00:20:09.590 lat (msec) : 2=0.04%, 4=0.22%, 10=0.81%, 20=1.53%, 50=58.71% 00:20:09.590 lat (msec) : 100=8.79%, 250=29.85%, 500=0.04% 00:20:09.590 cpu : usr=0.63%, sys=3.11%, ctx=1811, majf=0, minf=4097 00:20:09.590 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:09.590 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.590 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.590 issued rwts: total=9599,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.590 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.590 job5: (groupid=0, jobs=1): err= 0: pid=3935965: Thu Nov 28 04:26:45 2024 00:20:09.590 read: IOPS=843, BW=211MiB/s (221MB/s)(2118MiB/10046msec) 00:20:09.590 slat (usec): min=9, max=84296, avg=956.02, stdev=3475.57 00:20:09.590 clat (msec): min=2, max=235, avg=74.87, stdev=40.40 00:20:09.590 lat (msec): min=2, max=263, avg=75.83, stdev=40.93 00:20:09.590 clat percentiles (msec): 00:20:09.590 | 1.00th=[ 10], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], 00:20:09.590 | 30.00th=[ 45], 40.00th=[ 55], 50.00th=[ 67], 60.00th=[ 86], 00:20:09.590 | 70.00th=[ 100], 80.00th=[ 111], 90.00th=[ 136], 95.00th=[ 150], 00:20:09.590 | 99.00th=[ 169], 99.50th=[ 176], 99.90th=[ 184], 99.95th=[ 186], 00:20:09.590 | 99.99th=[ 236] 00:20:09.590 bw ( KiB/s): min=105472, max=438930, per=11.34%, avg=215193.25, stdev=103691.93, samples=20 00:20:09.590 iops : min= 412, max= 1714, avg=840.45, stdev=405.00, samples=20 00:20:09.590 lat (msec) : 4=0.25%, 10=0.81%, 20=2.03%, 50=32.83%, 100=35.42% 00:20:09.590 lat (msec) : 250=28.66% 00:20:09.590 cpu : usr=0.44%, sys=2.90%, ctx=1625, majf=0, minf=4097 00:20:09.590 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:09.590 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.590 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.590 issued rwts: total=8473,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.590 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.590 job6: (groupid=0, jobs=1): err= 0: pid=3935966: Thu Nov 28 04:26:45 2024 00:20:09.590 read: IOPS=575, BW=144MiB/s (151MB/s)(1452MiB/10094msec) 00:20:09.590 slat (usec): min=9, max=176393, avg=1511.29, stdev=6376.10 00:20:09.590 clat (usec): min=1211, max=406986, avg=109661.44, stdev=65181.89 00:20:09.590 lat (usec): min=1237, max=407003, avg=111172.72, stdev=66164.25 00:20:09.590 clat percentiles (msec): 00:20:09.590 | 1.00th=[ 8], 5.00th=[ 25], 10.00th=[ 38], 20.00th=[ 55], 00:20:09.590 | 30.00th=[ 64], 40.00th=[ 74], 50.00th=[ 93], 60.00th=[ 126], 00:20:09.590 | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 203], 95.00th=[ 239], 00:20:09.590 | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 326], 99.95th=[ 351], 00:20:09.590 | 99.99th=[ 409] 00:20:09.591 bw ( KiB/s): min=62976, max=257021, per=7.75%, avg=146949.40, stdev=66648.33, samples=20 00:20:09.591 iops : min= 246, max= 1003, avg=573.95, stdev=260.26, samples=20 00:20:09.591 lat (msec) : 2=0.03%, 4=0.43%, 10=1.00%, 20=1.89%, 50=13.05% 00:20:09.591 lat (msec) : 100=35.23%, 250=44.31%, 500=4.05% 00:20:09.591 cpu : usr=0.29%, sys=1.92%, ctx=1103, majf=0, minf=4097 00:20:09.591 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:09.591 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.591 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.591 issued rwts: total=5807,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.591 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.591 job7: (groupid=0, jobs=1): err= 0: pid=3935967: Thu Nov 28 04:26:45 2024 00:20:09.591 read: IOPS=763, BW=191MiB/s (200MB/s)(1933MiB/10129msec) 00:20:09.591 slat (usec): min=9, max=137526, avg=833.98, stdev=4686.98 00:20:09.591 clat (usec): min=653, max=421525, avg=82956.20, stdev=59183.43 00:20:09.591 lat (usec): min=677, max=426166, avg=83790.18, stdev=60017.82 00:20:09.591 clat percentiles (msec): 00:20:09.591 | 1.00th=[ 6], 5.00th=[ 14], 10.00th=[ 20], 20.00th=[ 32], 00:20:09.591 | 30.00th=[ 42], 40.00th=[ 54], 50.00th=[ 69], 60.00th=[ 85], 00:20:09.591 | 70.00th=[ 112], 80.00th=[ 132], 90.00th=[ 153], 95.00th=[ 203], 00:20:09.591 | 99.00th=[ 279], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 388], 00:20:09.591 | 99.99th=[ 422] 00:20:09.591 bw ( KiB/s): min=52736, max=366080, per=10.34%, avg=196256.90, stdev=90032.06, samples=20 00:20:09.591 iops : min= 206, max= 1430, avg=766.55, stdev=351.71, samples=20 00:20:09.591 lat (usec) : 750=0.04%, 1000=0.01% 00:20:09.591 lat (msec) : 2=0.06%, 4=0.28%, 10=2.12%, 20=7.68%, 50=26.90% 00:20:09.591 lat (msec) : 100=28.56%, 250=32.63%, 500=1.69% 00:20:09.591 cpu : usr=0.35%, sys=2.04%, ctx=1545, majf=0, minf=4097 00:20:09.591 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:09.591 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.591 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.591 issued rwts: total=7731,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.591 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.591 job8: (groupid=0, jobs=1): err= 0: pid=3935968: Thu Nov 28 04:26:45 2024 00:20:09.591 read: IOPS=519, BW=130MiB/s (136MB/s)(1315MiB/10122msec) 00:20:09.591 slat (usec): min=12, max=56069, avg=1751.29, stdev=4932.94 00:20:09.591 clat (msec): min=16, max=246, avg=121.31, stdev=35.44 00:20:09.591 lat (msec): min=22, max=254, avg=123.06, stdev=35.99 00:20:09.591 clat percentiles (msec): 00:20:09.591 | 1.00th=[ 50], 5.00th=[ 70], 10.00th=[ 84], 20.00th=[ 94], 00:20:09.591 | 30.00th=[ 101], 40.00th=[ 107], 50.00th=[ 115], 60.00th=[ 127], 00:20:09.591 | 70.00th=[ 138], 80.00th=[ 150], 90.00th=[ 167], 95.00th=[ 188], 00:20:09.591 | 99.00th=[ 226], 99.50th=[ 232], 99.90th=[ 243], 99.95th=[ 245], 00:20:09.591 | 99.99th=[ 247] 00:20:09.591 bw ( KiB/s): min=87552, max=208384, per=7.01%, avg=132990.60, stdev=31487.75, samples=20 00:20:09.591 iops : min= 342, max= 814, avg=519.40, stdev=122.96, samples=20 00:20:09.591 lat (msec) : 20=0.02%, 50=1.05%, 100=27.47%, 250=71.46% 00:20:09.591 cpu : usr=0.34%, sys=1.95%, ctx=1040, majf=0, minf=3721 00:20:09.591 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:09.591 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.591 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.591 issued rwts: total=5260,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.591 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.591 job9: (groupid=0, jobs=1): err= 0: pid=3935969: Thu Nov 28 04:26:45 2024 00:20:09.591 read: IOPS=505, BW=126MiB/s (133MB/s)(1276MiB/10093msec) 00:20:09.591 slat (usec): min=9, max=77085, avg=1418.80, stdev=5471.80 00:20:09.591 clat (usec): min=839, max=320767, avg=125018.22, stdev=62671.10 00:20:09.591 lat (usec): min=857, max=345531, avg=126437.03, stdev=63578.20 00:20:09.591 clat percentiles (msec): 00:20:09.591 | 1.00th=[ 9], 5.00th=[ 21], 10.00th=[ 34], 20.00th=[ 83], 00:20:09.591 | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 124], 60.00th=[ 132], 00:20:09.591 | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 247], 00:20:09.591 | 99.00th=[ 296], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 317], 00:20:09.591 | 99.99th=[ 321] 00:20:09.591 bw ( KiB/s): min=61952, max=212992, per=6.80%, avg=129030.20, stdev=43485.74, samples=20 00:20:09.591 iops : min= 242, max= 832, avg=503.95, stdev=169.87, samples=20 00:20:09.591 lat (usec) : 1000=0.08% 00:20:09.591 lat (msec) : 2=0.14%, 4=0.29%, 10=0.84%, 20=3.33%, 50=9.13% 00:20:09.591 lat (msec) : 100=16.20%, 250=65.09%, 500=4.90% 00:20:09.591 cpu : usr=0.32%, sys=1.56%, ctx=1141, majf=0, minf=4097 00:20:09.591 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:09.591 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.591 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.591 issued rwts: total=5105,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.591 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.591 job10: (groupid=0, jobs=1): err= 0: pid=3935970: Thu Nov 28 04:26:45 2024 00:20:09.591 read: IOPS=617, BW=154MiB/s (162MB/s)(1558MiB/10086msec) 00:20:09.591 slat (usec): min=10, max=174651, avg=1178.54, stdev=4905.62 00:20:09.591 clat (usec): min=793, max=297157, avg=102306.97, stdev=53598.57 00:20:09.591 lat (usec): min=811, max=297181, avg=103485.50, stdev=54309.25 00:20:09.591 clat percentiles (msec): 00:20:09.591 | 1.00th=[ 3], 5.00th=[ 17], 10.00th=[ 27], 20.00th=[ 57], 00:20:09.591 | 30.00th=[ 78], 40.00th=[ 92], 50.00th=[ 101], 60.00th=[ 111], 00:20:09.591 | 70.00th=[ 128], 80.00th=[ 144], 90.00th=[ 169], 95.00th=[ 197], 00:20:09.591 | 99.00th=[ 251], 99.50th=[ 266], 99.90th=[ 284], 99.95th=[ 284], 00:20:09.591 | 99.99th=[ 296] 00:20:09.591 bw ( KiB/s): min=92672, max=254978, per=8.32%, avg=157870.05, stdev=50540.16, samples=20 00:20:09.591 iops : min= 362, max= 996, avg=616.65, stdev=197.40, samples=20 00:20:09.591 lat (usec) : 1000=0.08% 00:20:09.591 lat (msec) : 2=0.47%, 4=1.09%, 10=0.75%, 20=4.88%, 50=9.93% 00:20:09.591 lat (msec) : 100=32.84%, 250=48.87%, 500=1.09% 00:20:09.591 cpu : usr=0.34%, sys=1.97%, ctx=1394, majf=0, minf=4098 00:20:09.591 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:09.591 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:09.591 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:09.591 issued rwts: total=6233,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:09.591 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:09.591 00:20:09.591 Run status group 0 (all jobs): 00:20:09.591 READ: bw=1853MiB/s (1943MB/s), 119MiB/s-263MiB/s (125MB/s-275MB/s), io=18.3GiB (19.7GB), run=10011-10129msec 00:20:09.591 00:20:09.591 Disk stats (read/write): 00:20:09.591 nvme0n1: ios=9727/0, merge=0/0, ticks=1230973/0, in_queue=1230973, util=96.76% 00:20:09.591 nvme10n1: ios=12667/0, merge=0/0, ticks=1226953/0, in_queue=1226953, util=97.19% 00:20:09.591 nvme1n1: ios=9428/0, merge=0/0, ticks=1220500/0, in_queue=1220500, util=97.71% 00:20:09.591 nvme2n1: ios=20805/0, merge=0/0, ticks=1232885/0, in_queue=1232885, util=97.90% 00:20:09.591 nvme3n1: ios=18670/0, merge=0/0, ticks=1234253/0, in_queue=1234253, util=97.99% 00:20:09.591 nvme4n1: ios=16667/0, merge=0/0, ticks=1233799/0, in_queue=1233799, util=98.32% 00:20:09.591 nvme5n1: ios=11433/0, merge=0/0, ticks=1221662/0, in_queue=1221662, util=98.47% 00:20:09.591 nvme6n1: ios=15176/0, merge=0/0, ticks=1221290/0, in_queue=1221290, util=98.55% 00:20:09.591 nvme7n1: ios=10234/0, merge=0/0, ticks=1229371/0, in_queue=1229371, util=98.92% 00:20:09.591 nvme8n1: ios=10033/0, merge=0/0, ticks=1226460/0, in_queue=1226460, util=99.10% 00:20:09.591 nvme9n1: ios=12198/0, merge=0/0, ticks=1233081/0, in_queue=1233081, util=99.22% 00:20:09.591 04:26:45 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:09.591 [global] 00:20:09.591 thread=1 00:20:09.591 invalidate=1 00:20:09.591 rw=randwrite 00:20:09.591 time_based=1 00:20:09.591 runtime=10 00:20:09.591 ioengine=libaio 00:20:09.591 direct=1 00:20:09.591 bs=262144 00:20:09.591 iodepth=64 00:20:09.591 norandommap=1 00:20:09.591 numjobs=1 00:20:09.591 00:20:09.591 [job0] 00:20:09.591 filename=/dev/nvme0n1 00:20:09.591 [job1] 00:20:09.591 filename=/dev/nvme10n1 00:20:09.591 [job2] 00:20:09.591 filename=/dev/nvme1n1 00:20:09.591 [job3] 00:20:09.591 filename=/dev/nvme2n1 00:20:09.591 [job4] 00:20:09.591 filename=/dev/nvme3n1 00:20:09.591 [job5] 00:20:09.591 filename=/dev/nvme4n1 00:20:09.591 [job6] 00:20:09.591 filename=/dev/nvme5n1 00:20:09.591 [job7] 00:20:09.591 filename=/dev/nvme6n1 00:20:09.591 [job8] 00:20:09.591 filename=/dev/nvme7n1 00:20:09.591 [job9] 00:20:09.591 filename=/dev/nvme8n1 00:20:09.591 [job10] 00:20:09.591 filename=/dev/nvme9n1 00:20:09.591 Could not set queue depth (nvme0n1) 00:20:09.591 Could not set queue depth (nvme10n1) 00:20:09.591 Could not set queue depth (nvme1n1) 00:20:09.591 Could not set queue depth (nvme2n1) 00:20:09.591 Could not set queue depth (nvme3n1) 00:20:09.591 Could not set queue depth (nvme4n1) 00:20:09.591 Could not set queue depth (nvme5n1) 00:20:09.591 Could not set queue depth (nvme6n1) 00:20:09.591 Could not set queue depth (nvme7n1) 00:20:09.591 Could not set queue depth (nvme8n1) 00:20:09.591 Could not set queue depth (nvme9n1) 00:20:09.591 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.591 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.592 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:09.592 fio-3.35 00:20:09.592 Starting 11 threads 00:20:19.560 00:20:19.560 job0: (groupid=0, jobs=1): err= 0: pid=3937008: Thu Nov 28 04:26:56 2024 00:20:19.560 write: IOPS=509, BW=127MiB/s (133MB/s)(1289MiB/10123msec); 0 zone resets 00:20:19.560 slat (usec): min=20, max=58045, avg=1265.44, stdev=3494.99 00:20:19.560 clat (usec): min=767, max=390226, avg=124334.40, stdev=67079.40 00:20:19.560 lat (usec): min=803, max=390295, avg=125599.83, stdev=67659.10 00:20:19.560 clat percentiles (msec): 00:20:19.560 | 1.00th=[ 7], 5.00th=[ 19], 10.00th=[ 32], 20.00th=[ 75], 00:20:19.560 | 30.00th=[ 99], 40.00th=[ 108], 50.00th=[ 125], 60.00th=[ 136], 00:20:19.560 | 70.00th=[ 146], 80.00th=[ 159], 90.00th=[ 199], 95.00th=[ 268], 00:20:19.560 | 99.00th=[ 330], 99.50th=[ 347], 99.90th=[ 376], 99.95th=[ 384], 00:20:19.560 | 99.99th=[ 393] 00:20:19.560 bw ( KiB/s): min=57344, max=219136, per=8.88%, avg=130313.55, stdev=37016.62, samples=20 00:20:19.560 iops : min= 224, max= 856, avg=508.95, stdev=144.62, samples=20 00:20:19.560 lat (usec) : 1000=0.06% 00:20:19.560 lat (msec) : 2=0.16%, 4=0.31%, 10=1.26%, 20=3.73%, 50=9.00% 00:20:19.560 lat (msec) : 100=18.47%, 250=60.42%, 500=6.60% 00:20:19.560 cpu : usr=1.64%, sys=1.88%, ctx=2888, majf=0, minf=1 00:20:19.560 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:19.560 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.560 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.560 issued rwts: total=0,5154,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.560 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.560 job1: (groupid=0, jobs=1): err= 0: pid=3937020: Thu Nov 28 04:26:56 2024 00:20:19.560 write: IOPS=604, BW=151MiB/s (158MB/s)(1531MiB/10136msec); 0 zone resets 00:20:19.560 slat (usec): min=18, max=45379, avg=1253.79, stdev=3377.51 00:20:19.560 clat (usec): min=1313, max=359682, avg=104599.48, stdev=70816.01 00:20:19.560 lat (usec): min=1356, max=359774, avg=105853.27, stdev=71758.36 00:20:19.560 clat percentiles (msec): 00:20:19.560 | 1.00th=[ 7], 5.00th=[ 16], 10.00th=[ 29], 20.00th=[ 52], 00:20:19.560 | 30.00th=[ 58], 40.00th=[ 74], 50.00th=[ 97], 60.00th=[ 112], 00:20:19.560 | 70.00th=[ 122], 80.00th=[ 148], 90.00th=[ 203], 95.00th=[ 257], 00:20:19.560 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 359], 99.95th=[ 359], 00:20:19.560 | 99.99th=[ 359] 00:20:19.560 bw ( KiB/s): min=49152, max=304128, per=10.58%, avg=155203.40, stdev=75167.97, samples=20 00:20:19.560 iops : min= 192, max= 1188, avg=606.25, stdev=293.61, samples=20 00:20:19.560 lat (msec) : 2=0.08%, 4=0.39%, 10=1.98%, 20=4.46%, 50=12.20% 00:20:19.560 lat (msec) : 100=32.39%, 250=42.84%, 500=5.67% 00:20:19.560 cpu : usr=1.99%, sys=2.10%, ctx=3009, majf=0, minf=1 00:20:19.560 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:19.560 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.560 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.560 issued rwts: total=0,6125,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.560 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.560 job2: (groupid=0, jobs=1): err= 0: pid=3937021: Thu Nov 28 04:26:56 2024 00:20:19.560 write: IOPS=517, BW=129MiB/s (136MB/s)(1301MiB/10049msec); 0 zone resets 00:20:19.560 slat (usec): min=17, max=148269, avg=1209.59, stdev=4668.47 00:20:19.560 clat (usec): min=1765, max=508201, avg=122319.39, stdev=81309.65 00:20:19.560 lat (msec): min=2, max=508, avg=123.53, stdev=82.23 00:20:19.560 clat percentiles (msec): 00:20:19.560 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 39], 20.00th=[ 51], 00:20:19.560 | 30.00th=[ 62], 40.00th=[ 84], 50.00th=[ 109], 60.00th=[ 136], 00:20:19.560 | 70.00th=[ 155], 80.00th=[ 180], 90.00th=[ 236], 95.00th=[ 305], 00:20:19.560 | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 380], 99.95th=[ 510], 00:20:19.560 | 99.99th=[ 510] 00:20:19.560 bw ( KiB/s): min=49152, max=293376, per=8.97%, avg=131594.15, stdev=62608.04, samples=20 00:20:19.560 iops : min= 192, max= 1146, avg=514.00, stdev=244.59, samples=20 00:20:19.560 lat (msec) : 2=0.02%, 4=0.19%, 10=1.11%, 20=1.83%, 50=16.39% 00:20:19.561 lat (msec) : 100=27.85%, 250=43.94%, 500=8.61%, 750=0.06% 00:20:19.561 cpu : usr=1.66%, sys=1.73%, ctx=3066, majf=0, minf=1 00:20:19.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:19.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.561 issued rwts: total=0,5203,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.561 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.561 job3: (groupid=0, jobs=1): err= 0: pid=3937022: Thu Nov 28 04:26:56 2024 00:20:19.561 write: IOPS=480, BW=120MiB/s (126MB/s)(1217MiB/10139msec); 0 zone resets 00:20:19.561 slat (usec): min=18, max=132257, avg=1612.37, stdev=4795.94 00:20:19.561 clat (usec): min=916, max=547529, avg=131566.26, stdev=77944.44 00:20:19.561 lat (usec): min=1008, max=550285, avg=133178.63, stdev=78735.09 00:20:19.561 clat percentiles (msec): 00:20:19.561 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 22], 20.00th=[ 74], 00:20:19.561 | 30.00th=[ 92], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 153], 00:20:19.561 | 70.00th=[ 161], 80.00th=[ 176], 90.00th=[ 207], 95.00th=[ 255], 00:20:19.561 | 99.00th=[ 414], 99.50th=[ 477], 99.90th=[ 542], 99.95th=[ 542], 00:20:19.561 | 99.99th=[ 550] 00:20:19.561 bw ( KiB/s): min=32833, max=283592, per=8.38%, avg=122945.55, stdev=51041.64, samples=20 00:20:19.561 iops : min= 128, max= 1107, avg=480.20, stdev=199.28, samples=20 00:20:19.561 lat (usec) : 1000=0.02% 00:20:19.561 lat (msec) : 2=0.33%, 4=1.38%, 10=3.14%, 20=4.52%, 50=5.86% 00:20:19.561 lat (msec) : 100=17.59%, 250=61.64%, 500=5.12%, 750=0.41% 00:20:19.561 cpu : usr=1.30%, sys=1.58%, ctx=2358, majf=0, minf=1 00:20:19.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:19.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.561 issued rwts: total=0,4867,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.561 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.561 job4: (groupid=0, jobs=1): err= 0: pid=3937023: Thu Nov 28 04:26:56 2024 00:20:19.561 write: IOPS=343, BW=86.0MiB/s (90.1MB/s)(872MiB/10139msec); 0 zone resets 00:20:19.561 slat (usec): min=22, max=77605, avg=2681.60, stdev=5700.05 00:20:19.561 clat (msec): min=14, max=427, avg=183.39, stdev=67.95 00:20:19.561 lat (msec): min=17, max=427, avg=186.07, stdev=68.80 00:20:19.561 clat percentiles (msec): 00:20:19.561 | 1.00th=[ 50], 5.00th=[ 87], 10.00th=[ 102], 20.00th=[ 140], 00:20:19.561 | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 167], 60.00th=[ 180], 00:20:19.561 | 70.00th=[ 199], 80.00th=[ 236], 90.00th=[ 279], 95.00th=[ 326], 00:20:19.561 | 99.00th=[ 388], 99.50th=[ 409], 99.90th=[ 426], 99.95th=[ 426], 00:20:19.561 | 99.99th=[ 426] 00:20:19.561 bw ( KiB/s): min=47198, max=145920, per=5.97%, avg=87617.65, stdev=25654.23, samples=20 00:20:19.561 iops : min= 184, max= 570, avg=342.20, stdev=100.26, samples=20 00:20:19.561 lat (msec) : 20=0.06%, 50=1.00%, 100=8.58%, 250=74.56%, 500=15.81% 00:20:19.561 cpu : usr=1.11%, sys=1.19%, ctx=1138, majf=0, minf=1 00:20:19.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=98.2% 00:20:19.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.561 issued rwts: total=0,3486,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.561 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.561 job5: (groupid=0, jobs=1): err= 0: pid=3937024: Thu Nov 28 04:26:56 2024 00:20:19.561 write: IOPS=538, BW=135MiB/s (141MB/s)(1360MiB/10111msec); 0 zone resets 00:20:19.561 slat (usec): min=22, max=29584, avg=1111.47, stdev=3247.58 00:20:19.561 clat (msec): min=3, max=428, avg=117.75, stdev=68.87 00:20:19.561 lat (msec): min=3, max=428, avg=118.86, stdev=69.66 00:20:19.561 clat percentiles (msec): 00:20:19.561 | 1.00th=[ 13], 5.00th=[ 35], 10.00th=[ 43], 20.00th=[ 58], 00:20:19.561 | 30.00th=[ 77], 40.00th=[ 95], 50.00th=[ 117], 60.00th=[ 129], 00:20:19.561 | 70.00th=[ 140], 80.00th=[ 153], 90.00th=[ 178], 95.00th=[ 275], 00:20:19.561 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 405], 99.95th=[ 418], 00:20:19.561 | 99.99th=[ 430] 00:20:19.561 bw ( KiB/s): min=49152, max=209920, per=9.38%, avg=137657.85, stdev=39930.73, samples=20 00:20:19.561 iops : min= 192, max= 820, avg=537.65, stdev=156.05, samples=20 00:20:19.561 lat (msec) : 4=0.02%, 10=0.70%, 20=1.03%, 50=14.34%, 100=26.02% 00:20:19.561 lat (msec) : 250=51.35%, 500=6.54% 00:20:19.561 cpu : usr=1.57%, sys=2.18%, ctx=3237, majf=0, minf=1 00:20:19.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:19.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.561 issued rwts: total=0,5441,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.561 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.561 job6: (groupid=0, jobs=1): err= 0: pid=3937028: Thu Nov 28 04:26:56 2024 00:20:19.561 write: IOPS=638, BW=160MiB/s (167MB/s)(1614MiB/10118msec); 0 zone resets 00:20:19.561 slat (usec): min=22, max=50073, avg=1072.11, stdev=2728.18 00:20:19.561 clat (usec): min=881, max=548086, avg=99175.60, stdev=63681.49 00:20:19.561 lat (usec): min=957, max=551196, avg=100247.71, stdev=64193.43 00:20:19.561 clat percentiles (msec): 00:20:19.561 | 1.00th=[ 9], 5.00th=[ 28], 10.00th=[ 41], 20.00th=[ 45], 00:20:19.561 | 30.00th=[ 57], 40.00th=[ 75], 50.00th=[ 86], 60.00th=[ 108], 00:20:19.561 | 70.00th=[ 123], 80.00th=[ 148], 90.00th=[ 163], 95.00th=[ 207], 00:20:19.561 | 99.00th=[ 309], 99.50th=[ 338], 99.90th=[ 542], 99.95th=[ 542], 00:20:19.561 | 99.99th=[ 550] 00:20:19.561 bw ( KiB/s): min=45056, max=328704, per=11.15%, avg=163685.80, stdev=70360.75, samples=20 00:20:19.561 iops : min= 176, max= 1284, avg=639.35, stdev=274.78, samples=20 00:20:19.561 lat (usec) : 1000=0.06% 00:20:19.561 lat (msec) : 2=0.28%, 4=0.23%, 10=0.65%, 20=1.77%, 50=24.10% 00:20:19.561 lat (msec) : 100=29.63%, 250=40.41%, 500=2.49%, 750=0.37% 00:20:19.561 cpu : usr=2.00%, sys=2.19%, ctx=3169, majf=0, minf=1 00:20:19.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:19.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.561 issued rwts: total=0,6456,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.561 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.561 job7: (groupid=0, jobs=1): err= 0: pid=3937029: Thu Nov 28 04:26:56 2024 00:20:19.561 write: IOPS=563, BW=141MiB/s (148MB/s)(1427MiB/10123msec); 0 zone resets 00:20:19.561 slat (usec): min=20, max=118450, avg=1369.56, stdev=3842.17 00:20:19.561 clat (usec): min=1166, max=467218, avg=112089.22, stdev=69448.39 00:20:19.561 lat (usec): min=1582, max=470812, avg=113458.78, stdev=70197.73 00:20:19.561 clat percentiles (msec): 00:20:19.561 | 1.00th=[ 10], 5.00th=[ 39], 10.00th=[ 41], 20.00th=[ 43], 00:20:19.561 | 30.00th=[ 74], 40.00th=[ 94], 50.00th=[ 107], 60.00th=[ 126], 00:20:19.561 | 70.00th=[ 140], 80.00th=[ 155], 90.00th=[ 176], 95.00th=[ 209], 00:20:19.561 | 99.00th=[ 414], 99.50th=[ 447], 99.90th=[ 464], 99.95th=[ 464], 00:20:19.561 | 99.99th=[ 468] 00:20:19.561 bw ( KiB/s): min=60928, max=385536, per=9.84%, avg=144483.95, stdev=71047.27, samples=20 00:20:19.561 iops : min= 238, max= 1506, avg=564.30, stdev=277.55, samples=20 00:20:19.561 lat (msec) : 2=0.05%, 4=0.28%, 10=0.86%, 20=1.30%, 50=22.70% 00:20:19.561 lat (msec) : 100=19.81%, 250=51.58%, 500=3.42% 00:20:19.561 cpu : usr=1.94%, sys=2.01%, ctx=2419, majf=0, minf=2 00:20:19.561 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:19.561 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.561 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.561 issued rwts: total=0,5708,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.561 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.561 job8: (groupid=0, jobs=1): err= 0: pid=3937031: Thu Nov 28 04:26:56 2024 00:20:19.561 write: IOPS=664, BW=166MiB/s (174MB/s)(1681MiB/10122msec); 0 zone resets 00:20:19.562 slat (usec): min=23, max=118117, avg=1268.41, stdev=3270.09 00:20:19.562 clat (msec): min=2, max=363, avg=94.99, stdev=60.89 00:20:19.562 lat (msec): min=3, max=374, avg=96.26, stdev=61.64 00:20:19.562 clat percentiles (msec): 00:20:19.562 | 1.00th=[ 17], 5.00th=[ 41], 10.00th=[ 42], 20.00th=[ 44], 00:20:19.562 | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 78], 60.00th=[ 107], 00:20:19.562 | 70.00th=[ 124], 80.00th=[ 146], 90.00th=[ 167], 95.00th=[ 203], 00:20:19.562 | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 359], 99.95th=[ 359], 00:20:19.562 | 99.99th=[ 363] 00:20:19.562 bw ( KiB/s): min=67584, max=378880, per=11.62%, avg=170506.20, stdev=93524.16, samples=20 00:20:19.562 iops : min= 264, max= 1480, avg=666.00, stdev=365.27, samples=20 00:20:19.562 lat (msec) : 4=0.03%, 10=0.21%, 20=1.62%, 50=37.43%, 100=17.68% 00:20:19.562 lat (msec) : 250=40.41%, 500=2.62% 00:20:19.562 cpu : usr=2.04%, sys=2.58%, ctx=2380, majf=0, minf=1 00:20:19.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:19.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.562 issued rwts: total=0,6724,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.562 job9: (groupid=0, jobs=1): err= 0: pid=3937033: Thu Nov 28 04:26:56 2024 00:20:19.562 write: IOPS=438, BW=110MiB/s (115MB/s)(1109MiB/10118msec); 0 zone resets 00:20:19.562 slat (usec): min=24, max=199494, avg=1785.05, stdev=5518.27 00:20:19.562 clat (msec): min=5, max=511, avg=144.16, stdev=71.46 00:20:19.562 lat (msec): min=5, max=511, avg=145.95, stdev=72.48 00:20:19.562 clat percentiles (msec): 00:20:19.562 | 1.00th=[ 18], 5.00th=[ 47], 10.00th=[ 74], 20.00th=[ 91], 00:20:19.562 | 30.00th=[ 110], 40.00th=[ 118], 50.00th=[ 138], 60.00th=[ 148], 00:20:19.562 | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 230], 95.00th=[ 266], 00:20:19.562 | 99.00th=[ 464], 99.50th=[ 493], 99.90th=[ 510], 99.95th=[ 510], 00:20:19.562 | 99.99th=[ 510] 00:20:19.562 bw ( KiB/s): min=39424, max=218112, per=7.62%, avg=111900.55, stdev=39502.26, samples=20 00:20:19.562 iops : min= 154, max= 852, avg=437.10, stdev=154.31, samples=20 00:20:19.562 lat (msec) : 10=0.14%, 20=1.31%, 50=3.81%, 100=18.13%, 250=69.63% 00:20:19.562 lat (msec) : 500=6.72%, 750=0.27% 00:20:19.562 cpu : usr=1.48%, sys=1.55%, ctx=2042, majf=0, minf=1 00:20:19.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:19.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.562 issued rwts: total=0,4435,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.562 job10: (groupid=0, jobs=1): err= 0: pid=3937034: Thu Nov 28 04:26:56 2024 00:20:19.562 write: IOPS=447, BW=112MiB/s (117MB/s)(1132MiB/10125msec); 0 zone resets 00:20:19.562 slat (usec): min=26, max=257031, avg=1949.02, stdev=6094.64 00:20:19.562 clat (msec): min=4, max=606, avg=141.08, stdev=86.95 00:20:19.562 lat (msec): min=4, max=607, avg=143.03, stdev=88.24 00:20:19.562 clat percentiles (msec): 00:20:19.562 | 1.00th=[ 20], 5.00th=[ 39], 10.00th=[ 58], 20.00th=[ 60], 00:20:19.562 | 30.00th=[ 85], 40.00th=[ 109], 50.00th=[ 128], 60.00th=[ 146], 00:20:19.562 | 70.00th=[ 167], 80.00th=[ 197], 90.00th=[ 253], 95.00th=[ 330], 00:20:19.562 | 99.00th=[ 393], 99.50th=[ 464], 99.90th=[ 584], 99.95th=[ 609], 00:20:19.562 | 99.99th=[ 609] 00:20:19.562 bw ( KiB/s): min=30720, max=275456, per=7.79%, avg=114282.85, stdev=59417.66, samples=20 00:20:19.562 iops : min= 120, max= 1076, avg=446.35, stdev=232.15, samples=20 00:20:19.562 lat (msec) : 10=0.22%, 20=0.88%, 50=5.30%, 100=27.92%, 250=55.47% 00:20:19.562 lat (msec) : 500=9.87%, 750=0.33% 00:20:19.562 cpu : usr=1.30%, sys=1.82%, ctx=1734, majf=0, minf=2 00:20:19.562 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:19.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:19.562 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:19.562 issued rwts: total=0,4527,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:19.562 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:19.562 00:20:19.562 Run status group 0 (all jobs): 00:20:19.562 WRITE: bw=1433MiB/s (1503MB/s), 86.0MiB/s-166MiB/s (90.1MB/s-174MB/s), io=14.2GiB (15.2GB), run=10049-10139msec 00:20:19.562 00:20:19.562 Disk stats (read/write): 00:20:19.562 nvme0n1: ios=51/10122, merge=0/0, ticks=896/1220357, in_queue=1221253, util=99.93% 00:20:19.562 nvme10n1: ios=40/12064, merge=0/0, ticks=37/1217231, in_queue=1217268, util=97.43% 00:20:19.562 nvme1n1: ios=46/10073, merge=0/0, ticks=821/1226328, in_queue=1227149, util=100.00% 00:20:19.562 nvme2n1: ios=41/9570, merge=0/0, ticks=869/1213465, in_queue=1214334, util=100.00% 00:20:19.562 nvme3n1: ios=47/6807, merge=0/0, ticks=71/1206672, in_queue=1206743, util=98.24% 00:20:19.562 nvme4n1: ios=36/10668, merge=0/0, ticks=237/1224122, in_queue=1224359, util=100.00% 00:20:19.562 nvme5n1: ios=0/12719, merge=0/0, ticks=0/1219201, in_queue=1219201, util=98.25% 00:20:19.562 nvme6n1: ios=0/11229, merge=0/0, ticks=0/1215006, in_queue=1215006, util=98.40% 00:20:19.562 nvme7n1: ios=41/13259, merge=0/0, ticks=443/1209012, in_queue=1209455, util=100.00% 00:20:19.562 nvme8n1: ios=18/8683, merge=0/0, ticks=146/1215480, in_queue=1215626, util=99.06% 00:20:19.562 nvme9n1: ios=31/8861, merge=0/0, ticks=3486/1197271, in_queue=1200757, util=100.00% 00:20:19.562 04:26:56 -- target/multiconnection.sh@36 -- # sync 00:20:19.562 04:26:56 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:19.562 04:26:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:19.562 04:26:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:19.562 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:19.562 04:26:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:19.562 04:26:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:19.562 04:26:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:19.562 04:26:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:19.562 04:26:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:19.562 04:26:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:19.562 04:26:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:19.562 04:26:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:19.562 04:26:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:19.562 04:26:56 -- common/autotest_common.sh@10 -- # set +x 00:20:19.562 04:26:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:19.562 04:26:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:19.562 04:26:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:19.562 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:19.562 04:26:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:19.562 04:26:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:19.562 04:26:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:19.562 04:26:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:19.562 04:26:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:19.562 04:26:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:19.562 04:26:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:19.562 04:26:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:19.562 04:26:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:19.562 04:26:56 -- common/autotest_common.sh@10 -- # set +x 00:20:19.562 04:26:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:19.562 04:26:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:19.562 04:26:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:19.820 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:19.820 04:26:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:19.820 04:26:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:19.820 04:26:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:19.820 04:26:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:19.820 04:26:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:19.820 04:26:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:19.820 04:26:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:19.820 04:26:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:19.820 04:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:19.820 04:26:57 -- common/autotest_common.sh@10 -- # set +x 00:20:19.820 04:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:19.820 04:26:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:19.820 04:26:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:20.078 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:20.078 04:26:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:20.079 04:26:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:20.079 04:26:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:20.079 04:26:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:20.079 04:26:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:20.079 04:26:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:20.079 04:26:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:20.079 04:26:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:20.079 04:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:20.079 04:26:57 -- common/autotest_common.sh@10 -- # set +x 00:20:20.079 04:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:20.079 04:26:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:20.079 04:26:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:20.336 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:20.336 04:26:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:20.336 04:26:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:20.336 04:26:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:20.336 04:26:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:20.336 04:26:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:20.336 04:26:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:20.336 04:26:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:20.336 04:26:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:20.336 04:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:20.336 04:26:57 -- common/autotest_common.sh@10 -- # set +x 00:20:20.336 04:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:20.337 04:26:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:20.337 04:26:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:20.595 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:20.595 04:26:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:20.595 04:26:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:20.595 04:26:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:20.595 04:26:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:20.595 04:26:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:20.595 04:26:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:20.595 04:26:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:20.595 04:26:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:20.595 04:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:20.595 04:26:57 -- common/autotest_common.sh@10 -- # set +x 00:20:20.595 04:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:20.595 04:26:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:20.595 04:26:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:20.854 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:20.854 04:26:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:20.854 04:26:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:20.854 04:26:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:20.854 04:26:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:20.854 04:26:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:20.854 04:26:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:20.854 04:26:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:20.854 04:26:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:20.854 04:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:20.854 04:26:57 -- common/autotest_common.sh@10 -- # set +x 00:20:20.854 04:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:20.854 04:26:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:20.854 04:26:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:21.111 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:21.111 04:26:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:21.111 04:26:58 -- common/autotest_common.sh@1208 -- # local i=0 00:20:21.111 04:26:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:21.111 04:26:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:21.111 04:26:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:21.111 04:26:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:21.111 04:26:58 -- common/autotest_common.sh@1220 -- # return 0 00:20:21.111 04:26:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:21.112 04:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.112 04:26:58 -- common/autotest_common.sh@10 -- # set +x 00:20:21.112 04:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.112 04:26:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:21.112 04:26:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:21.112 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:21.112 04:26:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:21.112 04:26:58 -- common/autotest_common.sh@1208 -- # local i=0 00:20:21.112 04:26:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:21.112 04:26:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:21.112 04:26:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:21.112 04:26:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:21.112 04:26:58 -- common/autotest_common.sh@1220 -- # return 0 00:20:21.112 04:26:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:21.112 04:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.112 04:26:58 -- common/autotest_common.sh@10 -- # set +x 00:20:21.112 04:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.112 04:26:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:21.112 04:26:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:21.112 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:21.112 04:26:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:21.112 04:26:58 -- common/autotest_common.sh@1208 -- # local i=0 00:20:21.112 04:26:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:21.112 04:26:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:21.112 04:26:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:21.112 04:26:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:21.370 04:26:58 -- common/autotest_common.sh@1220 -- # return 0 00:20:21.370 04:26:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:21.370 04:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.370 04:26:58 -- common/autotest_common.sh@10 -- # set +x 00:20:21.370 04:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.370 04:26:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:21.370 04:26:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:21.370 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:21.370 04:26:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:21.370 04:26:58 -- common/autotest_common.sh@1208 -- # local i=0 00:20:21.370 04:26:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:21.370 04:26:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:21.370 04:26:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:21.370 04:26:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:21.370 04:26:58 -- common/autotest_common.sh@1220 -- # return 0 00:20:21.370 04:26:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:21.370 04:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:21.370 04:26:58 -- common/autotest_common.sh@10 -- # set +x 00:20:21.370 04:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:21.370 04:26:58 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:21.370 04:26:58 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:21.370 04:26:58 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:21.370 04:26:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:21.370 04:26:58 -- nvmf/common.sh@116 -- # sync 00:20:21.370 04:26:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:21.370 04:26:58 -- nvmf/common.sh@119 -- # set +e 00:20:21.370 04:26:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:21.370 04:26:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:21.370 rmmod nvme_tcp 00:20:21.370 rmmod nvme_fabrics 00:20:21.370 rmmod nvme_keyring 00:20:21.370 04:26:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:21.370 04:26:58 -- nvmf/common.sh@123 -- # set -e 00:20:21.370 04:26:58 -- nvmf/common.sh@124 -- # return 0 00:20:21.370 04:26:58 -- nvmf/common.sh@477 -- # '[' -n 3931442 ']' 00:20:21.370 04:26:58 -- nvmf/common.sh@478 -- # killprocess 3931442 00:20:21.370 04:26:58 -- common/autotest_common.sh@936 -- # '[' -z 3931442 ']' 00:20:21.370 04:26:58 -- common/autotest_common.sh@940 -- # kill -0 3931442 00:20:21.370 04:26:58 -- common/autotest_common.sh@941 -- # uname 00:20:21.370 04:26:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:21.370 04:26:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3931442 00:20:21.370 04:26:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:21.370 04:26:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:21.370 04:26:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3931442' 00:20:21.370 killing process with pid 3931442 00:20:21.370 04:26:58 -- common/autotest_common.sh@955 -- # kill 3931442 00:20:21.370 04:26:58 -- common/autotest_common.sh@960 -- # wait 3931442 00:20:21.937 04:26:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:21.937 04:26:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:21.937 04:26:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:21.937 04:26:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:21.937 04:26:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:21.937 04:26:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:21.937 04:26:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:21.937 04:26:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:24.471 04:27:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:24.471 00:20:24.471 real 1m1.240s 00:20:24.471 user 3m19.082s 00:20:24.471 sys 0m27.822s 00:20:24.471 04:27:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:24.471 04:27:01 -- common/autotest_common.sh@10 -- # set +x 00:20:24.471 ************************************ 00:20:24.471 END TEST nvmf_multiconnection 00:20:24.471 ************************************ 00:20:24.471 04:27:01 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:24.471 04:27:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:24.471 04:27:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:24.471 04:27:01 -- common/autotest_common.sh@10 -- # set +x 00:20:24.471 ************************************ 00:20:24.471 START TEST nvmf_initiator_timeout 00:20:24.471 ************************************ 00:20:24.471 04:27:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:24.471 * Looking for test storage... 00:20:24.471 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:24.471 04:27:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:24.471 04:27:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:24.471 04:27:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:24.471 04:27:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:24.471 04:27:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:24.471 04:27:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:24.471 04:27:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:24.471 04:27:01 -- scripts/common.sh@335 -- # IFS=.-: 00:20:24.471 04:27:01 -- scripts/common.sh@335 -- # read -ra ver1 00:20:24.471 04:27:01 -- scripts/common.sh@336 -- # IFS=.-: 00:20:24.471 04:27:01 -- scripts/common.sh@336 -- # read -ra ver2 00:20:24.471 04:27:01 -- scripts/common.sh@337 -- # local 'op=<' 00:20:24.471 04:27:01 -- scripts/common.sh@339 -- # ver1_l=2 00:20:24.471 04:27:01 -- scripts/common.sh@340 -- # ver2_l=1 00:20:24.471 04:27:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:24.471 04:27:01 -- scripts/common.sh@343 -- # case "$op" in 00:20:24.471 04:27:01 -- scripts/common.sh@344 -- # : 1 00:20:24.471 04:27:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:24.471 04:27:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:24.471 04:27:01 -- scripts/common.sh@364 -- # decimal 1 00:20:24.471 04:27:01 -- scripts/common.sh@352 -- # local d=1 00:20:24.471 04:27:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:24.471 04:27:01 -- scripts/common.sh@354 -- # echo 1 00:20:24.471 04:27:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:24.471 04:27:01 -- scripts/common.sh@365 -- # decimal 2 00:20:24.471 04:27:01 -- scripts/common.sh@352 -- # local d=2 00:20:24.471 04:27:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:24.471 04:27:01 -- scripts/common.sh@354 -- # echo 2 00:20:24.471 04:27:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:24.471 04:27:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:24.471 04:27:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:24.471 04:27:01 -- scripts/common.sh@367 -- # return 0 00:20:24.471 04:27:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:24.471 04:27:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:24.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:24.471 --rc genhtml_branch_coverage=1 00:20:24.471 --rc genhtml_function_coverage=1 00:20:24.471 --rc genhtml_legend=1 00:20:24.471 --rc geninfo_all_blocks=1 00:20:24.471 --rc geninfo_unexecuted_blocks=1 00:20:24.471 00:20:24.471 ' 00:20:24.471 04:27:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:24.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:24.471 --rc genhtml_branch_coverage=1 00:20:24.471 --rc genhtml_function_coverage=1 00:20:24.471 --rc genhtml_legend=1 00:20:24.471 --rc geninfo_all_blocks=1 00:20:24.471 --rc geninfo_unexecuted_blocks=1 00:20:24.471 00:20:24.471 ' 00:20:24.471 04:27:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:24.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:24.471 --rc genhtml_branch_coverage=1 00:20:24.471 --rc genhtml_function_coverage=1 00:20:24.471 --rc genhtml_legend=1 00:20:24.471 --rc geninfo_all_blocks=1 00:20:24.471 --rc geninfo_unexecuted_blocks=1 00:20:24.471 00:20:24.471 ' 00:20:24.471 04:27:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:24.471 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:24.471 --rc genhtml_branch_coverage=1 00:20:24.471 --rc genhtml_function_coverage=1 00:20:24.471 --rc genhtml_legend=1 00:20:24.471 --rc geninfo_all_blocks=1 00:20:24.471 --rc geninfo_unexecuted_blocks=1 00:20:24.471 00:20:24.471 ' 00:20:24.471 04:27:01 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:24.471 04:27:01 -- nvmf/common.sh@7 -- # uname -s 00:20:24.471 04:27:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:24.471 04:27:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:24.471 04:27:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:24.471 04:27:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:24.471 04:27:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:24.471 04:27:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:24.471 04:27:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:24.471 04:27:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:24.471 04:27:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:24.472 04:27:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:24.472 04:27:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:24.472 04:27:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:24.472 04:27:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:24.472 04:27:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:24.472 04:27:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:24.472 04:27:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:24.472 04:27:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:24.472 04:27:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:24.472 04:27:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:24.472 04:27:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.472 04:27:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.472 04:27:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.472 04:27:01 -- paths/export.sh@5 -- # export PATH 00:20:24.472 04:27:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:24.472 04:27:01 -- nvmf/common.sh@46 -- # : 0 00:20:24.472 04:27:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:24.472 04:27:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:24.472 04:27:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:24.472 04:27:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:24.472 04:27:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:24.472 04:27:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:24.472 04:27:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:24.472 04:27:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:24.472 04:27:01 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:24.472 04:27:01 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:24.472 04:27:01 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:24.472 04:27:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:24.472 04:27:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:24.472 04:27:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:24.472 04:27:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:24.472 04:27:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:24.472 04:27:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:24.472 04:27:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:24.472 04:27:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:24.472 04:27:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:24.472 04:27:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:24.472 04:27:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:24.472 04:27:01 -- common/autotest_common.sh@10 -- # set +x 00:20:26.373 04:27:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:26.373 04:27:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:26.373 04:27:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:26.373 04:27:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:26.373 04:27:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:26.373 04:27:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:26.373 04:27:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:26.373 04:27:03 -- nvmf/common.sh@294 -- # net_devs=() 00:20:26.373 04:27:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:26.373 04:27:03 -- nvmf/common.sh@295 -- # e810=() 00:20:26.373 04:27:03 -- nvmf/common.sh@295 -- # local -ga e810 00:20:26.373 04:27:03 -- nvmf/common.sh@296 -- # x722=() 00:20:26.373 04:27:03 -- nvmf/common.sh@296 -- # local -ga x722 00:20:26.373 04:27:03 -- nvmf/common.sh@297 -- # mlx=() 00:20:26.373 04:27:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:26.373 04:27:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:26.373 04:27:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:26.373 04:27:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:26.373 04:27:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:26.373 04:27:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:26.373 04:27:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:26.373 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:26.373 04:27:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:26.373 04:27:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:26.373 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:26.373 04:27:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:26.373 04:27:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:26.373 04:27:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:26.373 04:27:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:26.373 04:27:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:26.373 04:27:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:26.374 04:27:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:26.374 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:26.374 04:27:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:26.374 04:27:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:26.374 04:27:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:26.374 04:27:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:26.374 04:27:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:26.374 04:27:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:26.374 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:26.374 04:27:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:26.374 04:27:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:26.374 04:27:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:26.374 04:27:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:26.374 04:27:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:26.374 04:27:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:26.374 04:27:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:26.374 04:27:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:26.374 04:27:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:26.374 04:27:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:26.374 04:27:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:26.374 04:27:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:26.374 04:27:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:26.374 04:27:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:26.374 04:27:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:26.374 04:27:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:26.374 04:27:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:26.374 04:27:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:26.374 04:27:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:26.374 04:27:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:26.374 04:27:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:26.374 04:27:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:26.374 04:27:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:26.633 04:27:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:26.633 04:27:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:26.633 04:27:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:26.633 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:26.633 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:20:26.633 00:20:26.633 --- 10.0.0.2 ping statistics --- 00:20:26.633 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:26.633 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:20:26.633 04:27:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:26.633 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:26.633 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:20:26.633 00:20:26.633 --- 10.0.0.1 ping statistics --- 00:20:26.633 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:26.633 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:20:26.633 04:27:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:26.633 04:27:03 -- nvmf/common.sh@410 -- # return 0 00:20:26.633 04:27:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:26.633 04:27:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:26.633 04:27:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:26.633 04:27:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:26.633 04:27:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:26.633 04:27:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:26.633 04:27:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:26.633 04:27:03 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:26.633 04:27:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:26.633 04:27:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:26.633 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:20:26.633 04:27:03 -- nvmf/common.sh@469 -- # nvmfpid=3940540 00:20:26.633 04:27:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:26.633 04:27:03 -- nvmf/common.sh@470 -- # waitforlisten 3940540 00:20:26.633 04:27:03 -- common/autotest_common.sh@829 -- # '[' -z 3940540 ']' 00:20:26.633 04:27:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:26.633 04:27:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:26.633 04:27:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:26.633 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:26.633 04:27:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:26.633 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:20:26.633 [2024-11-28 04:27:03.797066] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:26.633 [2024-11-28 04:27:03.797146] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:26.633 EAL: No free 2048 kB hugepages reported on node 1 00:20:26.633 [2024-11-28 04:27:03.871074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:26.892 [2024-11-28 04:27:03.981241] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:26.892 [2024-11-28 04:27:03.981402] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:26.892 [2024-11-28 04:27:03.981435] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:26.892 [2024-11-28 04:27:03.981448] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:26.892 [2024-11-28 04:27:03.981502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:26.892 [2024-11-28 04:27:03.981600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:26.892 [2024-11-28 04:27:03.981603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:26.892 [2024-11-28 04:27:03.981543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:27.827 04:27:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:27.827 04:27:04 -- common/autotest_common.sh@862 -- # return 0 00:20:27.827 04:27:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:27.827 04:27:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:27.827 04:27:04 -- common/autotest_common.sh@10 -- # set +x 00:20:27.827 04:27:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:27.827 04:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.827 04:27:04 -- common/autotest_common.sh@10 -- # set +x 00:20:27.827 Malloc0 00:20:27.827 04:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:27.827 04:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.827 04:27:04 -- common/autotest_common.sh@10 -- # set +x 00:20:27.827 Delay0 00:20:27.827 04:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:27.827 04:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.827 04:27:04 -- common/autotest_common.sh@10 -- # set +x 00:20:27.827 [2024-11-28 04:27:04.872588] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:27.827 04:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:27.827 04:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.827 04:27:04 -- common/autotest_common.sh@10 -- # set +x 00:20:27.827 04:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:27.827 04:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.827 04:27:04 -- common/autotest_common.sh@10 -- # set +x 00:20:27.827 04:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:27.827 04:27:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:27.827 04:27:04 -- common/autotest_common.sh@10 -- # set +x 00:20:27.827 [2024-11-28 04:27:04.900939] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:27.827 04:27:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:27.827 04:27:04 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:28.394 04:27:05 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:28.394 04:27:05 -- common/autotest_common.sh@1187 -- # local i=0 00:20:28.394 04:27:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:28.394 04:27:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:28.394 04:27:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:30.920 04:27:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:30.920 04:27:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:30.920 04:27:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:30.920 04:27:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:30.920 04:27:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:30.920 04:27:07 -- common/autotest_common.sh@1197 -- # return 0 00:20:30.920 04:27:07 -- target/initiator_timeout.sh@35 -- # fio_pid=3941345 00:20:30.920 04:27:07 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:30.920 04:27:07 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:30.920 [global] 00:20:30.920 thread=1 00:20:30.920 invalidate=1 00:20:30.920 rw=write 00:20:30.920 time_based=1 00:20:30.920 runtime=60 00:20:30.920 ioengine=libaio 00:20:30.920 direct=1 00:20:30.920 bs=4096 00:20:30.920 iodepth=1 00:20:30.920 norandommap=0 00:20:30.920 numjobs=1 00:20:30.920 00:20:30.920 verify_dump=1 00:20:30.920 verify_backlog=512 00:20:30.920 verify_state_save=0 00:20:30.920 do_verify=1 00:20:30.920 verify=crc32c-intel 00:20:30.920 [job0] 00:20:30.920 filename=/dev/nvme0n1 00:20:30.920 Could not set queue depth (nvme0n1) 00:20:30.920 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:30.920 fio-3.35 00:20:30.920 Starting 1 thread 00:20:33.449 04:27:10 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:33.449 04:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.449 04:27:10 -- common/autotest_common.sh@10 -- # set +x 00:20:33.449 true 00:20:33.449 04:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.449 04:27:10 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:33.449 04:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.449 04:27:10 -- common/autotest_common.sh@10 -- # set +x 00:20:33.449 true 00:20:33.449 04:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.449 04:27:10 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:33.449 04:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.449 04:27:10 -- common/autotest_common.sh@10 -- # set +x 00:20:33.449 true 00:20:33.449 04:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.449 04:27:10 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:33.449 04:27:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.449 04:27:10 -- common/autotest_common.sh@10 -- # set +x 00:20:33.449 true 00:20:33.449 04:27:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.449 04:27:10 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:36.727 04:27:13 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:36.727 04:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.727 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:20:36.727 true 00:20:36.727 04:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.727 04:27:13 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:36.727 04:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.727 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:20:36.727 true 00:20:36.727 04:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.727 04:27:13 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:36.727 04:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.727 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:20:36.727 true 00:20:36.727 04:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.727 04:27:13 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:36.727 04:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:36.727 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:20:36.727 true 00:20:36.727 04:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:36.727 04:27:13 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:36.727 04:27:13 -- target/initiator_timeout.sh@54 -- # wait 3941345 00:21:32.998 00:21:32.998 job0: (groupid=0, jobs=1): err= 0: pid=3941477: Thu Nov 28 04:28:08 2024 00:21:32.998 read: IOPS=31, BW=126KiB/s (129kB/s)(7572KiB/60036msec) 00:21:32.998 slat (nsec): min=5598, max=46738, avg=13203.60, stdev=8147.40 00:21:32.998 clat (usec): min=238, max=41110k, avg=31425.74, stdev=944804.27 00:21:32.998 lat (usec): min=243, max=41110k, avg=31438.94, stdev=944804.47 00:21:32.998 clat percentiles (usec): 00:21:32.998 | 1.00th=[ 247], 5.00th=[ 255], 10.00th=[ 262], 00:21:32.998 | 20.00th=[ 269], 30.00th=[ 277], 40.00th=[ 289], 00:21:32.999 | 50.00th=[ 318], 60.00th=[ 338], 70.00th=[ 355], 00:21:32.999 | 80.00th=[ 41157], 90.00th=[ 41157], 95.00th=[ 41157], 00:21:32.999 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 42206], 00:21:32.999 | 99.95th=[17112761], 99.99th=[17112761] 00:21:32.999 write: IOPS=34, BW=136KiB/s (140kB/s)(8192KiB/60036msec); 0 zone resets 00:21:32.999 slat (usec): min=5, max=29048, avg=26.96, stdev=641.63 00:21:32.999 clat (usec): min=181, max=335, avg=220.54, stdev=21.57 00:21:32.999 lat (usec): min=189, max=29322, avg=247.50, stdev=643.24 00:21:32.999 clat percentiles (usec): 00:21:32.999 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 198], 20.00th=[ 204], 00:21:32.999 | 30.00th=[ 206], 40.00th=[ 212], 50.00th=[ 217], 60.00th=[ 221], 00:21:32.999 | 70.00th=[ 229], 80.00th=[ 237], 90.00th=[ 247], 95.00th=[ 260], 00:21:32.999 | 99.00th=[ 293], 99.50th=[ 297], 99.90th=[ 302], 99.95th=[ 318], 00:21:32.999 | 99.99th=[ 334] 00:21:32.999 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=5461.33, stdev=2364.83, samples=3 00:21:32.999 iops : min= 1024, max= 2048, avg=1365.33, stdev=591.21, samples=3 00:21:32.999 lat (usec) : 250=48.77%, 500=40.07%, 750=0.03% 00:21:32.999 lat (msec) : 50=11.11%, >=2000=0.03% 00:21:32.999 cpu : usr=0.06%, sys=0.12%, ctx=3944, majf=0, minf=1 00:21:32.999 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:32.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:32.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:32.999 issued rwts: total=1893,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:32.999 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:32.999 00:21:32.999 Run status group 0 (all jobs): 00:21:32.999 READ: bw=126KiB/s (129kB/s), 126KiB/s-126KiB/s (129kB/s-129kB/s), io=7572KiB (7754kB), run=60036-60036msec 00:21:32.999 WRITE: bw=136KiB/s (140kB/s), 136KiB/s-136KiB/s (140kB/s-140kB/s), io=8192KiB (8389kB), run=60036-60036msec 00:21:32.999 00:21:32.999 Disk stats (read/write): 00:21:32.999 nvme0n1: ios=1942/2048, merge=0/0, ticks=18742/436, in_queue=19178, util=99.73% 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:32.999 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:32.999 04:28:08 -- common/autotest_common.sh@1208 -- # local i=0 00:21:32.999 04:28:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:32.999 04:28:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:32.999 04:28:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:32.999 04:28:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:32.999 04:28:08 -- common/autotest_common.sh@1220 -- # return 0 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:32.999 nvmf hotplug test: fio successful as expected 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:32.999 04:28:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.999 04:28:08 -- common/autotest_common.sh@10 -- # set +x 00:21:32.999 04:28:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:32.999 04:28:08 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:32.999 04:28:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:32.999 04:28:08 -- nvmf/common.sh@116 -- # sync 00:21:32.999 04:28:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:32.999 04:28:08 -- nvmf/common.sh@119 -- # set +e 00:21:32.999 04:28:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:32.999 04:28:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:32.999 rmmod nvme_tcp 00:21:32.999 rmmod nvme_fabrics 00:21:32.999 rmmod nvme_keyring 00:21:32.999 04:28:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:32.999 04:28:08 -- nvmf/common.sh@123 -- # set -e 00:21:32.999 04:28:08 -- nvmf/common.sh@124 -- # return 0 00:21:32.999 04:28:08 -- nvmf/common.sh@477 -- # '[' -n 3940540 ']' 00:21:32.999 04:28:08 -- nvmf/common.sh@478 -- # killprocess 3940540 00:21:32.999 04:28:08 -- common/autotest_common.sh@936 -- # '[' -z 3940540 ']' 00:21:32.999 04:28:08 -- common/autotest_common.sh@940 -- # kill -0 3940540 00:21:32.999 04:28:08 -- common/autotest_common.sh@941 -- # uname 00:21:32.999 04:28:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:32.999 04:28:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3940540 00:21:32.999 04:28:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:32.999 04:28:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:32.999 04:28:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3940540' 00:21:32.999 killing process with pid 3940540 00:21:32.999 04:28:08 -- common/autotest_common.sh@955 -- # kill 3940540 00:21:32.999 04:28:08 -- common/autotest_common.sh@960 -- # wait 3940540 00:21:32.999 04:28:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:32.999 04:28:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:32.999 04:28:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:32.999 04:28:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:32.999 04:28:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:32.999 04:28:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:32.999 04:28:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:32.999 04:28:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:33.257 04:28:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:33.257 00:21:33.257 real 1m9.351s 00:21:33.257 user 4m15.054s 00:21:33.257 sys 0m6.077s 00:21:33.257 04:28:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:33.257 04:28:10 -- common/autotest_common.sh@10 -- # set +x 00:21:33.257 ************************************ 00:21:33.257 END TEST nvmf_initiator_timeout 00:21:33.257 ************************************ 00:21:33.515 04:28:10 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:33.515 04:28:10 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:33.515 04:28:10 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:33.515 04:28:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:33.515 04:28:10 -- common/autotest_common.sh@10 -- # set +x 00:21:35.415 04:28:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:35.415 04:28:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:35.415 04:28:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:35.415 04:28:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:35.415 04:28:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:35.415 04:28:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:35.415 04:28:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:35.415 04:28:12 -- nvmf/common.sh@294 -- # net_devs=() 00:21:35.415 04:28:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:35.415 04:28:12 -- nvmf/common.sh@295 -- # e810=() 00:21:35.415 04:28:12 -- nvmf/common.sh@295 -- # local -ga e810 00:21:35.415 04:28:12 -- nvmf/common.sh@296 -- # x722=() 00:21:35.415 04:28:12 -- nvmf/common.sh@296 -- # local -ga x722 00:21:35.415 04:28:12 -- nvmf/common.sh@297 -- # mlx=() 00:21:35.415 04:28:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:35.415 04:28:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:35.415 04:28:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:35.415 04:28:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:35.415 04:28:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:35.415 04:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:35.415 04:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:35.415 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:35.415 04:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:35.415 04:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:35.415 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:35.415 04:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:35.415 04:28:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:35.415 04:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:35.415 04:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:35.415 04:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:35.415 04:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:35.415 04:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:35.415 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:35.415 04:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:35.415 04:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:35.415 04:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:35.415 04:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:35.415 04:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:35.415 04:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:35.415 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:35.415 04:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:35.415 04:28:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:35.415 04:28:12 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:35.415 04:28:12 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:35.416 04:28:12 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:35.416 04:28:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:35.416 04:28:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:35.416 04:28:12 -- common/autotest_common.sh@10 -- # set +x 00:21:35.416 ************************************ 00:21:35.416 START TEST nvmf_perf_adq 00:21:35.416 ************************************ 00:21:35.416 04:28:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:35.416 * Looking for test storage... 00:21:35.416 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:35.416 04:28:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:35.416 04:28:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:35.416 04:28:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:35.674 04:28:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:35.674 04:28:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:35.674 04:28:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:35.674 04:28:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:35.674 04:28:12 -- scripts/common.sh@335 -- # IFS=.-: 00:21:35.674 04:28:12 -- scripts/common.sh@335 -- # read -ra ver1 00:21:35.674 04:28:12 -- scripts/common.sh@336 -- # IFS=.-: 00:21:35.674 04:28:12 -- scripts/common.sh@336 -- # read -ra ver2 00:21:35.674 04:28:12 -- scripts/common.sh@337 -- # local 'op=<' 00:21:35.674 04:28:12 -- scripts/common.sh@339 -- # ver1_l=2 00:21:35.674 04:28:12 -- scripts/common.sh@340 -- # ver2_l=1 00:21:35.674 04:28:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:35.674 04:28:12 -- scripts/common.sh@343 -- # case "$op" in 00:21:35.674 04:28:12 -- scripts/common.sh@344 -- # : 1 00:21:35.674 04:28:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:35.674 04:28:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:35.674 04:28:12 -- scripts/common.sh@364 -- # decimal 1 00:21:35.674 04:28:12 -- scripts/common.sh@352 -- # local d=1 00:21:35.674 04:28:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:35.674 04:28:12 -- scripts/common.sh@354 -- # echo 1 00:21:35.674 04:28:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:35.674 04:28:12 -- scripts/common.sh@365 -- # decimal 2 00:21:35.674 04:28:12 -- scripts/common.sh@352 -- # local d=2 00:21:35.674 04:28:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:35.674 04:28:12 -- scripts/common.sh@354 -- # echo 2 00:21:35.674 04:28:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:35.674 04:28:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:35.674 04:28:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:35.674 04:28:12 -- scripts/common.sh@367 -- # return 0 00:21:35.674 04:28:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:35.674 04:28:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:35.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.674 --rc genhtml_branch_coverage=1 00:21:35.674 --rc genhtml_function_coverage=1 00:21:35.674 --rc genhtml_legend=1 00:21:35.674 --rc geninfo_all_blocks=1 00:21:35.674 --rc geninfo_unexecuted_blocks=1 00:21:35.674 00:21:35.674 ' 00:21:35.674 04:28:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:35.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.674 --rc genhtml_branch_coverage=1 00:21:35.674 --rc genhtml_function_coverage=1 00:21:35.674 --rc genhtml_legend=1 00:21:35.674 --rc geninfo_all_blocks=1 00:21:35.674 --rc geninfo_unexecuted_blocks=1 00:21:35.674 00:21:35.674 ' 00:21:35.674 04:28:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:35.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.675 --rc genhtml_branch_coverage=1 00:21:35.675 --rc genhtml_function_coverage=1 00:21:35.675 --rc genhtml_legend=1 00:21:35.675 --rc geninfo_all_blocks=1 00:21:35.675 --rc geninfo_unexecuted_blocks=1 00:21:35.675 00:21:35.675 ' 00:21:35.675 04:28:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:35.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.675 --rc genhtml_branch_coverage=1 00:21:35.675 --rc genhtml_function_coverage=1 00:21:35.675 --rc genhtml_legend=1 00:21:35.675 --rc geninfo_all_blocks=1 00:21:35.675 --rc geninfo_unexecuted_blocks=1 00:21:35.675 00:21:35.675 ' 00:21:35.675 04:28:12 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:35.675 04:28:12 -- nvmf/common.sh@7 -- # uname -s 00:21:35.675 04:28:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:35.675 04:28:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:35.675 04:28:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:35.675 04:28:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:35.675 04:28:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:35.675 04:28:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:35.675 04:28:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:35.675 04:28:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:35.675 04:28:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:35.675 04:28:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:35.675 04:28:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:35.675 04:28:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:35.675 04:28:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:35.675 04:28:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:35.675 04:28:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:35.675 04:28:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:35.675 04:28:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:35.675 04:28:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:35.675 04:28:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:35.675 04:28:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.675 04:28:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.675 04:28:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.675 04:28:12 -- paths/export.sh@5 -- # export PATH 00:21:35.675 04:28:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.675 04:28:12 -- nvmf/common.sh@46 -- # : 0 00:21:35.675 04:28:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:35.675 04:28:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:35.675 04:28:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:35.675 04:28:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:35.675 04:28:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:35.675 04:28:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:35.675 04:28:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:35.675 04:28:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:35.675 04:28:12 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:35.675 04:28:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:35.675 04:28:12 -- common/autotest_common.sh@10 -- # set +x 00:21:38.209 04:28:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:38.209 04:28:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:38.209 04:28:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:38.209 04:28:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:38.209 04:28:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:38.209 04:28:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:38.210 04:28:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:38.210 04:28:14 -- nvmf/common.sh@294 -- # net_devs=() 00:21:38.210 04:28:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:38.210 04:28:14 -- nvmf/common.sh@295 -- # e810=() 00:21:38.210 04:28:14 -- nvmf/common.sh@295 -- # local -ga e810 00:21:38.210 04:28:14 -- nvmf/common.sh@296 -- # x722=() 00:21:38.210 04:28:14 -- nvmf/common.sh@296 -- # local -ga x722 00:21:38.210 04:28:14 -- nvmf/common.sh@297 -- # mlx=() 00:21:38.210 04:28:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:38.210 04:28:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:38.210 04:28:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:38.210 04:28:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:38.210 04:28:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:38.210 04:28:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:38.210 04:28:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:38.210 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:38.210 04:28:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:38.210 04:28:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:38.210 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:38.210 04:28:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:38.210 04:28:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:38.210 04:28:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:38.210 04:28:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:38.210 04:28:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:38.210 04:28:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:38.210 04:28:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:38.210 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:38.210 04:28:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:38.210 04:28:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:38.210 04:28:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:38.210 04:28:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:38.210 04:28:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:38.210 04:28:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:38.210 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:38.210 04:28:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:38.210 04:28:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:38.210 04:28:14 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:38.210 04:28:14 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:38.210 04:28:14 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:38.210 04:28:14 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:38.210 04:28:14 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:38.469 04:28:15 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:41.000 04:28:18 -- target/perf_adq.sh@54 -- # sleep 5 00:21:46.270 04:28:23 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:46.270 04:28:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:46.270 04:28:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:46.270 04:28:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:46.270 04:28:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:46.270 04:28:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:46.270 04:28:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:46.270 04:28:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:46.270 04:28:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:46.270 04:28:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:46.270 04:28:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:46.270 04:28:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:46.270 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.270 04:28:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:46.270 04:28:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:46.270 04:28:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:46.270 04:28:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:46.270 04:28:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:46.270 04:28:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:46.270 04:28:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:46.270 04:28:23 -- nvmf/common.sh@294 -- # net_devs=() 00:21:46.270 04:28:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:46.270 04:28:23 -- nvmf/common.sh@295 -- # e810=() 00:21:46.270 04:28:23 -- nvmf/common.sh@295 -- # local -ga e810 00:21:46.270 04:28:23 -- nvmf/common.sh@296 -- # x722=() 00:21:46.270 04:28:23 -- nvmf/common.sh@296 -- # local -ga x722 00:21:46.270 04:28:23 -- nvmf/common.sh@297 -- # mlx=() 00:21:46.270 04:28:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:46.270 04:28:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:46.270 04:28:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:46.270 04:28:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:46.270 04:28:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:46.271 04:28:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:46.271 04:28:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:46.271 04:28:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:46.271 04:28:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.271 04:28:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:46.271 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:46.271 04:28:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:46.271 04:28:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:46.271 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:46.271 04:28:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:46.271 04:28:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.271 04:28:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.271 04:28:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.271 04:28:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.271 04:28:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:46.271 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:46.271 04:28:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.271 04:28:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:46.271 04:28:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.271 04:28:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:46.271 04:28:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.271 04:28:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:46.271 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:46.271 04:28:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.271 04:28:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:46.271 04:28:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:46.271 04:28:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:46.271 04:28:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:46.271 04:28:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:46.271 04:28:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:46.271 04:28:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:46.271 04:28:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:46.271 04:28:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:46.271 04:28:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:46.271 04:28:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:46.271 04:28:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:46.271 04:28:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:46.271 04:28:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:46.271 04:28:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:46.271 04:28:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:46.271 04:28:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:46.271 04:28:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:46.271 04:28:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:46.271 04:28:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:46.271 04:28:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:46.271 04:28:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:46.271 04:28:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:46.271 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:46.271 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:21:46.271 00:21:46.271 --- 10.0.0.2 ping statistics --- 00:21:46.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.271 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:21:46.271 04:28:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:46.271 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:46.271 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:21:46.271 00:21:46.271 --- 10.0.0.1 ping statistics --- 00:21:46.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.271 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:21:46.271 04:28:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:46.271 04:28:23 -- nvmf/common.sh@410 -- # return 0 00:21:46.271 04:28:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:46.271 04:28:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:46.271 04:28:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:46.271 04:28:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:46.271 04:28:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:46.271 04:28:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:46.271 04:28:23 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:46.271 04:28:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:46.271 04:28:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:46.271 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.271 04:28:23 -- nvmf/common.sh@469 -- # nvmfpid=3953621 00:21:46.271 04:28:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:46.271 04:28:23 -- nvmf/common.sh@470 -- # waitforlisten 3953621 00:21:46.271 04:28:23 -- common/autotest_common.sh@829 -- # '[' -z 3953621 ']' 00:21:46.271 04:28:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:46.271 04:28:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:46.271 04:28:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:46.271 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:46.271 04:28:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:46.271 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.271 [2024-11-28 04:28:23.275519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:46.271 [2024-11-28 04:28:23.275627] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:46.271 EAL: No free 2048 kB hugepages reported on node 1 00:21:46.271 [2024-11-28 04:28:23.348478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:46.271 [2024-11-28 04:28:23.459980] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:46.271 [2024-11-28 04:28:23.460123] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:46.271 [2024-11-28 04:28:23.460139] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:46.271 [2024-11-28 04:28:23.460151] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:46.271 [2024-11-28 04:28:23.460205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:46.271 [2024-11-28 04:28:23.460264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:46.271 [2024-11-28 04:28:23.460333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:46.271 [2024-11-28 04:28:23.460330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:46.271 04:28:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:46.271 04:28:23 -- common/autotest_common.sh@862 -- # return 0 00:21:46.271 04:28:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:46.271 04:28:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:46.271 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.271 04:28:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:46.271 04:28:23 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:46.271 04:28:23 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:46.271 04:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.271 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.271 04:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.271 04:28:23 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:46.271 04:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.271 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.529 04:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.529 04:28:23 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:46.529 04:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.529 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.529 [2024-11-28 04:28:23.655144] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:46.529 04:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.529 04:28:23 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:46.529 04:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.529 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.529 Malloc1 00:21:46.529 04:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.529 04:28:23 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:46.529 04:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.529 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.529 04:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.529 04:28:23 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:46.529 04:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.529 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.529 04:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.529 04:28:23 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:46.529 04:28:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.529 04:28:23 -- common/autotest_common.sh@10 -- # set +x 00:21:46.529 [2024-11-28 04:28:23.708463] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:46.529 04:28:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.529 04:28:23 -- target/perf_adq.sh@73 -- # perfpid=3953648 00:21:46.529 04:28:23 -- target/perf_adq.sh@74 -- # sleep 2 00:21:46.529 04:28:23 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:46.529 EAL: No free 2048 kB hugepages reported on node 1 00:21:48.428 04:28:25 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:48.428 04:28:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.428 04:28:25 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:48.428 04:28:25 -- common/autotest_common.sh@10 -- # set +x 00:21:48.428 04:28:25 -- target/perf_adq.sh@76 -- # wc -l 00:21:48.428 04:28:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.686 04:28:25 -- target/perf_adq.sh@76 -- # count=4 00:21:48.686 04:28:25 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:48.686 04:28:25 -- target/perf_adq.sh@81 -- # wait 3953648 00:21:56.791 Initializing NVMe Controllers 00:21:56.791 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:56.791 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:56.791 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:56.791 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:56.791 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:56.791 Initialization complete. Launching workers. 00:21:56.791 ======================================================== 00:21:56.791 Latency(us) 00:21:56.791 Device Information : IOPS MiB/s Average min max 00:21:56.791 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11144.80 43.53 5744.95 1173.24 9576.21 00:21:56.791 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11326.09 44.24 5651.57 2162.73 9459.39 00:21:56.792 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10457.23 40.85 6122.19 1192.44 10547.38 00:21:56.792 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11035.90 43.11 5801.92 1862.55 9481.97 00:21:56.792 ======================================================== 00:21:56.792 Total : 43964.03 171.73 5824.92 1173.24 10547.38 00:21:56.792 00:21:56.792 04:28:33 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:56.792 04:28:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:56.792 04:28:33 -- nvmf/common.sh@116 -- # sync 00:21:56.792 04:28:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:56.792 04:28:33 -- nvmf/common.sh@119 -- # set +e 00:21:56.792 04:28:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:56.792 04:28:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:56.792 rmmod nvme_tcp 00:21:56.792 rmmod nvme_fabrics 00:21:56.792 rmmod nvme_keyring 00:21:56.792 04:28:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:56.792 04:28:33 -- nvmf/common.sh@123 -- # set -e 00:21:56.792 04:28:33 -- nvmf/common.sh@124 -- # return 0 00:21:56.792 04:28:33 -- nvmf/common.sh@477 -- # '[' -n 3953621 ']' 00:21:56.792 04:28:33 -- nvmf/common.sh@478 -- # killprocess 3953621 00:21:56.792 04:28:33 -- common/autotest_common.sh@936 -- # '[' -z 3953621 ']' 00:21:56.792 04:28:33 -- common/autotest_common.sh@940 -- # kill -0 3953621 00:21:56.792 04:28:33 -- common/autotest_common.sh@941 -- # uname 00:21:56.792 04:28:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:56.792 04:28:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3953621 00:21:56.792 04:28:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:56.792 04:28:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:56.792 04:28:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3953621' 00:21:56.792 killing process with pid 3953621 00:21:56.792 04:28:34 -- common/autotest_common.sh@955 -- # kill 3953621 00:21:56.792 04:28:34 -- common/autotest_common.sh@960 -- # wait 3953621 00:21:57.050 04:28:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:57.050 04:28:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:57.050 04:28:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:57.050 04:28:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:57.050 04:28:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:57.050 04:28:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:57.050 04:28:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:57.050 04:28:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:59.588 04:28:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:59.588 04:28:36 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:59.588 04:28:36 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:59.847 04:28:37 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:02.377 04:28:39 -- target/perf_adq.sh@54 -- # sleep 5 00:22:07.651 04:28:44 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:07.651 04:28:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:07.651 04:28:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:07.651 04:28:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:07.651 04:28:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:07.651 04:28:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:07.651 04:28:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.651 04:28:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.651 04:28:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:07.651 04:28:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:07.651 04:28:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:07.651 04:28:44 -- common/autotest_common.sh@10 -- # set +x 00:22:07.651 04:28:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:07.651 04:28:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:07.651 04:28:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:07.651 04:28:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:07.651 04:28:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:07.651 04:28:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:07.651 04:28:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:07.651 04:28:44 -- nvmf/common.sh@294 -- # net_devs=() 00:22:07.651 04:28:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:07.651 04:28:44 -- nvmf/common.sh@295 -- # e810=() 00:22:07.651 04:28:44 -- nvmf/common.sh@295 -- # local -ga e810 00:22:07.651 04:28:44 -- nvmf/common.sh@296 -- # x722=() 00:22:07.651 04:28:44 -- nvmf/common.sh@296 -- # local -ga x722 00:22:07.651 04:28:44 -- nvmf/common.sh@297 -- # mlx=() 00:22:07.651 04:28:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:07.651 04:28:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:07.651 04:28:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:07.651 04:28:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:07.651 04:28:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:07.651 04:28:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:07.651 04:28:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:07.651 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:07.651 04:28:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:07.651 04:28:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:07.651 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:07.651 04:28:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:07.651 04:28:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:07.651 04:28:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:07.651 04:28:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:07.651 04:28:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:07.651 04:28:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:07.651 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:07.651 04:28:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:07.651 04:28:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:07.651 04:28:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:07.651 04:28:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:07.651 04:28:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:07.651 04:28:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:07.651 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:07.651 04:28:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:07.651 04:28:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:07.651 04:28:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:07.651 04:28:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:07.651 04:28:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:07.651 04:28:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:07.651 04:28:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:07.651 04:28:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:07.651 04:28:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:07.651 04:28:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:07.651 04:28:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:07.651 04:28:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:07.651 04:28:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:07.651 04:28:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:07.651 04:28:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:07.651 04:28:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:07.651 04:28:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:07.651 04:28:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:07.651 04:28:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:07.651 04:28:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:07.651 04:28:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:07.651 04:28:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:07.651 04:28:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:07.651 04:28:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:07.651 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:07.651 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:22:07.651 00:22:07.651 --- 10.0.0.2 ping statistics --- 00:22:07.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:07.651 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:22:07.651 04:28:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:07.651 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:07.651 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:22:07.651 00:22:07.651 --- 10.0.0.1 ping statistics --- 00:22:07.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:07.651 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:22:07.651 04:28:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:07.651 04:28:44 -- nvmf/common.sh@410 -- # return 0 00:22:07.651 04:28:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:07.651 04:28:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:07.651 04:28:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:07.651 04:28:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:07.651 04:28:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:07.651 04:28:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:07.651 04:28:44 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:07.651 04:28:44 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:07.651 04:28:44 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:07.651 04:28:44 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:07.651 net.core.busy_poll = 1 00:22:07.651 04:28:44 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:07.651 net.core.busy_read = 1 00:22:07.651 04:28:44 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:07.651 04:28:44 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:07.651 04:28:44 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:07.651 04:28:44 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:07.651 04:28:44 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:07.651 04:28:44 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:07.651 04:28:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:07.651 04:28:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:07.651 04:28:44 -- common/autotest_common.sh@10 -- # set +x 00:22:07.651 04:28:44 -- nvmf/common.sh@469 -- # nvmfpid=3956479 00:22:07.651 04:28:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:07.651 04:28:44 -- nvmf/common.sh@470 -- # waitforlisten 3956479 00:22:07.651 04:28:44 -- common/autotest_common.sh@829 -- # '[' -z 3956479 ']' 00:22:07.651 04:28:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:07.651 04:28:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:07.651 04:28:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:07.651 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:07.651 04:28:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:07.651 04:28:44 -- common/autotest_common.sh@10 -- # set +x 00:22:07.651 [2024-11-28 04:28:44.819896] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:07.651 [2024-11-28 04:28:44.819983] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:07.651 EAL: No free 2048 kB hugepages reported on node 1 00:22:07.651 [2024-11-28 04:28:44.883810] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:07.917 [2024-11-28 04:28:44.996026] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:07.917 [2024-11-28 04:28:44.996199] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:07.917 [2024-11-28 04:28:44.996216] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:07.917 [2024-11-28 04:28:44.996228] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:07.917 [2024-11-28 04:28:44.996280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:07.917 [2024-11-28 04:28:44.996339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:07.917 [2024-11-28 04:28:44.996418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:07.917 [2024-11-28 04:28:44.996415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:07.917 04:28:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:07.917 04:28:45 -- common/autotest_common.sh@862 -- # return 0 00:22:07.917 04:28:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:07.917 04:28:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:07.917 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:07.917 04:28:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:07.917 04:28:45 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:07.918 04:28:45 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:07.918 04:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.918 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:07.918 04:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.918 04:28:45 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:07.918 04:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.918 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:07.918 04:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.918 04:28:45 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:07.918 04:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.918 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:07.918 [2024-11-28 04:28:45.187462] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:07.918 04:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.918 04:28:45 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:07.918 04:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.918 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:07.918 Malloc1 00:22:07.918 04:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.918 04:28:45 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:07.918 04:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.918 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:08.176 04:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.176 04:28:45 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:08.176 04:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.176 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:08.176 04:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.176 04:28:45 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:08.176 04:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.176 04:28:45 -- common/autotest_common.sh@10 -- # set +x 00:22:08.176 [2024-11-28 04:28:45.241035] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:08.176 04:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.176 04:28:45 -- target/perf_adq.sh@94 -- # perfpid=3956502 00:22:08.176 04:28:45 -- target/perf_adq.sh@95 -- # sleep 2 00:22:08.176 04:28:45 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:08.176 EAL: No free 2048 kB hugepages reported on node 1 00:22:10.077 04:28:47 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:10.077 04:28:47 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:10.077 04:28:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.077 04:28:47 -- target/perf_adq.sh@97 -- # wc -l 00:22:10.077 04:28:47 -- common/autotest_common.sh@10 -- # set +x 00:22:10.077 04:28:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.077 04:28:47 -- target/perf_adq.sh@97 -- # count=2 00:22:10.077 04:28:47 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:10.077 04:28:47 -- target/perf_adq.sh@103 -- # wait 3956502 00:22:18.189 Initializing NVMe Controllers 00:22:18.190 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:18.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:18.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:18.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:18.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:18.190 Initialization complete. Launching workers. 00:22:18.190 ======================================================== 00:22:18.190 Latency(us) 00:22:18.190 Device Information : IOPS MiB/s Average min max 00:22:18.190 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5027.80 19.64 12729.71 1708.69 60870.30 00:22:18.190 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5223.40 20.40 12252.48 1273.05 62147.39 00:22:18.190 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 14026.80 54.79 4562.99 1063.76 46564.93 00:22:18.190 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4984.70 19.47 12840.00 1634.71 59186.17 00:22:18.190 ======================================================== 00:22:18.190 Total : 29262.70 114.31 8748.67 1063.76 62147.39 00:22:18.190 00:22:18.190 04:28:55 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:18.190 04:28:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:18.190 04:28:55 -- nvmf/common.sh@116 -- # sync 00:22:18.190 04:28:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:18.190 04:28:55 -- nvmf/common.sh@119 -- # set +e 00:22:18.190 04:28:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:18.190 04:28:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:18.190 rmmod nvme_tcp 00:22:18.190 rmmod nvme_fabrics 00:22:18.190 rmmod nvme_keyring 00:22:18.190 04:28:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:18.190 04:28:55 -- nvmf/common.sh@123 -- # set -e 00:22:18.190 04:28:55 -- nvmf/common.sh@124 -- # return 0 00:22:18.190 04:28:55 -- nvmf/common.sh@477 -- # '[' -n 3956479 ']' 00:22:18.190 04:28:55 -- nvmf/common.sh@478 -- # killprocess 3956479 00:22:18.190 04:28:55 -- common/autotest_common.sh@936 -- # '[' -z 3956479 ']' 00:22:18.190 04:28:55 -- common/autotest_common.sh@940 -- # kill -0 3956479 00:22:18.190 04:28:55 -- common/autotest_common.sh@941 -- # uname 00:22:18.190 04:28:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:18.190 04:28:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3956479 00:22:18.190 04:28:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:18.190 04:28:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:18.190 04:28:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3956479' 00:22:18.190 killing process with pid 3956479 00:22:18.190 04:28:55 -- common/autotest_common.sh@955 -- # kill 3956479 00:22:18.190 04:28:55 -- common/autotest_common.sh@960 -- # wait 3956479 00:22:18.755 04:28:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:18.755 04:28:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:18.755 04:28:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:18.755 04:28:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:18.755 04:28:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:18.755 04:28:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:18.755 04:28:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:18.755 04:28:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:22.108 04:28:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:22.108 04:28:58 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:22.108 00:22:22.108 real 0m46.193s 00:22:22.108 user 2m36.428s 00:22:22.108 sys 0m11.110s 00:22:22.108 04:28:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:22.108 04:28:58 -- common/autotest_common.sh@10 -- # set +x 00:22:22.108 ************************************ 00:22:22.108 END TEST nvmf_perf_adq 00:22:22.108 ************************************ 00:22:22.108 04:28:58 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:22.108 04:28:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:22.108 04:28:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:22.108 04:28:58 -- common/autotest_common.sh@10 -- # set +x 00:22:22.108 ************************************ 00:22:22.108 START TEST nvmf_shutdown 00:22:22.108 ************************************ 00:22:22.108 04:28:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:22.108 * Looking for test storage... 00:22:22.108 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:22.108 04:28:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:22.108 04:28:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:22.108 04:28:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:22.108 04:28:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:22.108 04:28:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:22.108 04:28:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:22.108 04:28:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:22.108 04:28:58 -- scripts/common.sh@335 -- # IFS=.-: 00:22:22.108 04:28:58 -- scripts/common.sh@335 -- # read -ra ver1 00:22:22.108 04:28:58 -- scripts/common.sh@336 -- # IFS=.-: 00:22:22.108 04:28:58 -- scripts/common.sh@336 -- # read -ra ver2 00:22:22.108 04:28:58 -- scripts/common.sh@337 -- # local 'op=<' 00:22:22.108 04:28:58 -- scripts/common.sh@339 -- # ver1_l=2 00:22:22.108 04:28:58 -- scripts/common.sh@340 -- # ver2_l=1 00:22:22.108 04:28:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:22.108 04:28:58 -- scripts/common.sh@343 -- # case "$op" in 00:22:22.108 04:28:58 -- scripts/common.sh@344 -- # : 1 00:22:22.108 04:28:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:22.108 04:28:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:22.108 04:28:58 -- scripts/common.sh@364 -- # decimal 1 00:22:22.108 04:28:58 -- scripts/common.sh@352 -- # local d=1 00:22:22.108 04:28:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:22.108 04:28:58 -- scripts/common.sh@354 -- # echo 1 00:22:22.108 04:28:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:22.108 04:28:58 -- scripts/common.sh@365 -- # decimal 2 00:22:22.108 04:28:59 -- scripts/common.sh@352 -- # local d=2 00:22:22.108 04:28:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:22.108 04:28:59 -- scripts/common.sh@354 -- # echo 2 00:22:22.108 04:28:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:22.108 04:28:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:22.108 04:28:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:22.108 04:28:59 -- scripts/common.sh@367 -- # return 0 00:22:22.108 04:28:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:22.108 04:28:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:22.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.108 --rc genhtml_branch_coverage=1 00:22:22.108 --rc genhtml_function_coverage=1 00:22:22.108 --rc genhtml_legend=1 00:22:22.108 --rc geninfo_all_blocks=1 00:22:22.108 --rc geninfo_unexecuted_blocks=1 00:22:22.108 00:22:22.108 ' 00:22:22.108 04:28:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:22.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.108 --rc genhtml_branch_coverage=1 00:22:22.108 --rc genhtml_function_coverage=1 00:22:22.108 --rc genhtml_legend=1 00:22:22.108 --rc geninfo_all_blocks=1 00:22:22.108 --rc geninfo_unexecuted_blocks=1 00:22:22.108 00:22:22.108 ' 00:22:22.108 04:28:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:22.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.108 --rc genhtml_branch_coverage=1 00:22:22.108 --rc genhtml_function_coverage=1 00:22:22.108 --rc genhtml_legend=1 00:22:22.108 --rc geninfo_all_blocks=1 00:22:22.108 --rc geninfo_unexecuted_blocks=1 00:22:22.108 00:22:22.108 ' 00:22:22.108 04:28:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:22.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:22.108 --rc genhtml_branch_coverage=1 00:22:22.108 --rc genhtml_function_coverage=1 00:22:22.108 --rc genhtml_legend=1 00:22:22.108 --rc geninfo_all_blocks=1 00:22:22.109 --rc geninfo_unexecuted_blocks=1 00:22:22.109 00:22:22.109 ' 00:22:22.109 04:28:59 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:22.109 04:28:59 -- nvmf/common.sh@7 -- # uname -s 00:22:22.109 04:28:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:22.109 04:28:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:22.109 04:28:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:22.109 04:28:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:22.109 04:28:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:22.109 04:28:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:22.109 04:28:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:22.109 04:28:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:22.109 04:28:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:22.109 04:28:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:22.109 04:28:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:22.109 04:28:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:22.109 04:28:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:22.109 04:28:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:22.109 04:28:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:22.109 04:28:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:22.109 04:28:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:22.109 04:28:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:22.109 04:28:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:22.109 04:28:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.109 04:28:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.109 04:28:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.109 04:28:59 -- paths/export.sh@5 -- # export PATH 00:22:22.109 04:28:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.109 04:28:59 -- nvmf/common.sh@46 -- # : 0 00:22:22.109 04:28:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:22.109 04:28:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:22.109 04:28:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:22.109 04:28:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:22.109 04:28:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:22.109 04:28:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:22.109 04:28:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:22.109 04:28:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:22.109 04:28:59 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:22.109 04:28:59 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:22.109 04:28:59 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:22.109 04:28:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:22.109 04:28:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:22.109 04:28:59 -- common/autotest_common.sh@10 -- # set +x 00:22:22.109 ************************************ 00:22:22.109 START TEST nvmf_shutdown_tc1 00:22:22.109 ************************************ 00:22:22.109 04:28:59 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:22.109 04:28:59 -- target/shutdown.sh@74 -- # starttarget 00:22:22.109 04:28:59 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:22.109 04:28:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:22.109 04:28:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:22.109 04:28:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:22.109 04:28:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:22.109 04:28:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:22.109 04:28:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:22.109 04:28:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:22.109 04:28:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:22.109 04:28:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:22.109 04:28:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:22.109 04:28:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:22.109 04:28:59 -- common/autotest_common.sh@10 -- # set +x 00:22:24.012 04:29:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:24.012 04:29:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:24.012 04:29:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:24.012 04:29:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:24.012 04:29:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:24.012 04:29:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:24.012 04:29:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:24.012 04:29:01 -- nvmf/common.sh@294 -- # net_devs=() 00:22:24.012 04:29:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:24.012 04:29:01 -- nvmf/common.sh@295 -- # e810=() 00:22:24.012 04:29:01 -- nvmf/common.sh@295 -- # local -ga e810 00:22:24.012 04:29:01 -- nvmf/common.sh@296 -- # x722=() 00:22:24.012 04:29:01 -- nvmf/common.sh@296 -- # local -ga x722 00:22:24.012 04:29:01 -- nvmf/common.sh@297 -- # mlx=() 00:22:24.012 04:29:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:24.012 04:29:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:24.012 04:29:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:24.012 04:29:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:24.012 04:29:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:24.012 04:29:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:24.012 04:29:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:24.012 04:29:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:24.012 04:29:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:24.013 04:29:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:24.013 04:29:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:24.013 04:29:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:24.013 04:29:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:24.013 04:29:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:24.013 04:29:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:24.013 04:29:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:24.013 04:29:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:24.013 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:24.013 04:29:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:24.013 04:29:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:24.013 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:24.013 04:29:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:24.013 04:29:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:24.013 04:29:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:24.013 04:29:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:24.013 04:29:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:24.013 04:29:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:24.013 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:24.013 04:29:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:24.013 04:29:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:24.013 04:29:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:24.013 04:29:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:24.013 04:29:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:24.013 04:29:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:24.013 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:24.013 04:29:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:24.013 04:29:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:24.013 04:29:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:24.013 04:29:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:24.013 04:29:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:24.013 04:29:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:24.013 04:29:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:24.013 04:29:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:24.013 04:29:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:24.013 04:29:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:24.013 04:29:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:24.013 04:29:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:24.013 04:29:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:24.013 04:29:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:24.013 04:29:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:24.013 04:29:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:24.013 04:29:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:24.013 04:29:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:24.013 04:29:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:24.013 04:29:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:24.013 04:29:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:24.013 04:29:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:24.013 04:29:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:24.013 04:29:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:24.013 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:24.013 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.348 ms 00:22:24.013 00:22:24.013 --- 10.0.0.2 ping statistics --- 00:22:24.013 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:24.013 rtt min/avg/max/mdev = 0.348/0.348/0.348/0.000 ms 00:22:24.013 04:29:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:24.013 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:24.013 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:22:24.013 00:22:24.013 --- 10.0.0.1 ping statistics --- 00:22:24.013 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:24.013 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:22:24.013 04:29:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:24.013 04:29:01 -- nvmf/common.sh@410 -- # return 0 00:22:24.013 04:29:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:24.013 04:29:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:24.013 04:29:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:24.013 04:29:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:24.013 04:29:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:24.013 04:29:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:24.013 04:29:01 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:24.013 04:29:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:24.013 04:29:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:24.013 04:29:01 -- common/autotest_common.sh@10 -- # set +x 00:22:24.013 04:29:01 -- nvmf/common.sh@469 -- # nvmfpid=3959862 00:22:24.013 04:29:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:24.013 04:29:01 -- nvmf/common.sh@470 -- # waitforlisten 3959862 00:22:24.013 04:29:01 -- common/autotest_common.sh@829 -- # '[' -z 3959862 ']' 00:22:24.013 04:29:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:24.013 04:29:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:24.013 04:29:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:24.013 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:24.013 04:29:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:24.013 04:29:01 -- common/autotest_common.sh@10 -- # set +x 00:22:24.271 [2024-11-28 04:29:01.337201] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:24.271 [2024-11-28 04:29:01.337271] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:24.271 EAL: No free 2048 kB hugepages reported on node 1 00:22:24.271 [2024-11-28 04:29:01.401476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:24.271 [2024-11-28 04:29:01.518522] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:24.271 [2024-11-28 04:29:01.518692] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:24.271 [2024-11-28 04:29:01.518710] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:24.271 [2024-11-28 04:29:01.518731] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:24.271 [2024-11-28 04:29:01.518795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:24.271 [2024-11-28 04:29:01.518858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:24.271 [2024-11-28 04:29:01.518911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:24.271 [2024-11-28 04:29:01.518913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:25.203 04:29:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:25.203 04:29:02 -- common/autotest_common.sh@862 -- # return 0 00:22:25.203 04:29:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:25.203 04:29:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:25.203 04:29:02 -- common/autotest_common.sh@10 -- # set +x 00:22:25.203 04:29:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:25.203 04:29:02 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:25.203 04:29:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.203 04:29:02 -- common/autotest_common.sh@10 -- # set +x 00:22:25.203 [2024-11-28 04:29:02.390221] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:25.203 04:29:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.203 04:29:02 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:25.203 04:29:02 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:25.203 04:29:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:25.203 04:29:02 -- common/autotest_common.sh@10 -- # set +x 00:22:25.203 04:29:02 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:25.203 04:29:02 -- target/shutdown.sh@28 -- # cat 00:22:25.203 04:29:02 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:25.203 04:29:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:25.203 04:29:02 -- common/autotest_common.sh@10 -- # set +x 00:22:25.203 Malloc1 00:22:25.203 [2024-11-28 04:29:02.477891] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:25.203 Malloc2 00:22:25.459 Malloc3 00:22:25.459 Malloc4 00:22:25.459 Malloc5 00:22:25.459 Malloc6 00:22:25.459 Malloc7 00:22:25.716 Malloc8 00:22:25.716 Malloc9 00:22:25.716 Malloc10 00:22:25.716 04:29:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:25.716 04:29:02 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:25.716 04:29:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:25.716 04:29:02 -- common/autotest_common.sh@10 -- # set +x 00:22:25.716 04:29:02 -- target/shutdown.sh@78 -- # perfpid=3960177 00:22:25.716 04:29:02 -- target/shutdown.sh@79 -- # waitforlisten 3960177 /var/tmp/bdevperf.sock 00:22:25.716 04:29:02 -- common/autotest_common.sh@829 -- # '[' -z 3960177 ']' 00:22:25.716 04:29:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:25.716 04:29:02 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:25.716 04:29:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:25.716 04:29:02 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:25.716 04:29:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:25.716 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:25.716 04:29:02 -- nvmf/common.sh@520 -- # config=() 00:22:25.716 04:29:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:25.716 04:29:02 -- nvmf/common.sh@520 -- # local subsystem config 00:22:25.716 04:29:02 -- common/autotest_common.sh@10 -- # set +x 00:22:25.716 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.716 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.716 { 00:22:25.716 "params": { 00:22:25.716 "name": "Nvme$subsystem", 00:22:25.716 "trtype": "$TEST_TRANSPORT", 00:22:25.716 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.716 "adrfam": "ipv4", 00:22:25.716 "trsvcid": "$NVMF_PORT", 00:22:25.716 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.716 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.716 "hdgst": ${hdgst:-false}, 00:22:25.716 "ddgst": ${ddgst:-false} 00:22:25.716 }, 00:22:25.716 "method": "bdev_nvme_attach_controller" 00:22:25.716 } 00:22:25.716 EOF 00:22:25.716 )") 00:22:25.716 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.716 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.716 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.716 { 00:22:25.716 "params": { 00:22:25.716 "name": "Nvme$subsystem", 00:22:25.716 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:25.717 { 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme$subsystem", 00:22:25.717 "trtype": "$TEST_TRANSPORT", 00:22:25.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "$NVMF_PORT", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:25.717 "hdgst": ${hdgst:-false}, 00:22:25.717 "ddgst": ${ddgst:-false} 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 } 00:22:25.717 EOF 00:22:25.717 )") 00:22:25.717 04:29:02 -- nvmf/common.sh@542 -- # cat 00:22:25.717 04:29:02 -- nvmf/common.sh@544 -- # jq . 00:22:25.717 04:29:02 -- nvmf/common.sh@545 -- # IFS=, 00:22:25.717 04:29:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme1", 00:22:25.717 "trtype": "tcp", 00:22:25.717 "traddr": "10.0.0.2", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "4420", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:25.717 "hdgst": false, 00:22:25.717 "ddgst": false 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 },{ 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme2", 00:22:25.717 "trtype": "tcp", 00:22:25.717 "traddr": "10.0.0.2", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "4420", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:25.717 "hdgst": false, 00:22:25.717 "ddgst": false 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 },{ 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme3", 00:22:25.717 "trtype": "tcp", 00:22:25.717 "traddr": "10.0.0.2", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "4420", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:25.717 "hdgst": false, 00:22:25.717 "ddgst": false 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 },{ 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme4", 00:22:25.717 "trtype": "tcp", 00:22:25.717 "traddr": "10.0.0.2", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "4420", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:25.717 "hdgst": false, 00:22:25.717 "ddgst": false 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 },{ 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme5", 00:22:25.717 "trtype": "tcp", 00:22:25.717 "traddr": "10.0.0.2", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "4420", 00:22:25.717 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:25.717 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:25.717 "hdgst": false, 00:22:25.717 "ddgst": false 00:22:25.717 }, 00:22:25.717 "method": "bdev_nvme_attach_controller" 00:22:25.717 },{ 00:22:25.717 "params": { 00:22:25.717 "name": "Nvme6", 00:22:25.717 "trtype": "tcp", 00:22:25.717 "traddr": "10.0.0.2", 00:22:25.717 "adrfam": "ipv4", 00:22:25.717 "trsvcid": "4420", 00:22:25.718 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:25.718 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:25.718 "hdgst": false, 00:22:25.718 "ddgst": false 00:22:25.718 }, 00:22:25.718 "method": "bdev_nvme_attach_controller" 00:22:25.718 },{ 00:22:25.718 "params": { 00:22:25.718 "name": "Nvme7", 00:22:25.718 "trtype": "tcp", 00:22:25.718 "traddr": "10.0.0.2", 00:22:25.718 "adrfam": "ipv4", 00:22:25.718 "trsvcid": "4420", 00:22:25.718 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:25.718 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:25.718 "hdgst": false, 00:22:25.718 "ddgst": false 00:22:25.718 }, 00:22:25.718 "method": "bdev_nvme_attach_controller" 00:22:25.718 },{ 00:22:25.718 "params": { 00:22:25.718 "name": "Nvme8", 00:22:25.718 "trtype": "tcp", 00:22:25.718 "traddr": "10.0.0.2", 00:22:25.718 "adrfam": "ipv4", 00:22:25.718 "trsvcid": "4420", 00:22:25.718 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:25.718 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:25.718 "hdgst": false, 00:22:25.718 "ddgst": false 00:22:25.718 }, 00:22:25.718 "method": "bdev_nvme_attach_controller" 00:22:25.718 },{ 00:22:25.718 "params": { 00:22:25.718 "name": "Nvme9", 00:22:25.718 "trtype": "tcp", 00:22:25.718 "traddr": "10.0.0.2", 00:22:25.718 "adrfam": "ipv4", 00:22:25.718 "trsvcid": "4420", 00:22:25.718 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:25.718 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:25.718 "hdgst": false, 00:22:25.718 "ddgst": false 00:22:25.718 }, 00:22:25.718 "method": "bdev_nvme_attach_controller" 00:22:25.718 },{ 00:22:25.718 "params": { 00:22:25.718 "name": "Nvme10", 00:22:25.718 "trtype": "tcp", 00:22:25.718 "traddr": "10.0.0.2", 00:22:25.718 "adrfam": "ipv4", 00:22:25.718 "trsvcid": "4420", 00:22:25.718 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:25.718 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:25.718 "hdgst": false, 00:22:25.718 "ddgst": false 00:22:25.718 }, 00:22:25.718 "method": "bdev_nvme_attach_controller" 00:22:25.718 }' 00:22:25.718 [2024-11-28 04:29:02.992265] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:25.718 [2024-11-28 04:29:02.992338] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:25.718 EAL: No free 2048 kB hugepages reported on node 1 00:22:25.974 [2024-11-28 04:29:03.056450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:25.974 [2024-11-28 04:29:03.165237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:27.869 04:29:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:27.869 04:29:04 -- common/autotest_common.sh@862 -- # return 0 00:22:27.869 04:29:04 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:27.869 04:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.869 04:29:04 -- common/autotest_common.sh@10 -- # set +x 00:22:27.869 04:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.869 04:29:04 -- target/shutdown.sh@83 -- # kill -9 3960177 00:22:27.869 04:29:04 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:27.869 04:29:04 -- target/shutdown.sh@87 -- # sleep 1 00:22:28.435 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3960177 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:28.435 04:29:05 -- target/shutdown.sh@88 -- # kill -0 3959862 00:22:28.435 04:29:05 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:28.435 04:29:05 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:28.435 04:29:05 -- nvmf/common.sh@520 -- # config=() 00:22:28.435 04:29:05 -- nvmf/common.sh@520 -- # local subsystem config 00:22:28.435 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.435 { 00:22:28.435 "params": { 00:22:28.435 "name": "Nvme$subsystem", 00:22:28.435 "trtype": "$TEST_TRANSPORT", 00:22:28.435 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.435 "adrfam": "ipv4", 00:22:28.435 "trsvcid": "$NVMF_PORT", 00:22:28.435 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.435 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.435 "hdgst": ${hdgst:-false}, 00:22:28.435 "ddgst": ${ddgst:-false} 00:22:28.435 }, 00:22:28.435 "method": "bdev_nvme_attach_controller" 00:22:28.435 } 00:22:28.435 EOF 00:22:28.435 )") 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.435 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.435 { 00:22:28.435 "params": { 00:22:28.435 "name": "Nvme$subsystem", 00:22:28.435 "trtype": "$TEST_TRANSPORT", 00:22:28.435 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.435 "adrfam": "ipv4", 00:22:28.435 "trsvcid": "$NVMF_PORT", 00:22:28.435 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.435 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.435 "hdgst": ${hdgst:-false}, 00:22:28.435 "ddgst": ${ddgst:-false} 00:22:28.435 }, 00:22:28.435 "method": "bdev_nvme_attach_controller" 00:22:28.435 } 00:22:28.435 EOF 00:22:28.435 )") 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.435 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.435 { 00:22:28.435 "params": { 00:22:28.435 "name": "Nvme$subsystem", 00:22:28.435 "trtype": "$TEST_TRANSPORT", 00:22:28.435 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.435 "adrfam": "ipv4", 00:22:28.435 "trsvcid": "$NVMF_PORT", 00:22:28.435 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.435 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.435 "hdgst": ${hdgst:-false}, 00:22:28.435 "ddgst": ${ddgst:-false} 00:22:28.435 }, 00:22:28.435 "method": "bdev_nvme_attach_controller" 00:22:28.435 } 00:22:28.435 EOF 00:22:28.435 )") 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.435 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.435 { 00:22:28.435 "params": { 00:22:28.435 "name": "Nvme$subsystem", 00:22:28.435 "trtype": "$TEST_TRANSPORT", 00:22:28.435 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.435 "adrfam": "ipv4", 00:22:28.435 "trsvcid": "$NVMF_PORT", 00:22:28.435 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.435 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.435 "hdgst": ${hdgst:-false}, 00:22:28.435 "ddgst": ${ddgst:-false} 00:22:28.435 }, 00:22:28.435 "method": "bdev_nvme_attach_controller" 00:22:28.435 } 00:22:28.435 EOF 00:22:28.435 )") 00:22:28.435 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.694 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.694 { 00:22:28.694 "params": { 00:22:28.694 "name": "Nvme$subsystem", 00:22:28.694 "trtype": "$TEST_TRANSPORT", 00:22:28.694 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.694 "adrfam": "ipv4", 00:22:28.694 "trsvcid": "$NVMF_PORT", 00:22:28.694 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.694 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.694 "hdgst": ${hdgst:-false}, 00:22:28.694 "ddgst": ${ddgst:-false} 00:22:28.694 }, 00:22:28.694 "method": "bdev_nvme_attach_controller" 00:22:28.694 } 00:22:28.694 EOF 00:22:28.694 )") 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.694 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.694 { 00:22:28.694 "params": { 00:22:28.694 "name": "Nvme$subsystem", 00:22:28.694 "trtype": "$TEST_TRANSPORT", 00:22:28.694 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.694 "adrfam": "ipv4", 00:22:28.694 "trsvcid": "$NVMF_PORT", 00:22:28.694 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.694 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.694 "hdgst": ${hdgst:-false}, 00:22:28.694 "ddgst": ${ddgst:-false} 00:22:28.694 }, 00:22:28.694 "method": "bdev_nvme_attach_controller" 00:22:28.694 } 00:22:28.694 EOF 00:22:28.694 )") 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.694 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.694 { 00:22:28.694 "params": { 00:22:28.694 "name": "Nvme$subsystem", 00:22:28.694 "trtype": "$TEST_TRANSPORT", 00:22:28.694 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.694 "adrfam": "ipv4", 00:22:28.694 "trsvcid": "$NVMF_PORT", 00:22:28.694 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.694 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.694 "hdgst": ${hdgst:-false}, 00:22:28.694 "ddgst": ${ddgst:-false} 00:22:28.694 }, 00:22:28.694 "method": "bdev_nvme_attach_controller" 00:22:28.694 } 00:22:28.694 EOF 00:22:28.694 )") 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.694 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.694 { 00:22:28.694 "params": { 00:22:28.694 "name": "Nvme$subsystem", 00:22:28.694 "trtype": "$TEST_TRANSPORT", 00:22:28.694 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.694 "adrfam": "ipv4", 00:22:28.694 "trsvcid": "$NVMF_PORT", 00:22:28.694 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.694 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.694 "hdgst": ${hdgst:-false}, 00:22:28.694 "ddgst": ${ddgst:-false} 00:22:28.694 }, 00:22:28.694 "method": "bdev_nvme_attach_controller" 00:22:28.694 } 00:22:28.694 EOF 00:22:28.694 )") 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.694 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.694 { 00:22:28.694 "params": { 00:22:28.694 "name": "Nvme$subsystem", 00:22:28.694 "trtype": "$TEST_TRANSPORT", 00:22:28.694 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.694 "adrfam": "ipv4", 00:22:28.694 "trsvcid": "$NVMF_PORT", 00:22:28.694 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.694 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.694 "hdgst": ${hdgst:-false}, 00:22:28.694 "ddgst": ${ddgst:-false} 00:22:28.694 }, 00:22:28.694 "method": "bdev_nvme_attach_controller" 00:22:28.694 } 00:22:28.694 EOF 00:22:28.694 )") 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.694 04:29:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.694 { 00:22:28.694 "params": { 00:22:28.694 "name": "Nvme$subsystem", 00:22:28.694 "trtype": "$TEST_TRANSPORT", 00:22:28.694 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.694 "adrfam": "ipv4", 00:22:28.694 "trsvcid": "$NVMF_PORT", 00:22:28.694 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.694 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.694 "hdgst": ${hdgst:-false}, 00:22:28.694 "ddgst": ${ddgst:-false} 00:22:28.694 }, 00:22:28.694 "method": "bdev_nvme_attach_controller" 00:22:28.694 } 00:22:28.694 EOF 00:22:28.694 )") 00:22:28.694 04:29:05 -- nvmf/common.sh@542 -- # cat 00:22:28.694 04:29:05 -- nvmf/common.sh@544 -- # jq . 00:22:28.694 04:29:05 -- nvmf/common.sh@545 -- # IFS=, 00:22:28.694 04:29:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:28.694 "params": { 00:22:28.694 "name": "Nvme1", 00:22:28.694 "trtype": "tcp", 00:22:28.694 "traddr": "10.0.0.2", 00:22:28.694 "adrfam": "ipv4", 00:22:28.694 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme2", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme3", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme4", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme5", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme6", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme7", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme8", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme9", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 },{ 00:22:28.695 "params": { 00:22:28.695 "name": "Nvme10", 00:22:28.695 "trtype": "tcp", 00:22:28.695 "traddr": "10.0.0.2", 00:22:28.695 "adrfam": "ipv4", 00:22:28.695 "trsvcid": "4420", 00:22:28.695 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:28.695 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:28.695 "hdgst": false, 00:22:28.695 "ddgst": false 00:22:28.695 }, 00:22:28.695 "method": "bdev_nvme_attach_controller" 00:22:28.695 }' 00:22:28.695 [2024-11-28 04:29:05.772068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:28.695 [2024-11-28 04:29:05.772151] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3960485 ] 00:22:28.695 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.695 [2024-11-28 04:29:05.837174] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:28.695 [2024-11-28 04:29:05.948426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:30.069 Running I/O for 1 seconds... 00:22:31.444 00:22:31.444 Latency(us) 00:22:31.444 [2024-11-28T03:29:08.755Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:31.444 [2024-11-28T03:29:08.755Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.444 Verification LBA range: start 0x0 length 0x400 00:22:31.444 Nvme1n1 : 1.06 374.38 23.40 0.00 0.00 166735.88 37088.52 161558.38 00:22:31.444 [2024-11-28T03:29:08.755Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.444 Verification LBA range: start 0x0 length 0x400 00:22:31.444 Nvme2n1 : 1.07 371.91 23.24 0.00 0.00 166378.25 40001.23 173985.94 00:22:31.444 [2024-11-28T03:29:08.755Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme3n1 : 1.07 403.79 25.24 0.00 0.00 153310.50 19709.35 120392.06 00:22:31.445 [2024-11-28T03:29:08.756Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme4n1 : 1.08 402.80 25.18 0.00 0.00 152655.03 18544.26 118838.61 00:22:31.445 [2024-11-28T03:29:08.756Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme5n1 : 1.08 401.36 25.09 0.00 0.00 152021.48 20000.62 116508.44 00:22:31.445 [2024-11-28T03:29:08.756Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme6n1 : 1.09 399.98 25.00 0.00 0.00 151860.19 16699.54 115731.72 00:22:31.445 [2024-11-28T03:29:08.756Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme7n1 : 1.09 399.46 24.97 0.00 0.00 151330.67 13592.65 119615.34 00:22:31.445 [2024-11-28T03:29:08.756Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme8n1 : 1.09 397.87 24.87 0.00 0.00 151071.11 11553.75 121168.78 00:22:31.445 [2024-11-28T03:29:08.756Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme9n1 : 1.10 396.32 24.77 0.00 0.00 151232.07 6553.60 126605.84 00:22:31.445 [2024-11-28T03:29:08.756Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:31.445 Verification LBA range: start 0x0 length 0x400 00:22:31.445 Nvme10n1 : 1.10 395.27 24.70 0.00 0.00 150678.75 5000.15 128936.01 00:22:31.445 [2024-11-28T03:29:08.756Z] =================================================================================================================== 00:22:31.445 [2024-11-28T03:29:08.756Z] Total : 3943.14 246.45 0.00 0.00 154527.83 5000.15 173985.94 00:22:31.445 04:29:08 -- target/shutdown.sh@93 -- # stoptarget 00:22:31.445 04:29:08 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:31.445 04:29:08 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:31.445 04:29:08 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:31.445 04:29:08 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:31.445 04:29:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:31.445 04:29:08 -- nvmf/common.sh@116 -- # sync 00:22:31.445 04:29:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:31.445 04:29:08 -- nvmf/common.sh@119 -- # set +e 00:22:31.445 04:29:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:31.445 04:29:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:31.445 rmmod nvme_tcp 00:22:31.445 rmmod nvme_fabrics 00:22:31.445 rmmod nvme_keyring 00:22:31.445 04:29:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:31.445 04:29:08 -- nvmf/common.sh@123 -- # set -e 00:22:31.445 04:29:08 -- nvmf/common.sh@124 -- # return 0 00:22:31.445 04:29:08 -- nvmf/common.sh@477 -- # '[' -n 3959862 ']' 00:22:31.445 04:29:08 -- nvmf/common.sh@478 -- # killprocess 3959862 00:22:31.445 04:29:08 -- common/autotest_common.sh@936 -- # '[' -z 3959862 ']' 00:22:31.445 04:29:08 -- common/autotest_common.sh@940 -- # kill -0 3959862 00:22:31.445 04:29:08 -- common/autotest_common.sh@941 -- # uname 00:22:31.445 04:29:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:31.445 04:29:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3959862 00:22:31.445 04:29:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:31.445 04:29:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:31.445 04:29:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3959862' 00:22:31.445 killing process with pid 3959862 00:22:31.445 04:29:08 -- common/autotest_common.sh@955 -- # kill 3959862 00:22:31.445 04:29:08 -- common/autotest_common.sh@960 -- # wait 3959862 00:22:32.012 04:29:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:32.012 04:29:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:32.012 04:29:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:32.012 04:29:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:32.012 04:29:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:32.012 04:29:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:32.012 04:29:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:32.012 04:29:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.546 04:29:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:34.546 00:22:34.546 real 0m12.291s 00:22:34.546 user 0m35.407s 00:22:34.546 sys 0m3.370s 00:22:34.546 04:29:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:34.546 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:22:34.546 ************************************ 00:22:34.546 END TEST nvmf_shutdown_tc1 00:22:34.546 ************************************ 00:22:34.546 04:29:11 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:34.546 04:29:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:34.546 04:29:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:34.546 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:22:34.546 ************************************ 00:22:34.546 START TEST nvmf_shutdown_tc2 00:22:34.546 ************************************ 00:22:34.546 04:29:11 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:34.546 04:29:11 -- target/shutdown.sh@98 -- # starttarget 00:22:34.546 04:29:11 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:34.546 04:29:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:34.546 04:29:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:34.546 04:29:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:34.546 04:29:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:34.546 04:29:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:34.546 04:29:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.546 04:29:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:34.546 04:29:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:34.546 04:29:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:34.546 04:29:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:34.546 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:22:34.546 04:29:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:34.546 04:29:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:34.546 04:29:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:34.546 04:29:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:34.546 04:29:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:34.546 04:29:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:34.546 04:29:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:34.546 04:29:11 -- nvmf/common.sh@294 -- # net_devs=() 00:22:34.546 04:29:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:34.546 04:29:11 -- nvmf/common.sh@295 -- # e810=() 00:22:34.546 04:29:11 -- nvmf/common.sh@295 -- # local -ga e810 00:22:34.546 04:29:11 -- nvmf/common.sh@296 -- # x722=() 00:22:34.546 04:29:11 -- nvmf/common.sh@296 -- # local -ga x722 00:22:34.546 04:29:11 -- nvmf/common.sh@297 -- # mlx=() 00:22:34.546 04:29:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:34.546 04:29:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:34.546 04:29:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:34.546 04:29:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:34.546 04:29:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:34.546 04:29:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:34.546 04:29:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:34.546 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:34.546 04:29:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:34.546 04:29:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:34.546 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:34.546 04:29:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:34.546 04:29:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:34.546 04:29:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:34.546 04:29:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:34.546 04:29:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:34.546 04:29:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:34.546 04:29:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:34.546 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:34.546 04:29:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:34.546 04:29:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:34.546 04:29:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:34.546 04:29:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:34.546 04:29:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:34.546 04:29:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:34.546 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:34.546 04:29:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:34.546 04:29:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:34.546 04:29:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:34.546 04:29:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:34.547 04:29:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:34.547 04:29:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:34.547 04:29:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:34.547 04:29:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:34.547 04:29:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:34.547 04:29:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:34.547 04:29:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:34.547 04:29:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:34.547 04:29:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:34.547 04:29:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:34.547 04:29:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:34.547 04:29:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:34.547 04:29:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:34.547 04:29:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:34.547 04:29:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:34.547 04:29:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:34.547 04:29:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:34.547 04:29:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:34.547 04:29:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:34.547 04:29:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:34.547 04:29:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:34.547 04:29:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:34.547 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:34.547 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:22:34.547 00:22:34.547 --- 10.0.0.2 ping statistics --- 00:22:34.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:34.547 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:22:34.547 04:29:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:34.547 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:34.547 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:22:34.547 00:22:34.547 --- 10.0.0.1 ping statistics --- 00:22:34.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:34.547 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:22:34.547 04:29:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:34.547 04:29:11 -- nvmf/common.sh@410 -- # return 0 00:22:34.547 04:29:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:34.547 04:29:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:34.547 04:29:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:34.547 04:29:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:34.547 04:29:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:34.547 04:29:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:34.547 04:29:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:34.547 04:29:11 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:34.547 04:29:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:34.547 04:29:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:34.547 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:22:34.547 04:29:11 -- nvmf/common.sh@469 -- # nvmfpid=3961263 00:22:34.547 04:29:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:34.547 04:29:11 -- nvmf/common.sh@470 -- # waitforlisten 3961263 00:22:34.547 04:29:11 -- common/autotest_common.sh@829 -- # '[' -z 3961263 ']' 00:22:34.547 04:29:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:34.547 04:29:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:34.547 04:29:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:34.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:34.547 04:29:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:34.547 04:29:11 -- common/autotest_common.sh@10 -- # set +x 00:22:34.547 [2024-11-28 04:29:11.563584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:34.547 [2024-11-28 04:29:11.563669] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:34.547 EAL: No free 2048 kB hugepages reported on node 1 00:22:34.547 [2024-11-28 04:29:11.628457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:34.547 [2024-11-28 04:29:11.736696] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:34.547 [2024-11-28 04:29:11.736834] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:34.547 [2024-11-28 04:29:11.736852] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:34.547 [2024-11-28 04:29:11.736864] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:34.547 [2024-11-28 04:29:11.736918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:34.547 [2024-11-28 04:29:11.736943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:34.547 [2024-11-28 04:29:11.737002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:34.547 [2024-11-28 04:29:11.737005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:35.481 04:29:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:35.481 04:29:12 -- common/autotest_common.sh@862 -- # return 0 00:22:35.481 04:29:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:35.481 04:29:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:35.481 04:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:35.481 04:29:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:35.481 04:29:12 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:35.481 04:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:35.481 04:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:35.481 [2024-11-28 04:29:12.605211] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:35.481 04:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:35.481 04:29:12 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:35.481 04:29:12 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:35.481 04:29:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:35.481 04:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:35.481 04:29:12 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:35.481 04:29:12 -- target/shutdown.sh@28 -- # cat 00:22:35.481 04:29:12 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:35.481 04:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:35.481 04:29:12 -- common/autotest_common.sh@10 -- # set +x 00:22:35.481 Malloc1 00:22:35.481 [2024-11-28 04:29:12.695099] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:35.481 Malloc2 00:22:35.481 Malloc3 00:22:35.739 Malloc4 00:22:35.740 Malloc5 00:22:35.740 Malloc6 00:22:35.740 Malloc7 00:22:35.740 Malloc8 00:22:35.998 Malloc9 00:22:35.998 Malloc10 00:22:35.998 04:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:35.998 04:29:13 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:35.998 04:29:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:35.998 04:29:13 -- common/autotest_common.sh@10 -- # set +x 00:22:35.998 04:29:13 -- target/shutdown.sh@102 -- # perfpid=3961580 00:22:35.998 04:29:13 -- target/shutdown.sh@103 -- # waitforlisten 3961580 /var/tmp/bdevperf.sock 00:22:35.998 04:29:13 -- common/autotest_common.sh@829 -- # '[' -z 3961580 ']' 00:22:35.998 04:29:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:35.998 04:29:13 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:35.998 04:29:13 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:35.998 04:29:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:35.998 04:29:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:35.998 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:35.998 04:29:13 -- nvmf/common.sh@520 -- # config=() 00:22:35.998 04:29:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:35.998 04:29:13 -- nvmf/common.sh@520 -- # local subsystem config 00:22:35.998 04:29:13 -- common/autotest_common.sh@10 -- # set +x 00:22:35.998 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.998 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.998 { 00:22:35.998 "params": { 00:22:35.998 "name": "Nvme$subsystem", 00:22:35.998 "trtype": "$TEST_TRANSPORT", 00:22:35.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.998 "adrfam": "ipv4", 00:22:35.998 "trsvcid": "$NVMF_PORT", 00:22:35.998 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.998 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.998 "hdgst": ${hdgst:-false}, 00:22:35.998 "ddgst": ${ddgst:-false} 00:22:35.998 }, 00:22:35.998 "method": "bdev_nvme_attach_controller" 00:22:35.998 } 00:22:35.998 EOF 00:22:35.998 )") 00:22:35.998 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.998 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.998 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.998 { 00:22:35.998 "params": { 00:22:35.998 "name": "Nvme$subsystem", 00:22:35.998 "trtype": "$TEST_TRANSPORT", 00:22:35.998 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:35.999 04:29:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:35.999 { 00:22:35.999 "params": { 00:22:35.999 "name": "Nvme$subsystem", 00:22:35.999 "trtype": "$TEST_TRANSPORT", 00:22:35.999 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:35.999 "adrfam": "ipv4", 00:22:35.999 "trsvcid": "$NVMF_PORT", 00:22:35.999 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:35.999 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:35.999 "hdgst": ${hdgst:-false}, 00:22:35.999 "ddgst": ${ddgst:-false} 00:22:35.999 }, 00:22:35.999 "method": "bdev_nvme_attach_controller" 00:22:35.999 } 00:22:35.999 EOF 00:22:35.999 )") 00:22:35.999 04:29:13 -- nvmf/common.sh@542 -- # cat 00:22:36.000 04:29:13 -- nvmf/common.sh@544 -- # jq . 00:22:36.000 04:29:13 -- nvmf/common.sh@545 -- # IFS=, 00:22:36.000 04:29:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme1", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme2", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme3", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme4", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme5", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme6", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme7", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme8", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme9", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 },{ 00:22:36.000 "params": { 00:22:36.000 "name": "Nvme10", 00:22:36.000 "trtype": "tcp", 00:22:36.000 "traddr": "10.0.0.2", 00:22:36.000 "adrfam": "ipv4", 00:22:36.000 "trsvcid": "4420", 00:22:36.000 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:36.000 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:36.000 "hdgst": false, 00:22:36.000 "ddgst": false 00:22:36.000 }, 00:22:36.000 "method": "bdev_nvme_attach_controller" 00:22:36.000 }' 00:22:36.000 [2024-11-28 04:29:13.198007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:36.000 [2024-11-28 04:29:13.198082] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3961580 ] 00:22:36.000 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.000 [2024-11-28 04:29:13.261203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:36.259 [2024-11-28 04:29:13.370290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:38.157 Running I/O for 10 seconds... 00:22:38.415 04:29:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:38.415 04:29:15 -- common/autotest_common.sh@862 -- # return 0 00:22:38.415 04:29:15 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:38.415 04:29:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.415 04:29:15 -- common/autotest_common.sh@10 -- # set +x 00:22:38.415 04:29:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.415 04:29:15 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:38.415 04:29:15 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:38.415 04:29:15 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:38.415 04:29:15 -- target/shutdown.sh@57 -- # local ret=1 00:22:38.415 04:29:15 -- target/shutdown.sh@58 -- # local i 00:22:38.415 04:29:15 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:38.415 04:29:15 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:38.415 04:29:15 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:38.415 04:29:15 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:38.415 04:29:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.415 04:29:15 -- common/autotest_common.sh@10 -- # set +x 00:22:38.673 04:29:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.673 04:29:15 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:38.673 04:29:15 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:38.673 04:29:15 -- target/shutdown.sh@64 -- # ret=0 00:22:38.673 04:29:15 -- target/shutdown.sh@65 -- # break 00:22:38.673 04:29:15 -- target/shutdown.sh@69 -- # return 0 00:22:38.673 04:29:15 -- target/shutdown.sh@109 -- # killprocess 3961580 00:22:38.673 04:29:15 -- common/autotest_common.sh@936 -- # '[' -z 3961580 ']' 00:22:38.673 04:29:15 -- common/autotest_common.sh@940 -- # kill -0 3961580 00:22:38.673 04:29:15 -- common/autotest_common.sh@941 -- # uname 00:22:38.673 04:29:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:38.673 04:29:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3961580 00:22:38.673 04:29:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:38.673 04:29:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:38.673 04:29:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3961580' 00:22:38.673 killing process with pid 3961580 00:22:38.673 04:29:15 -- common/autotest_common.sh@955 -- # kill 3961580 00:22:38.673 04:29:15 -- common/autotest_common.sh@960 -- # wait 3961580 00:22:38.673 Received shutdown signal, test time was about 0.792410 seconds 00:22:38.673 00:22:38.673 Latency(us) 00:22:38.673 [2024-11-28T03:29:15.984Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme1n1 : 0.73 371.06 23.19 0.00 0.00 166605.29 30098.01 128936.01 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme2n1 : 0.74 368.78 23.05 0.00 0.00 165867.83 29127.11 125829.12 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme3n1 : 0.73 370.34 23.15 0.00 0.00 163371.32 30292.20 125829.12 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme4n1 : 0.74 369.65 23.10 0.00 0.00 161853.57 30098.01 125829.12 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme5n1 : 0.74 368.10 23.01 0.00 0.00 160959.06 28156.21 127382.57 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme6n1 : 0.74 366.84 22.93 0.00 0.00 159688.32 29903.83 126605.84 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme7n1 : 0.74 365.60 22.85 0.00 0.00 158352.61 30486.38 128936.01 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme8n1 : 0.75 364.61 22.79 0.00 0.00 157079.01 30098.01 131266.18 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme9n1 : 0.75 363.32 22.71 0.00 0.00 155938.91 30292.20 132819.63 00:22:38.673 [2024-11-28T03:29:15.984Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:38.673 Verification LBA range: start 0x0 length 0x400 00:22:38.673 Nvme10n1 : 0.79 343.62 21.48 0.00 0.00 155829.69 25631.86 132819.63 00:22:38.673 [2024-11-28T03:29:15.984Z] =================================================================================================================== 00:22:38.673 [2024-11-28T03:29:15.984Z] Total : 3651.93 228.25 0.00 0.00 160554.56 25631.86 132819.63 00:22:38.931 04:29:16 -- target/shutdown.sh@112 -- # sleep 1 00:22:40.304 04:29:17 -- target/shutdown.sh@113 -- # kill -0 3961263 00:22:40.304 04:29:17 -- target/shutdown.sh@115 -- # stoptarget 00:22:40.304 04:29:17 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:40.304 04:29:17 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:40.304 04:29:17 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:40.304 04:29:17 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:40.304 04:29:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:40.304 04:29:17 -- nvmf/common.sh@116 -- # sync 00:22:40.304 04:29:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:40.304 04:29:17 -- nvmf/common.sh@119 -- # set +e 00:22:40.304 04:29:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:40.304 04:29:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:40.304 rmmod nvme_tcp 00:22:40.304 rmmod nvme_fabrics 00:22:40.304 rmmod nvme_keyring 00:22:40.304 04:29:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:40.304 04:29:17 -- nvmf/common.sh@123 -- # set -e 00:22:40.304 04:29:17 -- nvmf/common.sh@124 -- # return 0 00:22:40.304 04:29:17 -- nvmf/common.sh@477 -- # '[' -n 3961263 ']' 00:22:40.304 04:29:17 -- nvmf/common.sh@478 -- # killprocess 3961263 00:22:40.304 04:29:17 -- common/autotest_common.sh@936 -- # '[' -z 3961263 ']' 00:22:40.304 04:29:17 -- common/autotest_common.sh@940 -- # kill -0 3961263 00:22:40.304 04:29:17 -- common/autotest_common.sh@941 -- # uname 00:22:40.304 04:29:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:40.304 04:29:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3961263 00:22:40.304 04:29:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:40.304 04:29:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:40.304 04:29:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3961263' 00:22:40.304 killing process with pid 3961263 00:22:40.304 04:29:17 -- common/autotest_common.sh@955 -- # kill 3961263 00:22:40.304 04:29:17 -- common/autotest_common.sh@960 -- # wait 3961263 00:22:40.562 04:29:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:40.562 04:29:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:40.562 04:29:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:40.562 04:29:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:40.562 04:29:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:40.562 04:29:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:40.562 04:29:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:40.562 04:29:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:43.094 04:29:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:43.094 00:22:43.094 real 0m8.565s 00:22:43.094 user 0m27.346s 00:22:43.094 sys 0m1.596s 00:22:43.094 04:29:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:43.094 04:29:19 -- common/autotest_common.sh@10 -- # set +x 00:22:43.094 ************************************ 00:22:43.094 END TEST nvmf_shutdown_tc2 00:22:43.094 ************************************ 00:22:43.094 04:29:19 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:43.094 04:29:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:43.094 04:29:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:43.094 04:29:19 -- common/autotest_common.sh@10 -- # set +x 00:22:43.094 ************************************ 00:22:43.094 START TEST nvmf_shutdown_tc3 00:22:43.094 ************************************ 00:22:43.094 04:29:19 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:43.094 04:29:19 -- target/shutdown.sh@120 -- # starttarget 00:22:43.094 04:29:19 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:43.094 04:29:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:43.094 04:29:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:43.094 04:29:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:43.094 04:29:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:43.094 04:29:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:43.094 04:29:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.094 04:29:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.094 04:29:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:43.094 04:29:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:43.094 04:29:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:43.094 04:29:19 -- common/autotest_common.sh@10 -- # set +x 00:22:43.094 04:29:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:43.094 04:29:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:43.094 04:29:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:43.094 04:29:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:43.094 04:29:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:43.094 04:29:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:43.094 04:29:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:43.094 04:29:19 -- nvmf/common.sh@294 -- # net_devs=() 00:22:43.094 04:29:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:43.094 04:29:19 -- nvmf/common.sh@295 -- # e810=() 00:22:43.094 04:29:19 -- nvmf/common.sh@295 -- # local -ga e810 00:22:43.094 04:29:19 -- nvmf/common.sh@296 -- # x722=() 00:22:43.094 04:29:19 -- nvmf/common.sh@296 -- # local -ga x722 00:22:43.094 04:29:19 -- nvmf/common.sh@297 -- # mlx=() 00:22:43.094 04:29:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:43.094 04:29:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:43.094 04:29:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:43.094 04:29:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:43.094 04:29:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:43.094 04:29:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:43.094 04:29:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:43.094 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:43.094 04:29:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:43.094 04:29:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:43.094 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:43.094 04:29:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:43.094 04:29:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:43.094 04:29:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:43.094 04:29:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:43.094 04:29:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:43.094 04:29:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:43.094 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:43.094 04:29:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:43.094 04:29:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:43.094 04:29:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:43.094 04:29:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:43.094 04:29:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:43.094 04:29:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:43.094 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:43.094 04:29:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:43.094 04:29:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:43.094 04:29:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:43.094 04:29:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:43.094 04:29:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:43.094 04:29:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:43.094 04:29:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:43.094 04:29:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:43.094 04:29:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:43.094 04:29:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:43.094 04:29:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:43.094 04:29:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:43.094 04:29:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:43.094 04:29:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:43.094 04:29:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:43.094 04:29:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:43.094 04:29:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:43.094 04:29:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:43.094 04:29:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:43.094 04:29:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:43.094 04:29:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:43.094 04:29:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:43.094 04:29:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:43.094 04:29:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:43.094 04:29:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:43.094 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:43.094 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:22:43.094 00:22:43.094 --- 10.0.0.2 ping statistics --- 00:22:43.094 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:43.094 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:22:43.094 04:29:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:43.094 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:43.094 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:22:43.094 00:22:43.094 --- 10.0.0.1 ping statistics --- 00:22:43.094 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:43.094 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:22:43.094 04:29:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:43.094 04:29:20 -- nvmf/common.sh@410 -- # return 0 00:22:43.094 04:29:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:43.094 04:29:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:43.094 04:29:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:43.094 04:29:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:43.094 04:29:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:43.094 04:29:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:43.094 04:29:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:43.094 04:29:20 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:43.094 04:29:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:43.094 04:29:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:43.094 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:22:43.094 04:29:20 -- nvmf/common.sh@469 -- # nvmfpid=3962514 00:22:43.094 04:29:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:43.094 04:29:20 -- nvmf/common.sh@470 -- # waitforlisten 3962514 00:22:43.094 04:29:20 -- common/autotest_common.sh@829 -- # '[' -z 3962514 ']' 00:22:43.094 04:29:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:43.094 04:29:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:43.094 04:29:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:43.094 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:43.094 04:29:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:43.094 04:29:20 -- common/autotest_common.sh@10 -- # set +x 00:22:43.094 [2024-11-28 04:29:20.138444] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:43.094 [2024-11-28 04:29:20.138533] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:43.094 EAL: No free 2048 kB hugepages reported on node 1 00:22:43.094 [2024-11-28 04:29:20.205741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:43.094 [2024-11-28 04:29:20.314050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:43.094 [2024-11-28 04:29:20.314209] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:43.094 [2024-11-28 04:29:20.314227] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:43.094 [2024-11-28 04:29:20.314240] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:43.094 [2024-11-28 04:29:20.314328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:43.094 [2024-11-28 04:29:20.314380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:43.094 [2024-11-28 04:29:20.314432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:43.094 [2024-11-28 04:29:20.314435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:44.025 04:29:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:44.025 04:29:21 -- common/autotest_common.sh@862 -- # return 0 00:22:44.025 04:29:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:44.025 04:29:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:44.025 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:44.025 04:29:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:44.025 04:29:21 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:44.025 04:29:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.025 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:44.025 [2024-11-28 04:29:21.176269] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:44.025 04:29:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.025 04:29:21 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:44.025 04:29:21 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:44.025 04:29:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:44.025 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:44.025 04:29:21 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:44.025 04:29:21 -- target/shutdown.sh@28 -- # cat 00:22:44.025 04:29:21 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:44.025 04:29:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.025 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:44.025 Malloc1 00:22:44.025 [2024-11-28 04:29:21.266025] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:44.025 Malloc2 00:22:44.282 Malloc3 00:22:44.282 Malloc4 00:22:44.282 Malloc5 00:22:44.282 Malloc6 00:22:44.282 Malloc7 00:22:44.541 Malloc8 00:22:44.541 Malloc9 00:22:44.541 Malloc10 00:22:44.541 04:29:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.541 04:29:21 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:44.541 04:29:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:44.541 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:44.541 04:29:21 -- target/shutdown.sh@124 -- # perfpid=3962701 00:22:44.541 04:29:21 -- target/shutdown.sh@125 -- # waitforlisten 3962701 /var/tmp/bdevperf.sock 00:22:44.541 04:29:21 -- common/autotest_common.sh@829 -- # '[' -z 3962701 ']' 00:22:44.541 04:29:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:44.541 04:29:21 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:44.541 04:29:21 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:44.541 04:29:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:44.541 04:29:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:44.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:44.541 04:29:21 -- nvmf/common.sh@520 -- # config=() 00:22:44.541 04:29:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:44.541 04:29:21 -- nvmf/common.sh@520 -- # local subsystem config 00:22:44.541 04:29:21 -- common/autotest_common.sh@10 -- # set +x 00:22:44.541 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.541 { 00:22:44.541 "params": { 00:22:44.541 "name": "Nvme$subsystem", 00:22:44.541 "trtype": "$TEST_TRANSPORT", 00:22:44.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.541 "adrfam": "ipv4", 00:22:44.541 "trsvcid": "$NVMF_PORT", 00:22:44.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.541 "hdgst": ${hdgst:-false}, 00:22:44.541 "ddgst": ${ddgst:-false} 00:22:44.541 }, 00:22:44.541 "method": "bdev_nvme_attach_controller" 00:22:44.541 } 00:22:44.541 EOF 00:22:44.541 )") 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.541 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.541 { 00:22:44.541 "params": { 00:22:44.541 "name": "Nvme$subsystem", 00:22:44.541 "trtype": "$TEST_TRANSPORT", 00:22:44.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.541 "adrfam": "ipv4", 00:22:44.541 "trsvcid": "$NVMF_PORT", 00:22:44.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.541 "hdgst": ${hdgst:-false}, 00:22:44.541 "ddgst": ${ddgst:-false} 00:22:44.541 }, 00:22:44.541 "method": "bdev_nvme_attach_controller" 00:22:44.541 } 00:22:44.541 EOF 00:22:44.541 )") 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.541 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.541 { 00:22:44.541 "params": { 00:22:44.541 "name": "Nvme$subsystem", 00:22:44.541 "trtype": "$TEST_TRANSPORT", 00:22:44.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.541 "adrfam": "ipv4", 00:22:44.541 "trsvcid": "$NVMF_PORT", 00:22:44.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.541 "hdgst": ${hdgst:-false}, 00:22:44.541 "ddgst": ${ddgst:-false} 00:22:44.541 }, 00:22:44.541 "method": "bdev_nvme_attach_controller" 00:22:44.541 } 00:22:44.541 EOF 00:22:44.541 )") 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.541 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.541 { 00:22:44.541 "params": { 00:22:44.541 "name": "Nvme$subsystem", 00:22:44.541 "trtype": "$TEST_TRANSPORT", 00:22:44.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.541 "adrfam": "ipv4", 00:22:44.541 "trsvcid": "$NVMF_PORT", 00:22:44.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.541 "hdgst": ${hdgst:-false}, 00:22:44.541 "ddgst": ${ddgst:-false} 00:22:44.541 }, 00:22:44.541 "method": "bdev_nvme_attach_controller" 00:22:44.541 } 00:22:44.541 EOF 00:22:44.541 )") 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.541 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.541 { 00:22:44.541 "params": { 00:22:44.541 "name": "Nvme$subsystem", 00:22:44.541 "trtype": "$TEST_TRANSPORT", 00:22:44.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.541 "adrfam": "ipv4", 00:22:44.541 "trsvcid": "$NVMF_PORT", 00:22:44.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.541 "hdgst": ${hdgst:-false}, 00:22:44.541 "ddgst": ${ddgst:-false} 00:22:44.541 }, 00:22:44.541 "method": "bdev_nvme_attach_controller" 00:22:44.541 } 00:22:44.541 EOF 00:22:44.541 )") 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.541 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.541 { 00:22:44.541 "params": { 00:22:44.541 "name": "Nvme$subsystem", 00:22:44.541 "trtype": "$TEST_TRANSPORT", 00:22:44.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.541 "adrfam": "ipv4", 00:22:44.541 "trsvcid": "$NVMF_PORT", 00:22:44.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.541 "hdgst": ${hdgst:-false}, 00:22:44.541 "ddgst": ${ddgst:-false} 00:22:44.541 }, 00:22:44.541 "method": "bdev_nvme_attach_controller" 00:22:44.541 } 00:22:44.541 EOF 00:22:44.541 )") 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.541 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.541 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.541 { 00:22:44.541 "params": { 00:22:44.541 "name": "Nvme$subsystem", 00:22:44.542 "trtype": "$TEST_TRANSPORT", 00:22:44.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "$NVMF_PORT", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.542 "hdgst": ${hdgst:-false}, 00:22:44.542 "ddgst": ${ddgst:-false} 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 } 00:22:44.542 EOF 00:22:44.542 )") 00:22:44.542 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.542 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.542 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.542 { 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme$subsystem", 00:22:44.542 "trtype": "$TEST_TRANSPORT", 00:22:44.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "$NVMF_PORT", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.542 "hdgst": ${hdgst:-false}, 00:22:44.542 "ddgst": ${ddgst:-false} 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 } 00:22:44.542 EOF 00:22:44.542 )") 00:22:44.542 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.542 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.542 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.542 { 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme$subsystem", 00:22:44.542 "trtype": "$TEST_TRANSPORT", 00:22:44.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "$NVMF_PORT", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.542 "hdgst": ${hdgst:-false}, 00:22:44.542 "ddgst": ${ddgst:-false} 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 } 00:22:44.542 EOF 00:22:44.542 )") 00:22:44.542 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.542 04:29:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:44.542 04:29:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:44.542 { 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme$subsystem", 00:22:44.542 "trtype": "$TEST_TRANSPORT", 00:22:44.542 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "$NVMF_PORT", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:44.542 "hdgst": ${hdgst:-false}, 00:22:44.542 "ddgst": ${ddgst:-false} 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 } 00:22:44.542 EOF 00:22:44.542 )") 00:22:44.542 04:29:21 -- nvmf/common.sh@542 -- # cat 00:22:44.542 04:29:21 -- nvmf/common.sh@544 -- # jq . 00:22:44.542 04:29:21 -- nvmf/common.sh@545 -- # IFS=, 00:22:44.542 04:29:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme1", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme2", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme3", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme4", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme5", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme6", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme7", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme8", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme9", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 },{ 00:22:44.542 "params": { 00:22:44.542 "name": "Nvme10", 00:22:44.542 "trtype": "tcp", 00:22:44.542 "traddr": "10.0.0.2", 00:22:44.542 "adrfam": "ipv4", 00:22:44.542 "trsvcid": "4420", 00:22:44.542 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:44.542 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:44.542 "hdgst": false, 00:22:44.542 "ddgst": false 00:22:44.542 }, 00:22:44.542 "method": "bdev_nvme_attach_controller" 00:22:44.542 }' 00:22:44.542 [2024-11-28 04:29:21.771950] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:44.542 [2024-11-28 04:29:21.772025] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3962701 ] 00:22:44.542 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.542 [2024-11-28 04:29:21.835958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:44.800 [2024-11-28 04:29:21.945715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:46.721 Running I/O for 10 seconds... 00:22:46.980 04:29:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:46.980 04:29:24 -- common/autotest_common.sh@862 -- # return 0 00:22:46.980 04:29:24 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:46.980 04:29:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.980 04:29:24 -- common/autotest_common.sh@10 -- # set +x 00:22:46.980 04:29:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.980 04:29:24 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:46.980 04:29:24 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:46.980 04:29:24 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:46.980 04:29:24 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:46.980 04:29:24 -- target/shutdown.sh@57 -- # local ret=1 00:22:46.980 04:29:24 -- target/shutdown.sh@58 -- # local i 00:22:46.980 04:29:24 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:46.980 04:29:24 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:46.980 04:29:24 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:46.980 04:29:24 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:46.980 04:29:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.980 04:29:24 -- common/autotest_common.sh@10 -- # set +x 00:22:47.254 04:29:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.254 04:29:24 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:47.254 04:29:24 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:47.254 04:29:24 -- target/shutdown.sh@64 -- # ret=0 00:22:47.254 04:29:24 -- target/shutdown.sh@65 -- # break 00:22:47.254 04:29:24 -- target/shutdown.sh@69 -- # return 0 00:22:47.254 04:29:24 -- target/shutdown.sh@134 -- # killprocess 3962514 00:22:47.254 04:29:24 -- common/autotest_common.sh@936 -- # '[' -z 3962514 ']' 00:22:47.254 04:29:24 -- common/autotest_common.sh@940 -- # kill -0 3962514 00:22:47.254 04:29:24 -- common/autotest_common.sh@941 -- # uname 00:22:47.254 04:29:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:47.254 04:29:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3962514 00:22:47.254 04:29:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:47.254 04:29:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:47.254 04:29:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3962514' 00:22:47.254 killing process with pid 3962514 00:22:47.255 04:29:24 -- common/autotest_common.sh@955 -- # kill 3962514 00:22:47.255 04:29:24 -- common/autotest_common.sh@960 -- # wait 3962514 00:22:47.255 [2024-11-28 04:29:24.363121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.363989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.364001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.364012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.364024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.255 [2024-11-28 04:29:24.364036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca22e0 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.365990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.366127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4c90 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.370000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.256 [2024-11-28 04:29:24.370029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.370821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2790 is same with the state(5) to be set 00:22:47.257 [2024-11-28 04:29:24.375183] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.257 [2024-11-28 04:29:24.375225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d590 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.375438] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375481] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375507] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375543] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22bb600 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.375625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375661] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375687] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21171b0 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.375783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375869] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.258 [2024-11-28 04:29:24.375890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.258 [2024-11-28 04:29:24.375908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20f4f70 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.258 [2024-11-28 04:29:24.379932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.379944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.379956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.379968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.379980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.379991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.380341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca2c40 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.259 [2024-11-28 04:29:24.384931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.384943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.384954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.384966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.384978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.384989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca30d0 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214d590 (9): Bad file descriptor 00:22:47.260 [2024-11-28 04:29:24.385429] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.260 [2024-11-28 04:29:24.385452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.260 [2024-11-28 04:29:24.385468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.260 [2024-11-28 04:29:24.385481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.260 [2024-11-28 04:29:24.385495] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.260 [2024-11-28 04:29:24.385516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.260 [2024-11-28 04:29:24.385545] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.260 [2024-11-28 04:29:24.385561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.260 [2024-11-28 04:29:24.385580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2120690 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.385643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22bb600 (9): Bad file descriptor 00:22:47.260 [2024-11-28 04:29:24.385675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21171b0 (9): Bad file descriptor 00:22:47.260 [2024-11-28 04:29:24.385703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20f4f70 (9): Bad file descriptor 00:22:47.260 [2024-11-28 04:29:24.386764] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.260 [2024-11-28 04:29:24.387479] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.260 [2024-11-28 04:29:24.387579] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.260 [2024-11-28 04:29:24.393477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.393535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.393552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.393575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.260 [2024-11-28 04:29:24.393588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.393992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.394307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3560 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.395305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.395337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.395351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.395364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.395376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.395388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.261 [2024-11-28 04:29:24.395401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.395990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2120690 (9): Bad file descriptor 00:22:47.262 [2024-11-28 04:29:24.396116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3a10 is same with the state(5) to be set 00:22:47.262 [2024-11-28 04:29:24.396204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.262 [2024-11-28 04:29:24.396227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.262 [2024-11-28 04:29:24.396287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.262 [2024-11-28 04:29:24.396307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.262 [2024-11-28 04:29:24.396321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.262 [2024-11-28 04:29:24.396334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.262 [2024-11-28 04:29:24.396347] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.262 [2024-11-28 04:29:24.396359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.262 [2024-11-28 04:29:24.396372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22ab150 is same with the state(5) to be set 00:22:47.263 [2024-11-28 04:29:24.397226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.397984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.397997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.398012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.398025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.398040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.398053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.398068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.398081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.398096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.398110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.398124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.398137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.398152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.398165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.263 [2024-11-28 04:29:24.398180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.263 [2024-11-28 04:29:24.398193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.398969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.398983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.399002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.399016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.399031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.399044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.399059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.399072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.399087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.399100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.264 [2024-11-28 04:29:24.399115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.264 [2024-11-28 04:29:24.399128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.399142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2339260 is same with the state(5) to be set 00:22:47.265 [2024-11-28 04:29:24.400375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.400978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.400991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.265 [2024-11-28 04:29:24.401286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.265 [2024-11-28 04:29:24.401299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:43008 len:1[2024-11-28 04:29:24.401764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43264 len:1[2024-11-28 04:29:24.401838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.401852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.401889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.266 [2024-11-28 04:29:24.401918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.266 [2024-11-28 04:29:24.401920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.266 [2024-11-28 04:29:24.401930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.401936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.401953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with [2024-11-28 04:29:24.401954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.267 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.401967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.401972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.401980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.401989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.401993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43904 len:12[2024-11-28 04:29:24.402006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.402021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with [2024-11-28 04:29:24.402126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44416 len:1the state(5) to be set 00:22:47.267 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with [2024-11-28 04:29:24.402142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.267 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with [2024-11-28 04:29:24.402193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:44672 len:12the state(5) to be set 00:22:47.267 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 [2024-11-28 04:29:24.402320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:12[2024-11-28 04:29:24.402345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.267 the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with [2024-11-28 04:29:24.402361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.267 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.267 [2024-11-28 04:29:24.402375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20e5550 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.267 [2024-11-28 04:29:24.402424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.402575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca3ec0 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128[2024-11-28 04:29:24.403653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.403672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.403820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128the state(5) to be set 00:22:47.268 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35584 len:12[2024-11-28 04:29:24.403858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.403950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:12the state(5) to be set 00:22:47.268 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.403976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.268 [2024-11-28 04:29:24.403988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.268 [2024-11-28 04:29:24.403995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.268 [2024-11-28 04:29:24.404000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36864 len:12[2024-11-28 04:29:24.404013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.404027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.404044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:12the state(5) to be set 00:22:47.269 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.404060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.269 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:12[2024-11-28 04:29:24.404199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.404213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.404230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:12the state(5) to be set 00:22:47.269 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.404245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.269 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.404321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:12the state(5) to be set 00:22:47.269 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.404336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.269 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with [2024-11-28 04:29:24.404411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38784 len:12the state(5) to be set 00:22:47.269 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca4350 is same with the state(5) to be set 00:22:47.269 [2024-11-28 04:29:24.404444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.269 [2024-11-28 04:29:24.404502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.269 [2024-11-28 04:29:24.404515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.404973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.404986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43648 len:1[2024-11-28 04:29:24.405196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.405211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 [2024-11-28 04:29:24.405274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44032 len:1[2024-11-28 04:29:24.405286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.405301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.270 the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.270 [2024-11-28 04:29:24.405317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.270 [2024-11-28 04:29:24.405328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:44288 len:1[2024-11-28 04:29:24.405352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with [2024-11-28 04:29:24.405368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.271 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 [2024-11-28 04:29:24.405394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:44544 len:12[2024-11-28 04:29:24.405418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 04:29:24.405432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 [2024-11-28 04:29:24.405457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 [2024-11-28 04:29:24.405482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with [2024-11-28 04:29:24.405507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:44928 len:1the state(5) to be set 00:22:47.271 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 [2024-11-28 04:29:24.405520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with [2024-11-28 04:29:24.405522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.271 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with [2024-11-28 04:29:24.405547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:45056 len:1the state(5) to be set 00:22:47.271 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 [2024-11-28 04:29:24.405562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with [2024-11-28 04:29:24.405574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:47.271 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 [2024-11-28 04:29:24.405601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.271 [2024-11-28 04:29:24.405627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.271 [2024-11-28 04:29:24.405640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.271 [2024-11-28 04:29:24.405865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.405958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca47e0 is same with the state(5) to be set 00:22:47.272 [2024-11-28 04:29:24.407687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.407973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.407986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.272 [2024-11-28 04:29:24.408370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.272 [2024-11-28 04:29:24.408383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.408970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.408989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.273 [2024-11-28 04:29:24.409284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.273 [2024-11-28 04:29:24.409299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.409549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.409576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x234b5b0 is same with the state(5) to be set 00:22:47.274 [2024-11-28 04:29:24.411174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:47.274 [2024-11-28 04:29:24.411206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:47.274 [2024-11-28 04:29:24.411224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:47.274 [2024-11-28 04:29:24.411240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:47.274 [2024-11-28 04:29:24.411350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411415] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411446] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22aac70 is same with the state(5) to be set 00:22:47.274 [2024-11-28 04:29:24.411540] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411579] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22960a0 is same with the state(5) to be set 00:22:47.274 [2024-11-28 04:29:24.411703] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411738] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411764] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411790] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22a5a60 is same with the state(5) to be set 00:22:47.274 [2024-11-28 04:29:24.411870] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411904] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411935] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411962] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.274 [2024-11-28 04:29:24.411974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.411987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2142490 is same with the state(5) to be set 00:22:47.274 [2024-11-28 04:29:24.412021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ab150 (9): Bad file descriptor 00:22:47.274 [2024-11-28 04:29:24.412384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.412409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.412430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.274 [2024-11-28 04:29:24.412445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.274 [2024-11-28 04:29:24.412461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.412980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.412993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.275 [2024-11-28 04:29:24.413382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.275 [2024-11-28 04:29:24.413395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.413976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.413989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.276 [2024-11-28 04:29:24.414280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.276 [2024-11-28 04:29:24.414378] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x23489c0 was disconnected and freed. reset controller. 00:22:47.276 [2024-11-28 04:29:24.414828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.276 [2024-11-28 04:29:24.414931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.276 [2024-11-28 04:29:24.414955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20f4f70 with addr=10.0.0.2, port=4420 00:22:47.277 [2024-11-28 04:29:24.414972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20f4f70 is same with the state(5) to be set 00:22:47.277 [2024-11-28 04:29:24.415092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.277 [2024-11-28 04:29:24.415193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.277 [2024-11-28 04:29:24.415216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22bb600 with addr=10.0.0.2, port=4420 00:22:47.277 [2024-11-28 04:29:24.415231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22bb600 is same with the state(5) to be set 00:22:47.277 [2024-11-28 04:29:24.415319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.277 [2024-11-28 04:29:24.415418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.277 [2024-11-28 04:29:24.415441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21171b0 with addr=10.0.0.2, port=4420 00:22:47.277 [2024-11-28 04:29:24.415456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21171b0 is same with the state(5) to be set 00:22:47.277 [2024-11-28 04:29:24.415554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.277 [2024-11-28 04:29:24.415647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.277 [2024-11-28 04:29:24.415670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x214d590 with addr=10.0.0.2, port=4420 00:22:47.277 [2024-11-28 04:29:24.415686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d590 is same with the state(5) to be set 00:22:47.277 [2024-11-28 04:29:24.416565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.416985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.416999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.417018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.417032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.417048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.417061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.417077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.417091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.417106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.417120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.277 [2024-11-28 04:29:24.417135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.277 [2024-11-28 04:29:24.417149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.417977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.417993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.418006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.418022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.418036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.418051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.418065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.278 [2024-11-28 04:29:24.418080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.278 [2024-11-28 04:29:24.418094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.418496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.418510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.279 [2024-11-28 04:29:24.421617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.279 [2024-11-28 04:29:24.421632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.421977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.421991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.280 [2024-11-28 04:29:24.422550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.280 [2024-11-28 04:29:24.422564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.422982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.422998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.423011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.423030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.281 [2024-11-28 04:29:24.423044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.281 [2024-11-28 04:29:24.423157] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2349fa0 was disconnected and freed. reset controller. 00:22:47.281 [2024-11-28 04:29:24.423487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:47.281 [2024-11-28 04:29:24.423514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:47.281 [2024-11-28 04:29:24.423565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22aac70 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20f4f70 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22bb600 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21171b0 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214d590 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22960a0 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a5a60 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2142490 (9): Bad file descriptor 00:22:47.281 [2024-11-28 04:29:24.423851] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.281 [2024-11-28 04:29:24.423872] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.281 [2024-11-28 04:29:24.423890] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.281 [2024-11-28 04:29:24.423908] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.281 [2024-11-28 04:29:24.424039] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.281 [2024-11-28 04:29:24.424126] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.281 [2024-11-28 04:29:24.425359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:47.281 [2024-11-28 04:29:24.425563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.281 [2024-11-28 04:29:24.425704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.281 [2024-11-28 04:29:24.425729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2120690 with addr=10.0.0.2, port=4420 00:22:47.281 [2024-11-28 04:29:24.425745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2120690 is same with the state(5) to be set 00:22:47.281 [2024-11-28 04:29:24.425771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:47.281 [2024-11-28 04:29:24.425788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:47.281 [2024-11-28 04:29:24.425805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:47.281 [2024-11-28 04:29:24.425825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:47.281 [2024-11-28 04:29:24.425839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:47.281 [2024-11-28 04:29:24.425858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:47.281 [2024-11-28 04:29:24.425877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:47.281 [2024-11-28 04:29:24.425894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:47.281 [2024-11-28 04:29:24.425907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:47.281 [2024-11-28 04:29:24.425924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:47.281 [2024-11-28 04:29:24.425938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:47.281 [2024-11-28 04:29:24.425955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:47.282 [2024-11-28 04:29:24.426315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.426974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.426988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.282 [2024-11-28 04:29:24.427239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.282 [2024-11-28 04:29:24.427253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.427983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.427999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.428012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.283 [2024-11-28 04:29:24.428027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.283 [2024-11-28 04:29:24.428041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.428070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.428098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.428131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.428160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.428189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.428219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.428247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.428262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2344950 is same with the state(5) to be set 00:22:47.284 [2024-11-28 04:29:24.429811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.284 [2024-11-28 04:29:24.429836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.284 [2024-11-28 04:29:24.429849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.284 [2024-11-28 04:29:24.429870] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.284 [2024-11-28 04:29:24.429885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:47.284 [2024-11-28 04:29:24.430010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.284 [2024-11-28 04:29:24.430160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.284 [2024-11-28 04:29:24.430184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22aac70 with addr=10.0.0.2, port=4420 00:22:47.284 [2024-11-28 04:29:24.430199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22aac70 is same with the state(5) to be set 00:22:47.284 [2024-11-28 04:29:24.430306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.284 [2024-11-28 04:29:24.430412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.284 [2024-11-28 04:29:24.430437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2142490 with addr=10.0.0.2, port=4420 00:22:47.284 [2024-11-28 04:29:24.430452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2142490 is same with the state(5) to be set 00:22:47.284 [2024-11-28 04:29:24.430473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2120690 (9): Bad file descriptor 00:22:47.284 [2024-11-28 04:29:24.430601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.430977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.430991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.431006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.431020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.431036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.431050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.431071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.431085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.431101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.431114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.431130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.284 [2024-11-28 04:29:24.431144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.284 [2024-11-28 04:29:24.431159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.431981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.431994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.432010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.432023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.432039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.432052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.285 [2024-11-28 04:29:24.432068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.285 [2024-11-28 04:29:24.432082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.432530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.432546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23473e0 is same with the state(5) to be set 00:22:47.286 [2024-11-28 04:29:24.432632] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x23473e0 was disconnected and freed. reset controller. 00:22:47.286 [2024-11-28 04:29:24.433042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.286 [2024-11-28 04:29:24.433140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.286 [2024-11-28 04:29:24.433164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22ab150 with addr=10.0.0.2, port=4420 00:22:47.286 [2024-11-28 04:29:24.433179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22ab150 is same with the state(5) to be set 00:22:47.286 [2024-11-28 04:29:24.433197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22aac70 (9): Bad file descriptor 00:22:47.286 [2024-11-28 04:29:24.433216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2142490 (9): Bad file descriptor 00:22:47.286 [2024-11-28 04:29:24.433231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:47.286 [2024-11-28 04:29:24.433244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:47.286 [2024-11-28 04:29:24.433261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:47.286 [2024-11-28 04:29:24.434702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.286 [2024-11-28 04:29:24.434727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:47.286 [2024-11-28 04:29:24.434763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ab150 (9): Bad file descriptor 00:22:47.286 [2024-11-28 04:29:24.434784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:47.286 [2024-11-28 04:29:24.434797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:47.286 [2024-11-28 04:29:24.434810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:47.286 [2024-11-28 04:29:24.434828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:47.286 [2024-11-28 04:29:24.434842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:47.286 [2024-11-28 04:29:24.434855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:47.286 [2024-11-28 04:29:24.434984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.286 [2024-11-28 04:29:24.435006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.286 [2024-11-28 04:29:24.435163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.286 [2024-11-28 04:29:24.435271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.286 [2024-11-28 04:29:24.435295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22a5a60 with addr=10.0.0.2, port=4420 00:22:47.286 [2024-11-28 04:29:24.435310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22a5a60 is same with the state(5) to be set 00:22:47.286 [2024-11-28 04:29:24.435324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:47.286 [2024-11-28 04:29:24.435336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:47.286 [2024-11-28 04:29:24.435349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:47.286 [2024-11-28 04:29:24.435419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.435440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.435460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.435482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.435500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.435514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.286 [2024-11-28 04:29:24.435538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.286 [2024-11-28 04:29:24.435554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.435983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.435997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.287 [2024-11-28 04:29:24.436478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.287 [2024-11-28 04:29:24.436492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.436970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.436987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.288 [2024-11-28 04:29:24.437331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.288 [2024-11-28 04:29:24.437349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2345e00 is same with the state(5) to be set 00:22:47.288 [2024-11-28 04:29:24.439250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:47.288 [2024-11-28 04:29:24.439280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:47.288 [2024-11-28 04:29:24.439298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:47.288 [2024-11-28 04:29:24.439314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:47.288 [2024-11-28 04:29:24.439330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:47.289 [2024-11-28 04:29:24.439348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.289 task offset: 40320 on job bdev=Nvme1n1 fails 00:22:47.289 00:22:47.289 Latency(us) 00:22:47.289 [2024-11-28T03:29:24.600Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme1n1 ended in about 0.88 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme1n1 : 0.88 332.11 20.76 73.04 0.00 157041.35 78060.66 126605.84 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme2n1 ended in about 0.88 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme2n1 : 0.88 330.89 20.68 72.77 0.00 156300.73 73788.68 125052.40 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme3n1 ended in about 0.88 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme3n1 : 0.88 329.67 20.60 72.50 0.00 155495.56 68739.98 123498.95 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme4n1 ended in about 0.90 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme4n1 : 0.90 324.93 20.31 71.46 0.00 156472.48 71458.51 121168.78 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme5n1 ended in about 0.91 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme5n1 : 0.91 321.45 20.09 70.70 0.00 156870.69 71458.51 121945.51 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme6n1 ended in about 0.91 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme6n1 : 0.91 318.26 19.89 70.00 0.00 157136.53 71070.15 122722.23 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme7n1 ended in about 0.91 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme7n1 : 0.91 319.58 19.97 70.29 0.00 155103.92 58642.58 126605.84 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme8n1 ended in about 0.90 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme8n1 : 0.90 324.42 20.28 71.35 0.00 151286.49 34952.53 127382.57 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme9n1 ended in about 0.90 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme9n1 : 0.90 322.89 20.18 71.01 0.00 150670.03 28350.39 127382.57 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.289 [2024-11-28T03:29:24.600Z] Job: Nvme10n1 ended in about 0.89 seconds with error 00:22:47.289 Verification LBA range: start 0x0 length 0x400 00:22:47.289 Nvme10n1 : 0.89 292.12 18.26 72.18 0.00 161310.54 13107.20 128159.29 00:22:47.289 [2024-11-28T03:29:24.600Z] =================================================================================================================== 00:22:47.289 [2024-11-28T03:29:24.600Z] Total : 3216.33 201.02 715.31 0.00 155718.42 13107.20 128159.29 00:22:47.289 [2024-11-28 04:29:24.467623] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:47.289 [2024-11-28 04:29:24.467714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:47.289 [2024-11-28 04:29:24.467841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22a5a60 (9): Bad file descriptor 00:22:47.289 [2024-11-28 04:29:24.468301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.468428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.468456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x214d590 with addr=10.0.0.2, port=4420 00:22:47.289 [2024-11-28 04:29:24.468476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214d590 is same with the state(5) to be set 00:22:47.289 [2024-11-28 04:29:24.468590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.468694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.468720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21171b0 with addr=10.0.0.2, port=4420 00:22:47.289 [2024-11-28 04:29:24.468736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21171b0 is same with the state(5) to be set 00:22:47.289 [2024-11-28 04:29:24.468843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.468949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.468974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22bb600 with addr=10.0.0.2, port=4420 00:22:47.289 [2024-11-28 04:29:24.468989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22bb600 is same with the state(5) to be set 00:22:47.289 [2024-11-28 04:29:24.469076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.469185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.469209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20f4f70 with addr=10.0.0.2, port=4420 00:22:47.289 [2024-11-28 04:29:24.469225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20f4f70 is same with the state(5) to be set 00:22:47.289 [2024-11-28 04:29:24.469308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.469419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.289 [2024-11-28 04:29:24.469443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2120690 with addr=10.0.0.2, port=4420 00:22:47.289 [2024-11-28 04:29:24.469458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2120690 is same with the state(5) to be set 00:22:47.289 [2024-11-28 04:29:24.469561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.469651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.469676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22960a0 with addr=10.0.0.2, port=4420 00:22:47.290 [2024-11-28 04:29:24.469692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22960a0 is same with the state(5) to be set 00:22:47.290 [2024-11-28 04:29:24.469708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.469721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.469739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:47.290 [2024-11-28 04:29:24.469800] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.290 [2024-11-28 04:29:24.469828] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.290 [2024-11-28 04:29:24.469847] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.290 [2024-11-28 04:29:24.470182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:47.290 [2024-11-28 04:29:24.470209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:47.290 [2024-11-28 04:29:24.470253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.470294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214d590 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.470320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21171b0 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.470338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22bb600 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.470355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20f4f70 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.470372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2120690 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.470388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22960a0 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.470444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:47.290 [2024-11-28 04:29:24.470553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.470653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.470678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2142490 with addr=10.0.0.2, port=4420 00:22:47.290 [2024-11-28 04:29:24.470693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2142490 is same with the state(5) to be set 00:22:47.290 [2024-11-28 04:29:24.470776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.470880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.470906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22aac70 with addr=10.0.0.2, port=4420 00:22:47.290 [2024-11-28 04:29:24.470921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22aac70 is same with the state(5) to be set 00:22:47.290 [2024-11-28 04:29:24.470935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.470947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.470961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:47.290 [2024-11-28 04:29:24.470978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.470992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.471032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.471078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.471121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.471160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.471502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.290 [2024-11-28 04:29:24.471531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22ab150 with addr=10.0.0.2, port=4420 00:22:47.290 [2024-11-28 04:29:24.471548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22ab150 is same with the state(5) to be set 00:22:47.290 [2024-11-28 04:29:24.471566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2142490 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.471585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22aac70 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.471627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ab150 (9): Bad file descriptor 00:22:47.290 [2024-11-28 04:29:24.471648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.471661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.471702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.290 [2024-11-28 04:29:24.471782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:47.290 [2024-11-28 04:29:24.471794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:47.290 [2024-11-28 04:29:24.471812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:47.290 [2024-11-28 04:29:24.471849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.856 04:29:25 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:47.856 04:29:25 -- target/shutdown.sh@138 -- # sleep 1 00:22:48.788 04:29:26 -- target/shutdown.sh@141 -- # kill -9 3962701 00:22:48.788 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3962701) - No such process 00:22:48.788 04:29:26 -- target/shutdown.sh@141 -- # true 00:22:48.788 04:29:26 -- target/shutdown.sh@143 -- # stoptarget 00:22:48.788 04:29:26 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:48.788 04:29:26 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:48.788 04:29:26 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:48.788 04:29:26 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:48.788 04:29:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:48.788 04:29:26 -- nvmf/common.sh@116 -- # sync 00:22:48.788 04:29:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:48.788 04:29:26 -- nvmf/common.sh@119 -- # set +e 00:22:48.788 04:29:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:48.788 04:29:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:48.788 rmmod nvme_tcp 00:22:48.788 rmmod nvme_fabrics 00:22:48.788 rmmod nvme_keyring 00:22:48.788 04:29:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:48.788 04:29:26 -- nvmf/common.sh@123 -- # set -e 00:22:48.788 04:29:26 -- nvmf/common.sh@124 -- # return 0 00:22:48.788 04:29:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:48.788 04:29:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:48.788 04:29:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:48.788 04:29:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:48.788 04:29:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:48.788 04:29:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:48.788 04:29:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:48.788 04:29:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:48.788 04:29:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:51.322 04:29:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:51.322 00:22:51.322 real 0m8.176s 00:22:51.322 user 0m21.348s 00:22:51.322 sys 0m1.634s 00:22:51.322 04:29:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:51.322 04:29:28 -- common/autotest_common.sh@10 -- # set +x 00:22:51.322 ************************************ 00:22:51.322 END TEST nvmf_shutdown_tc3 00:22:51.322 ************************************ 00:22:51.322 04:29:28 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:51.322 00:22:51.322 real 0m29.273s 00:22:51.322 user 1m24.237s 00:22:51.322 sys 0m6.725s 00:22:51.322 04:29:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:51.322 04:29:28 -- common/autotest_common.sh@10 -- # set +x 00:22:51.322 ************************************ 00:22:51.322 END TEST nvmf_shutdown 00:22:51.322 ************************************ 00:22:51.322 04:29:28 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:51.322 04:29:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:51.322 04:29:28 -- common/autotest_common.sh@10 -- # set +x 00:22:51.322 04:29:28 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:51.322 04:29:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:51.322 04:29:28 -- common/autotest_common.sh@10 -- # set +x 00:22:51.322 04:29:28 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:51.322 04:29:28 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:51.322 04:29:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:51.322 04:29:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:51.322 04:29:28 -- common/autotest_common.sh@10 -- # set +x 00:22:51.322 ************************************ 00:22:51.322 START TEST nvmf_multicontroller 00:22:51.322 ************************************ 00:22:51.322 04:29:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:51.322 * Looking for test storage... 00:22:51.322 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:51.322 04:29:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:51.322 04:29:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:51.322 04:29:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:51.322 04:29:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:51.322 04:29:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:51.322 04:29:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:51.322 04:29:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:51.322 04:29:28 -- scripts/common.sh@335 -- # IFS=.-: 00:22:51.322 04:29:28 -- scripts/common.sh@335 -- # read -ra ver1 00:22:51.322 04:29:28 -- scripts/common.sh@336 -- # IFS=.-: 00:22:51.322 04:29:28 -- scripts/common.sh@336 -- # read -ra ver2 00:22:51.322 04:29:28 -- scripts/common.sh@337 -- # local 'op=<' 00:22:51.322 04:29:28 -- scripts/common.sh@339 -- # ver1_l=2 00:22:51.322 04:29:28 -- scripts/common.sh@340 -- # ver2_l=1 00:22:51.322 04:29:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:51.322 04:29:28 -- scripts/common.sh@343 -- # case "$op" in 00:22:51.322 04:29:28 -- scripts/common.sh@344 -- # : 1 00:22:51.322 04:29:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:51.322 04:29:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:51.322 04:29:28 -- scripts/common.sh@364 -- # decimal 1 00:22:51.322 04:29:28 -- scripts/common.sh@352 -- # local d=1 00:22:51.322 04:29:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:51.322 04:29:28 -- scripts/common.sh@354 -- # echo 1 00:22:51.322 04:29:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:51.322 04:29:28 -- scripts/common.sh@365 -- # decimal 2 00:22:51.322 04:29:28 -- scripts/common.sh@352 -- # local d=2 00:22:51.322 04:29:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:51.322 04:29:28 -- scripts/common.sh@354 -- # echo 2 00:22:51.322 04:29:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:51.322 04:29:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:51.322 04:29:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:51.322 04:29:28 -- scripts/common.sh@367 -- # return 0 00:22:51.322 04:29:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:51.322 04:29:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:51.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:51.322 --rc genhtml_branch_coverage=1 00:22:51.322 --rc genhtml_function_coverage=1 00:22:51.322 --rc genhtml_legend=1 00:22:51.322 --rc geninfo_all_blocks=1 00:22:51.322 --rc geninfo_unexecuted_blocks=1 00:22:51.322 00:22:51.322 ' 00:22:51.322 04:29:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:51.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:51.322 --rc genhtml_branch_coverage=1 00:22:51.322 --rc genhtml_function_coverage=1 00:22:51.322 --rc genhtml_legend=1 00:22:51.322 --rc geninfo_all_blocks=1 00:22:51.322 --rc geninfo_unexecuted_blocks=1 00:22:51.322 00:22:51.322 ' 00:22:51.322 04:29:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:51.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:51.322 --rc genhtml_branch_coverage=1 00:22:51.322 --rc genhtml_function_coverage=1 00:22:51.322 --rc genhtml_legend=1 00:22:51.322 --rc geninfo_all_blocks=1 00:22:51.322 --rc geninfo_unexecuted_blocks=1 00:22:51.322 00:22:51.322 ' 00:22:51.322 04:29:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:51.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:51.322 --rc genhtml_branch_coverage=1 00:22:51.322 --rc genhtml_function_coverage=1 00:22:51.322 --rc genhtml_legend=1 00:22:51.323 --rc geninfo_all_blocks=1 00:22:51.323 --rc geninfo_unexecuted_blocks=1 00:22:51.323 00:22:51.323 ' 00:22:51.323 04:29:28 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:51.323 04:29:28 -- nvmf/common.sh@7 -- # uname -s 00:22:51.323 04:29:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:51.323 04:29:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:51.323 04:29:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:51.323 04:29:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:51.323 04:29:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:51.323 04:29:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:51.323 04:29:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:51.323 04:29:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:51.323 04:29:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:51.323 04:29:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:51.323 04:29:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:51.323 04:29:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:51.323 04:29:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:51.323 04:29:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:51.323 04:29:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:51.323 04:29:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:51.323 04:29:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:51.323 04:29:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:51.323 04:29:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:51.323 04:29:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.323 04:29:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.323 04:29:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.323 04:29:28 -- paths/export.sh@5 -- # export PATH 00:22:51.323 04:29:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.323 04:29:28 -- nvmf/common.sh@46 -- # : 0 00:22:51.323 04:29:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:51.323 04:29:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:51.323 04:29:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:51.323 04:29:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:51.323 04:29:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:51.323 04:29:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:51.323 04:29:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:51.323 04:29:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:51.323 04:29:28 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:51.323 04:29:28 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:51.323 04:29:28 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:51.323 04:29:28 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:51.323 04:29:28 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:51.323 04:29:28 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:51.323 04:29:28 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:51.323 04:29:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:51.323 04:29:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:51.323 04:29:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:51.323 04:29:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:51.323 04:29:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:51.323 04:29:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.323 04:29:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:51.323 04:29:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:51.323 04:29:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:51.323 04:29:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:51.323 04:29:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:51.323 04:29:28 -- common/autotest_common.sh@10 -- # set +x 00:22:53.223 04:29:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:53.223 04:29:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:53.223 04:29:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:53.223 04:29:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:53.223 04:29:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:53.223 04:29:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:53.223 04:29:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:53.223 04:29:30 -- nvmf/common.sh@294 -- # net_devs=() 00:22:53.223 04:29:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:53.223 04:29:30 -- nvmf/common.sh@295 -- # e810=() 00:22:53.223 04:29:30 -- nvmf/common.sh@295 -- # local -ga e810 00:22:53.223 04:29:30 -- nvmf/common.sh@296 -- # x722=() 00:22:53.223 04:29:30 -- nvmf/common.sh@296 -- # local -ga x722 00:22:53.223 04:29:30 -- nvmf/common.sh@297 -- # mlx=() 00:22:53.223 04:29:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:53.223 04:29:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:53.223 04:29:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:53.223 04:29:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:53.223 04:29:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:53.223 04:29:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:53.223 04:29:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:53.223 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:53.223 04:29:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:53.223 04:29:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:53.224 04:29:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:53.224 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:53.224 04:29:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:53.224 04:29:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:53.224 04:29:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:53.224 04:29:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:53.224 04:29:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:53.224 04:29:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:53.224 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:53.224 04:29:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:53.224 04:29:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:53.224 04:29:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:53.224 04:29:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:53.224 04:29:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:53.224 04:29:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:53.224 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:53.224 04:29:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:53.224 04:29:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:53.224 04:29:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:53.224 04:29:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:53.224 04:29:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:53.224 04:29:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:53.224 04:29:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:53.224 04:29:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:53.224 04:29:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:53.224 04:29:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:53.224 04:29:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:53.224 04:29:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:53.224 04:29:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:53.224 04:29:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:53.224 04:29:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:53.224 04:29:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:53.224 04:29:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:53.224 04:29:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:53.224 04:29:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:53.224 04:29:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:53.224 04:29:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:53.224 04:29:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:53.224 04:29:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:53.224 04:29:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:53.224 04:29:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:53.224 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:53.224 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.361 ms 00:22:53.224 00:22:53.224 --- 10.0.0.2 ping statistics --- 00:22:53.224 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:53.224 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:22:53.224 04:29:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:53.224 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:53.224 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:22:53.224 00:22:53.224 --- 10.0.0.1 ping statistics --- 00:22:53.224 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:53.224 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:22:53.224 04:29:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:53.224 04:29:30 -- nvmf/common.sh@410 -- # return 0 00:22:53.224 04:29:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:53.224 04:29:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:53.224 04:29:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:53.482 04:29:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:53.482 04:29:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:53.482 04:29:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:53.482 04:29:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:53.482 04:29:30 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:53.482 04:29:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:53.482 04:29:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:53.482 04:29:30 -- common/autotest_common.sh@10 -- # set +x 00:22:53.482 04:29:30 -- nvmf/common.sh@469 -- # nvmfpid=3965254 00:22:53.482 04:29:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:53.482 04:29:30 -- nvmf/common.sh@470 -- # waitforlisten 3965254 00:22:53.482 04:29:30 -- common/autotest_common.sh@829 -- # '[' -z 3965254 ']' 00:22:53.482 04:29:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:53.482 04:29:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:53.482 04:29:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:53.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:53.482 04:29:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:53.482 04:29:30 -- common/autotest_common.sh@10 -- # set +x 00:22:53.482 [2024-11-28 04:29:30.599286] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:53.482 [2024-11-28 04:29:30.599367] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:53.482 EAL: No free 2048 kB hugepages reported on node 1 00:22:53.482 [2024-11-28 04:29:30.662461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:53.482 [2024-11-28 04:29:30.767894] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:53.482 [2024-11-28 04:29:30.768060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:53.482 [2024-11-28 04:29:30.768078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:53.482 [2024-11-28 04:29:30.768091] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:53.482 [2024-11-28 04:29:30.768182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:53.482 [2024-11-28 04:29:30.768238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:53.482 [2024-11-28 04:29:30.768241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:54.417 04:29:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:54.417 04:29:31 -- common/autotest_common.sh@862 -- # return 0 00:22:54.417 04:29:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:54.417 04:29:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.417 04:29:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:54.417 04:29:31 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:54.417 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.417 [2024-11-28 04:29:31.629889] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:54.417 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.417 04:29:31 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:54.417 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.417 Malloc0 00:22:54.417 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.417 04:29:31 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:54.417 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.417 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.417 04:29:31 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:54.417 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.417 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.417 04:29:31 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:54.417 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.417 [2024-11-28 04:29:31.692915] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:54.417 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.417 04:29:31 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:54.417 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.417 [2024-11-28 04:29:31.700748] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:54.417 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.417 04:29:31 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:54.417 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.417 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.675 Malloc1 00:22:54.675 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.675 04:29:31 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:54.675 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.675 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.675 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.675 04:29:31 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:54.675 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.675 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.675 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.675 04:29:31 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:54.675 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.675 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.675 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.675 04:29:31 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:54.675 04:29:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.675 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:54.675 04:29:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.675 04:29:31 -- host/multicontroller.sh@44 -- # bdevperf_pid=3965410 00:22:54.675 04:29:31 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:54.675 04:29:31 -- host/multicontroller.sh@47 -- # waitforlisten 3965410 /var/tmp/bdevperf.sock 00:22:54.675 04:29:31 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:54.675 04:29:31 -- common/autotest_common.sh@829 -- # '[' -z 3965410 ']' 00:22:54.675 04:29:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:54.675 04:29:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:54.675 04:29:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:54.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:54.675 04:29:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:54.675 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:22:55.692 04:29:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:55.692 04:29:32 -- common/autotest_common.sh@862 -- # return 0 00:22:55.692 04:29:32 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:55.692 04:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.692 04:29:32 -- common/autotest_common.sh@10 -- # set +x 00:22:55.692 NVMe0n1 00:22:55.692 04:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.692 04:29:32 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:55.692 04:29:32 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:55.692 04:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.692 04:29:32 -- common/autotest_common.sh@10 -- # set +x 00:22:55.692 04:29:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.692 1 00:22:55.692 04:29:32 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:55.692 04:29:32 -- common/autotest_common.sh@650 -- # local es=0 00:22:55.692 04:29:32 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:55.692 04:29:32 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.692 04:29:32 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:55.692 04:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.692 04:29:32 -- common/autotest_common.sh@10 -- # set +x 00:22:55.692 request: 00:22:55.692 { 00:22:55.692 "name": "NVMe0", 00:22:55.692 "trtype": "tcp", 00:22:55.692 "traddr": "10.0.0.2", 00:22:55.692 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:55.692 "hostaddr": "10.0.0.2", 00:22:55.692 "hostsvcid": "60000", 00:22:55.692 "adrfam": "ipv4", 00:22:55.692 "trsvcid": "4420", 00:22:55.692 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:55.692 "method": "bdev_nvme_attach_controller", 00:22:55.692 "req_id": 1 00:22:55.692 } 00:22:55.692 Got JSON-RPC error response 00:22:55.692 response: 00:22:55.692 { 00:22:55.692 "code": -114, 00:22:55.692 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:55.692 } 00:22:55.692 04:29:32 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:55.692 04:29:32 -- common/autotest_common.sh@653 -- # es=1 00:22:55.692 04:29:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:55.692 04:29:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:55.692 04:29:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:55.692 04:29:32 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:55.692 04:29:32 -- common/autotest_common.sh@650 -- # local es=0 00:22:55.692 04:29:32 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:55.692 04:29:32 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.692 04:29:32 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:55.692 04:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.692 04:29:32 -- common/autotest_common.sh@10 -- # set +x 00:22:55.692 request: 00:22:55.692 { 00:22:55.692 "name": "NVMe0", 00:22:55.692 "trtype": "tcp", 00:22:55.692 "traddr": "10.0.0.2", 00:22:55.692 "hostaddr": "10.0.0.2", 00:22:55.692 "hostsvcid": "60000", 00:22:55.692 "adrfam": "ipv4", 00:22:55.692 "trsvcid": "4420", 00:22:55.692 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:55.692 "method": "bdev_nvme_attach_controller", 00:22:55.692 "req_id": 1 00:22:55.692 } 00:22:55.692 Got JSON-RPC error response 00:22:55.692 response: 00:22:55.692 { 00:22:55.692 "code": -114, 00:22:55.692 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:55.692 } 00:22:55.692 04:29:32 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:55.692 04:29:32 -- common/autotest_common.sh@653 -- # es=1 00:22:55.692 04:29:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:55.692 04:29:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:55.692 04:29:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:55.692 04:29:32 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:55.692 04:29:32 -- common/autotest_common.sh@650 -- # local es=0 00:22:55.692 04:29:32 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:55.692 04:29:32 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:55.692 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.693 04:29:32 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:55.693 04:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.693 04:29:32 -- common/autotest_common.sh@10 -- # set +x 00:22:55.693 request: 00:22:55.693 { 00:22:55.693 "name": "NVMe0", 00:22:55.693 "trtype": "tcp", 00:22:55.693 "traddr": "10.0.0.2", 00:22:55.693 "hostaddr": "10.0.0.2", 00:22:55.693 "hostsvcid": "60000", 00:22:55.693 "adrfam": "ipv4", 00:22:55.693 "trsvcid": "4420", 00:22:55.693 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:55.693 "multipath": "disable", 00:22:55.693 "method": "bdev_nvme_attach_controller", 00:22:55.693 "req_id": 1 00:22:55.693 } 00:22:55.693 Got JSON-RPC error response 00:22:55.693 response: 00:22:55.693 { 00:22:55.693 "code": -114, 00:22:55.693 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:55.693 } 00:22:55.693 04:29:32 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:55.693 04:29:32 -- common/autotest_common.sh@653 -- # es=1 00:22:55.693 04:29:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:55.693 04:29:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:55.693 04:29:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:55.693 04:29:32 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:55.693 04:29:32 -- common/autotest_common.sh@650 -- # local es=0 00:22:55.693 04:29:32 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:55.693 04:29:32 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:55.693 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.693 04:29:32 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:55.693 04:29:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:55.693 04:29:32 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:55.693 04:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.693 04:29:32 -- common/autotest_common.sh@10 -- # set +x 00:22:55.693 request: 00:22:55.693 { 00:22:55.693 "name": "NVMe0", 00:22:55.693 "trtype": "tcp", 00:22:55.693 "traddr": "10.0.0.2", 00:22:55.693 "hostaddr": "10.0.0.2", 00:22:55.693 "hostsvcid": "60000", 00:22:55.693 "adrfam": "ipv4", 00:22:55.693 "trsvcid": "4420", 00:22:55.693 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:55.693 "multipath": "failover", 00:22:55.693 "method": "bdev_nvme_attach_controller", 00:22:55.693 "req_id": 1 00:22:55.693 } 00:22:55.693 Got JSON-RPC error response 00:22:55.693 response: 00:22:55.693 { 00:22:55.693 "code": -114, 00:22:55.693 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:55.693 } 00:22:55.693 04:29:32 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:55.693 04:29:32 -- common/autotest_common.sh@653 -- # es=1 00:22:55.693 04:29:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:55.693 04:29:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:55.693 04:29:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:55.693 04:29:32 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:55.693 04:29:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.693 04:29:32 -- common/autotest_common.sh@10 -- # set +x 00:22:55.960 00:22:55.960 04:29:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.960 04:29:33 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:55.960 04:29:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.960 04:29:33 -- common/autotest_common.sh@10 -- # set +x 00:22:55.960 04:29:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.960 04:29:33 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:55.960 04:29:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:55.960 04:29:33 -- common/autotest_common.sh@10 -- # set +x 00:22:55.960 00:22:55.960 04:29:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.218 04:29:33 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:56.218 04:29:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:56.218 04:29:33 -- common/autotest_common.sh@10 -- # set +x 00:22:56.218 04:29:33 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:56.218 04:29:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:56.218 04:29:33 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:56.218 04:29:33 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:57.151 0 00:22:57.151 04:29:34 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:57.151 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.151 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:22:57.151 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.151 04:29:34 -- host/multicontroller.sh@100 -- # killprocess 3965410 00:22:57.151 04:29:34 -- common/autotest_common.sh@936 -- # '[' -z 3965410 ']' 00:22:57.151 04:29:34 -- common/autotest_common.sh@940 -- # kill -0 3965410 00:22:57.151 04:29:34 -- common/autotest_common.sh@941 -- # uname 00:22:57.151 04:29:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:57.151 04:29:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3965410 00:22:57.409 04:29:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:57.409 04:29:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:57.409 04:29:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3965410' 00:22:57.409 killing process with pid 3965410 00:22:57.409 04:29:34 -- common/autotest_common.sh@955 -- # kill 3965410 00:22:57.409 04:29:34 -- common/autotest_common.sh@960 -- # wait 3965410 00:22:57.667 04:29:34 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:57.667 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.667 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:22:57.667 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.667 04:29:34 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:57.667 04:29:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.667 04:29:34 -- common/autotest_common.sh@10 -- # set +x 00:22:57.667 04:29:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.667 04:29:34 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:57.667 04:29:34 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:57.667 04:29:34 -- common/autotest_common.sh@1607 -- # read -r file 00:22:57.667 04:29:34 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:57.667 04:29:34 -- common/autotest_common.sh@1606 -- # sort -u 00:22:57.667 04:29:34 -- common/autotest_common.sh@1608 -- # cat 00:22:57.667 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:57.667 [2024-11-28 04:29:31.802349] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:57.667 [2024-11-28 04:29:31.802430] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3965410 ] 00:22:57.667 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.667 [2024-11-28 04:29:31.860976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:57.667 [2024-11-28 04:29:31.966573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:57.667 [2024-11-28 04:29:33.265571] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 4b48b8db-44e9-4b65-b648-65838cd02233 already exists 00:22:57.667 [2024-11-28 04:29:33.265612] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:4b48b8db-44e9-4b65-b648-65838cd02233 alias for bdev NVMe1n1 00:22:57.667 [2024-11-28 04:29:33.265647] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:57.667 Running I/O for 1 seconds... 00:22:57.667 00:22:57.668 Latency(us) 00:22:57.668 [2024-11-28T03:29:34.979Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:57.668 [2024-11-28T03:29:34.979Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:57.668 NVMe0n1 : 1.01 19669.64 76.83 0.00 0.00 6498.60 3956.43 15922.82 00:22:57.668 [2024-11-28T03:29:34.979Z] =================================================================================================================== 00:22:57.668 [2024-11-28T03:29:34.979Z] Total : 19669.64 76.83 0.00 0.00 6498.60 3956.43 15922.82 00:22:57.668 Received shutdown signal, test time was about 1.000000 seconds 00:22:57.668 00:22:57.668 Latency(us) 00:22:57.668 [2024-11-28T03:29:34.979Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:57.668 [2024-11-28T03:29:34.979Z] =================================================================================================================== 00:22:57.668 [2024-11-28T03:29:34.979Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:57.668 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:57.668 04:29:34 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:57.668 04:29:34 -- common/autotest_common.sh@1607 -- # read -r file 00:22:57.668 04:29:34 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:57.668 04:29:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:57.668 04:29:34 -- nvmf/common.sh@116 -- # sync 00:22:57.668 04:29:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:57.668 04:29:34 -- nvmf/common.sh@119 -- # set +e 00:22:57.668 04:29:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:57.668 04:29:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:57.668 rmmod nvme_tcp 00:22:57.668 rmmod nvme_fabrics 00:22:57.668 rmmod nvme_keyring 00:22:57.668 04:29:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:57.668 04:29:34 -- nvmf/common.sh@123 -- # set -e 00:22:57.668 04:29:34 -- nvmf/common.sh@124 -- # return 0 00:22:57.668 04:29:34 -- nvmf/common.sh@477 -- # '[' -n 3965254 ']' 00:22:57.668 04:29:34 -- nvmf/common.sh@478 -- # killprocess 3965254 00:22:57.668 04:29:34 -- common/autotest_common.sh@936 -- # '[' -z 3965254 ']' 00:22:57.668 04:29:34 -- common/autotest_common.sh@940 -- # kill -0 3965254 00:22:57.668 04:29:34 -- common/autotest_common.sh@941 -- # uname 00:22:57.668 04:29:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:57.668 04:29:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3965254 00:22:57.668 04:29:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:57.668 04:29:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:57.668 04:29:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3965254' 00:22:57.668 killing process with pid 3965254 00:22:57.668 04:29:34 -- common/autotest_common.sh@955 -- # kill 3965254 00:22:57.668 04:29:34 -- common/autotest_common.sh@960 -- # wait 3965254 00:22:57.926 04:29:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:57.926 04:29:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:57.926 04:29:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:57.926 04:29:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:57.926 04:29:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:57.926 04:29:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:57.926 04:29:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:57.926 04:29:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.459 04:29:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:00.459 00:23:00.459 real 0m9.054s 00:23:00.459 user 0m17.322s 00:23:00.459 sys 0m2.428s 00:23:00.459 04:29:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.459 04:29:37 -- common/autotest_common.sh@10 -- # set +x 00:23:00.459 ************************************ 00:23:00.459 END TEST nvmf_multicontroller 00:23:00.459 ************************************ 00:23:00.459 04:29:37 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:00.459 04:29:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:00.459 04:29:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.459 04:29:37 -- common/autotest_common.sh@10 -- # set +x 00:23:00.459 ************************************ 00:23:00.459 START TEST nvmf_aer 00:23:00.459 ************************************ 00:23:00.459 04:29:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:00.459 * Looking for test storage... 00:23:00.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:00.459 04:29:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:00.459 04:29:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:00.459 04:29:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:00.459 04:29:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:00.459 04:29:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:00.459 04:29:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:00.459 04:29:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:00.459 04:29:37 -- scripts/common.sh@335 -- # IFS=.-: 00:23:00.459 04:29:37 -- scripts/common.sh@335 -- # read -ra ver1 00:23:00.459 04:29:37 -- scripts/common.sh@336 -- # IFS=.-: 00:23:00.459 04:29:37 -- scripts/common.sh@336 -- # read -ra ver2 00:23:00.459 04:29:37 -- scripts/common.sh@337 -- # local 'op=<' 00:23:00.459 04:29:37 -- scripts/common.sh@339 -- # ver1_l=2 00:23:00.459 04:29:37 -- scripts/common.sh@340 -- # ver2_l=1 00:23:00.459 04:29:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:00.459 04:29:37 -- scripts/common.sh@343 -- # case "$op" in 00:23:00.459 04:29:37 -- scripts/common.sh@344 -- # : 1 00:23:00.459 04:29:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:00.459 04:29:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:00.459 04:29:37 -- scripts/common.sh@364 -- # decimal 1 00:23:00.459 04:29:37 -- scripts/common.sh@352 -- # local d=1 00:23:00.459 04:29:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:00.459 04:29:37 -- scripts/common.sh@354 -- # echo 1 00:23:00.459 04:29:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:00.459 04:29:37 -- scripts/common.sh@365 -- # decimal 2 00:23:00.459 04:29:37 -- scripts/common.sh@352 -- # local d=2 00:23:00.459 04:29:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:00.459 04:29:37 -- scripts/common.sh@354 -- # echo 2 00:23:00.459 04:29:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:00.459 04:29:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:00.459 04:29:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:00.459 04:29:37 -- scripts/common.sh@367 -- # return 0 00:23:00.459 04:29:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:00.459 04:29:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:00.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.459 --rc genhtml_branch_coverage=1 00:23:00.459 --rc genhtml_function_coverage=1 00:23:00.459 --rc genhtml_legend=1 00:23:00.459 --rc geninfo_all_blocks=1 00:23:00.459 --rc geninfo_unexecuted_blocks=1 00:23:00.459 00:23:00.459 ' 00:23:00.459 04:29:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:00.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.459 --rc genhtml_branch_coverage=1 00:23:00.459 --rc genhtml_function_coverage=1 00:23:00.459 --rc genhtml_legend=1 00:23:00.459 --rc geninfo_all_blocks=1 00:23:00.459 --rc geninfo_unexecuted_blocks=1 00:23:00.459 00:23:00.459 ' 00:23:00.459 04:29:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:00.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.460 --rc genhtml_branch_coverage=1 00:23:00.460 --rc genhtml_function_coverage=1 00:23:00.460 --rc genhtml_legend=1 00:23:00.460 --rc geninfo_all_blocks=1 00:23:00.460 --rc geninfo_unexecuted_blocks=1 00:23:00.460 00:23:00.460 ' 00:23:00.460 04:29:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:00.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.460 --rc genhtml_branch_coverage=1 00:23:00.460 --rc genhtml_function_coverage=1 00:23:00.460 --rc genhtml_legend=1 00:23:00.460 --rc geninfo_all_blocks=1 00:23:00.460 --rc geninfo_unexecuted_blocks=1 00:23:00.460 00:23:00.460 ' 00:23:00.460 04:29:37 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:00.460 04:29:37 -- nvmf/common.sh@7 -- # uname -s 00:23:00.460 04:29:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:00.460 04:29:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:00.460 04:29:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:00.460 04:29:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:00.460 04:29:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:00.460 04:29:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:00.460 04:29:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:00.460 04:29:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:00.460 04:29:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:00.460 04:29:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:00.460 04:29:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.460 04:29:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.460 04:29:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:00.460 04:29:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:00.460 04:29:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:00.460 04:29:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:00.460 04:29:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.460 04:29:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.460 04:29:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.460 04:29:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.460 04:29:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.460 04:29:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.460 04:29:37 -- paths/export.sh@5 -- # export PATH 00:23:00.460 04:29:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.460 04:29:37 -- nvmf/common.sh@46 -- # : 0 00:23:00.460 04:29:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:00.460 04:29:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:00.460 04:29:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:00.460 04:29:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:00.460 04:29:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:00.460 04:29:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:00.460 04:29:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:00.460 04:29:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:00.460 04:29:37 -- host/aer.sh@11 -- # nvmftestinit 00:23:00.460 04:29:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:00.460 04:29:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.460 04:29:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:00.460 04:29:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:00.460 04:29:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:00.460 04:29:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.460 04:29:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.460 04:29:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.460 04:29:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:00.460 04:29:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:00.460 04:29:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:00.460 04:29:37 -- common/autotest_common.sh@10 -- # set +x 00:23:02.363 04:29:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:02.363 04:29:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:02.363 04:29:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:02.363 04:29:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:02.363 04:29:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:02.363 04:29:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:02.363 04:29:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:02.363 04:29:39 -- nvmf/common.sh@294 -- # net_devs=() 00:23:02.363 04:29:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:02.363 04:29:39 -- nvmf/common.sh@295 -- # e810=() 00:23:02.363 04:29:39 -- nvmf/common.sh@295 -- # local -ga e810 00:23:02.363 04:29:39 -- nvmf/common.sh@296 -- # x722=() 00:23:02.363 04:29:39 -- nvmf/common.sh@296 -- # local -ga x722 00:23:02.363 04:29:39 -- nvmf/common.sh@297 -- # mlx=() 00:23:02.363 04:29:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:02.363 04:29:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:02.363 04:29:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:02.363 04:29:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:02.363 04:29:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:02.363 04:29:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.363 04:29:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:02.363 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:02.363 04:29:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:02.363 04:29:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:02.363 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:02.363 04:29:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:02.363 04:29:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.363 04:29:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.363 04:29:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.363 04:29:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.363 04:29:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:02.363 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:02.363 04:29:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.363 04:29:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:02.363 04:29:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:02.363 04:29:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:02.363 04:29:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:02.363 04:29:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:02.363 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:02.363 04:29:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:02.363 04:29:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:02.363 04:29:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:02.363 04:29:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:02.363 04:29:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:02.363 04:29:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:02.363 04:29:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:02.363 04:29:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:02.363 04:29:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:02.363 04:29:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:02.363 04:29:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:02.363 04:29:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:02.363 04:29:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:02.363 04:29:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:02.363 04:29:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:02.363 04:29:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:02.363 04:29:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:02.363 04:29:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:02.363 04:29:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:02.363 04:29:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:02.363 04:29:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:02.363 04:29:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:02.363 04:29:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:02.363 04:29:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:02.363 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:02.363 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:23:02.363 00:23:02.363 --- 10.0.0.2 ping statistics --- 00:23:02.363 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.363 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:23:02.363 04:29:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:02.363 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:02.363 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:23:02.363 00:23:02.363 --- 10.0.0.1 ping statistics --- 00:23:02.363 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:02.363 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:23:02.363 04:29:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:02.363 04:29:39 -- nvmf/common.sh@410 -- # return 0 00:23:02.363 04:29:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:02.363 04:29:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:02.363 04:29:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:02.363 04:29:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:02.363 04:29:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:02.363 04:29:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:02.363 04:29:39 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:02.363 04:29:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:02.363 04:29:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:02.363 04:29:39 -- common/autotest_common.sh@10 -- # set +x 00:23:02.363 04:29:39 -- nvmf/common.sh@469 -- # nvmfpid=3967787 00:23:02.363 04:29:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:02.363 04:29:39 -- nvmf/common.sh@470 -- # waitforlisten 3967787 00:23:02.363 04:29:39 -- common/autotest_common.sh@829 -- # '[' -z 3967787 ']' 00:23:02.363 04:29:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:02.363 04:29:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:02.363 04:29:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:02.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:02.363 04:29:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:02.363 04:29:39 -- common/autotest_common.sh@10 -- # set +x 00:23:02.363 [2024-11-28 04:29:39.576867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:02.363 [2024-11-28 04:29:39.576946] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:02.363 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.363 [2024-11-28 04:29:39.639192] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:02.621 [2024-11-28 04:29:39.751508] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:02.621 [2024-11-28 04:29:39.751697] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:02.621 [2024-11-28 04:29:39.751715] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:02.621 [2024-11-28 04:29:39.751727] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:02.621 [2024-11-28 04:29:39.751783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:02.621 [2024-11-28 04:29:39.751845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:02.621 [2024-11-28 04:29:39.751875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:02.621 [2024-11-28 04:29:39.751878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:03.580 04:29:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:03.580 04:29:40 -- common/autotest_common.sh@862 -- # return 0 00:23:03.580 04:29:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:03.580 04:29:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:03.580 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.580 04:29:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:03.580 04:29:40 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:03.580 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.580 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.580 [2024-11-28 04:29:40.630357] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:03.580 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.580 04:29:40 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:03.580 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.580 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.580 Malloc0 00:23:03.580 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.580 04:29:40 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:03.580 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.580 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.580 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.580 04:29:40 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:03.580 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.580 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.580 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.580 04:29:40 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:03.580 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.580 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.580 [2024-11-28 04:29:40.682344] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:03.580 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.580 04:29:40 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:03.580 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.580 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.580 [2024-11-28 04:29:40.690085] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:03.580 [ 00:23:03.580 { 00:23:03.580 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:03.580 "subtype": "Discovery", 00:23:03.580 "listen_addresses": [], 00:23:03.580 "allow_any_host": true, 00:23:03.580 "hosts": [] 00:23:03.580 }, 00:23:03.580 { 00:23:03.580 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.580 "subtype": "NVMe", 00:23:03.580 "listen_addresses": [ 00:23:03.580 { 00:23:03.580 "transport": "TCP", 00:23:03.580 "trtype": "TCP", 00:23:03.580 "adrfam": "IPv4", 00:23:03.580 "traddr": "10.0.0.2", 00:23:03.580 "trsvcid": "4420" 00:23:03.580 } 00:23:03.580 ], 00:23:03.580 "allow_any_host": true, 00:23:03.580 "hosts": [], 00:23:03.580 "serial_number": "SPDK00000000000001", 00:23:03.580 "model_number": "SPDK bdev Controller", 00:23:03.580 "max_namespaces": 2, 00:23:03.580 "min_cntlid": 1, 00:23:03.580 "max_cntlid": 65519, 00:23:03.580 "namespaces": [ 00:23:03.580 { 00:23:03.580 "nsid": 1, 00:23:03.580 "bdev_name": "Malloc0", 00:23:03.580 "name": "Malloc0", 00:23:03.580 "nguid": "DC49440FB2E1459698AC50CBD9E9D3F9", 00:23:03.580 "uuid": "dc49440f-b2e1-4596-98ac-50cbd9e9d3f9" 00:23:03.580 } 00:23:03.580 ] 00:23:03.580 } 00:23:03.580 ] 00:23:03.580 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.580 04:29:40 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:03.580 04:29:40 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:03.580 04:29:40 -- host/aer.sh@33 -- # aerpid=3967950 00:23:03.581 04:29:40 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:03.581 04:29:40 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:03.581 04:29:40 -- common/autotest_common.sh@1254 -- # local i=0 00:23:03.581 04:29:40 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:03.581 04:29:40 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:03.581 04:29:40 -- common/autotest_common.sh@1257 -- # i=1 00:23:03.581 04:29:40 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:03.581 EAL: No free 2048 kB hugepages reported on node 1 00:23:03.581 04:29:40 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:03.581 04:29:40 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:03.581 04:29:40 -- common/autotest_common.sh@1257 -- # i=2 00:23:03.581 04:29:40 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:03.839 04:29:40 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:03.839 04:29:40 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:03.839 04:29:40 -- common/autotest_common.sh@1265 -- # return 0 00:23:03.839 04:29:40 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:03.839 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.839 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.839 Malloc1 00:23:03.839 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.839 04:29:40 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:03.839 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.839 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.839 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.839 04:29:40 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:03.839 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.839 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.839 Asynchronous Event Request test 00:23:03.839 Attaching to 10.0.0.2 00:23:03.839 Attached to 10.0.0.2 00:23:03.839 Registering asynchronous event callbacks... 00:23:03.839 Starting namespace attribute notice tests for all controllers... 00:23:03.839 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:03.839 aer_cb - Changed Namespace 00:23:03.839 Cleaning up... 00:23:03.839 [ 00:23:03.839 { 00:23:03.839 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:03.839 "subtype": "Discovery", 00:23:03.839 "listen_addresses": [], 00:23:03.839 "allow_any_host": true, 00:23:03.839 "hosts": [] 00:23:03.839 }, 00:23:03.839 { 00:23:03.839 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:03.839 "subtype": "NVMe", 00:23:03.839 "listen_addresses": [ 00:23:03.839 { 00:23:03.839 "transport": "TCP", 00:23:03.839 "trtype": "TCP", 00:23:03.839 "adrfam": "IPv4", 00:23:03.839 "traddr": "10.0.0.2", 00:23:03.839 "trsvcid": "4420" 00:23:03.839 } 00:23:03.839 ], 00:23:03.839 "allow_any_host": true, 00:23:03.839 "hosts": [], 00:23:03.839 "serial_number": "SPDK00000000000001", 00:23:03.839 "model_number": "SPDK bdev Controller", 00:23:03.839 "max_namespaces": 2, 00:23:03.839 "min_cntlid": 1, 00:23:03.839 "max_cntlid": 65519, 00:23:03.839 "namespaces": [ 00:23:03.839 { 00:23:03.839 "nsid": 1, 00:23:03.839 "bdev_name": "Malloc0", 00:23:03.839 "name": "Malloc0", 00:23:03.839 "nguid": "DC49440FB2E1459698AC50CBD9E9D3F9", 00:23:03.839 "uuid": "dc49440f-b2e1-4596-98ac-50cbd9e9d3f9" 00:23:03.839 }, 00:23:03.839 { 00:23:03.839 "nsid": 2, 00:23:03.839 "bdev_name": "Malloc1", 00:23:03.839 "name": "Malloc1", 00:23:03.839 "nguid": "ED3CAA8859124660AF5E0AA18755178D", 00:23:03.839 "uuid": "ed3caa88-5912-4660-af5e-0aa18755178d" 00:23:03.839 } 00:23:03.839 ] 00:23:03.839 } 00:23:03.839 ] 00:23:03.839 04:29:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.839 04:29:40 -- host/aer.sh@43 -- # wait 3967950 00:23:03.839 04:29:40 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:03.839 04:29:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.839 04:29:40 -- common/autotest_common.sh@10 -- # set +x 00:23:03.839 04:29:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.839 04:29:41 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:03.839 04:29:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.839 04:29:41 -- common/autotest_common.sh@10 -- # set +x 00:23:03.839 04:29:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.839 04:29:41 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:03.839 04:29:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.839 04:29:41 -- common/autotest_common.sh@10 -- # set +x 00:23:03.839 04:29:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.839 04:29:41 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:03.839 04:29:41 -- host/aer.sh@51 -- # nvmftestfini 00:23:03.839 04:29:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:03.839 04:29:41 -- nvmf/common.sh@116 -- # sync 00:23:03.839 04:29:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:03.839 04:29:41 -- nvmf/common.sh@119 -- # set +e 00:23:03.839 04:29:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:03.839 04:29:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:03.839 rmmod nvme_tcp 00:23:03.839 rmmod nvme_fabrics 00:23:03.839 rmmod nvme_keyring 00:23:03.839 04:29:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:03.839 04:29:41 -- nvmf/common.sh@123 -- # set -e 00:23:03.839 04:29:41 -- nvmf/common.sh@124 -- # return 0 00:23:03.839 04:29:41 -- nvmf/common.sh@477 -- # '[' -n 3967787 ']' 00:23:03.839 04:29:41 -- nvmf/common.sh@478 -- # killprocess 3967787 00:23:03.839 04:29:41 -- common/autotest_common.sh@936 -- # '[' -z 3967787 ']' 00:23:03.839 04:29:41 -- common/autotest_common.sh@940 -- # kill -0 3967787 00:23:03.839 04:29:41 -- common/autotest_common.sh@941 -- # uname 00:23:03.839 04:29:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:03.839 04:29:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3967787 00:23:03.839 04:29:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:03.839 04:29:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:03.839 04:29:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3967787' 00:23:03.839 killing process with pid 3967787 00:23:03.839 04:29:41 -- common/autotest_common.sh@955 -- # kill 3967787 00:23:03.839 [2024-11-28 04:29:41.130162] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:03.839 04:29:41 -- common/autotest_common.sh@960 -- # wait 3967787 00:23:04.097 04:29:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:04.097 04:29:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:04.097 04:29:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:04.097 04:29:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:04.097 04:29:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:04.097 04:29:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:04.097 04:29:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:04.097 04:29:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:06.629 04:29:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:06.629 00:23:06.629 real 0m6.157s 00:23:06.629 user 0m7.380s 00:23:06.629 sys 0m1.929s 00:23:06.629 04:29:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:06.629 04:29:43 -- common/autotest_common.sh@10 -- # set +x 00:23:06.629 ************************************ 00:23:06.629 END TEST nvmf_aer 00:23:06.629 ************************************ 00:23:06.629 04:29:43 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:06.629 04:29:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:06.629 04:29:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:06.629 04:29:43 -- common/autotest_common.sh@10 -- # set +x 00:23:06.629 ************************************ 00:23:06.629 START TEST nvmf_async_init 00:23:06.629 ************************************ 00:23:06.629 04:29:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:06.629 * Looking for test storage... 00:23:06.629 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:06.629 04:29:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:06.629 04:29:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:06.629 04:29:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:06.629 04:29:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:06.629 04:29:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:06.629 04:29:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:06.629 04:29:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:06.629 04:29:43 -- scripts/common.sh@335 -- # IFS=.-: 00:23:06.629 04:29:43 -- scripts/common.sh@335 -- # read -ra ver1 00:23:06.629 04:29:43 -- scripts/common.sh@336 -- # IFS=.-: 00:23:06.629 04:29:43 -- scripts/common.sh@336 -- # read -ra ver2 00:23:06.629 04:29:43 -- scripts/common.sh@337 -- # local 'op=<' 00:23:06.629 04:29:43 -- scripts/common.sh@339 -- # ver1_l=2 00:23:06.629 04:29:43 -- scripts/common.sh@340 -- # ver2_l=1 00:23:06.629 04:29:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:06.629 04:29:43 -- scripts/common.sh@343 -- # case "$op" in 00:23:06.629 04:29:43 -- scripts/common.sh@344 -- # : 1 00:23:06.629 04:29:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:06.629 04:29:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:06.629 04:29:43 -- scripts/common.sh@364 -- # decimal 1 00:23:06.629 04:29:43 -- scripts/common.sh@352 -- # local d=1 00:23:06.629 04:29:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:06.629 04:29:43 -- scripts/common.sh@354 -- # echo 1 00:23:06.629 04:29:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:06.629 04:29:43 -- scripts/common.sh@365 -- # decimal 2 00:23:06.629 04:29:43 -- scripts/common.sh@352 -- # local d=2 00:23:06.629 04:29:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:06.629 04:29:43 -- scripts/common.sh@354 -- # echo 2 00:23:06.629 04:29:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:06.629 04:29:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:06.629 04:29:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:06.629 04:29:43 -- scripts/common.sh@367 -- # return 0 00:23:06.629 04:29:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:06.629 04:29:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:06.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.629 --rc genhtml_branch_coverage=1 00:23:06.629 --rc genhtml_function_coverage=1 00:23:06.629 --rc genhtml_legend=1 00:23:06.629 --rc geninfo_all_blocks=1 00:23:06.629 --rc geninfo_unexecuted_blocks=1 00:23:06.629 00:23:06.629 ' 00:23:06.629 04:29:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:06.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.629 --rc genhtml_branch_coverage=1 00:23:06.629 --rc genhtml_function_coverage=1 00:23:06.629 --rc genhtml_legend=1 00:23:06.629 --rc geninfo_all_blocks=1 00:23:06.629 --rc geninfo_unexecuted_blocks=1 00:23:06.629 00:23:06.629 ' 00:23:06.629 04:29:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:06.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.629 --rc genhtml_branch_coverage=1 00:23:06.629 --rc genhtml_function_coverage=1 00:23:06.629 --rc genhtml_legend=1 00:23:06.629 --rc geninfo_all_blocks=1 00:23:06.629 --rc geninfo_unexecuted_blocks=1 00:23:06.629 00:23:06.629 ' 00:23:06.629 04:29:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:06.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:06.629 --rc genhtml_branch_coverage=1 00:23:06.629 --rc genhtml_function_coverage=1 00:23:06.629 --rc genhtml_legend=1 00:23:06.629 --rc geninfo_all_blocks=1 00:23:06.629 --rc geninfo_unexecuted_blocks=1 00:23:06.629 00:23:06.630 ' 00:23:06.630 04:29:43 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:06.630 04:29:43 -- nvmf/common.sh@7 -- # uname -s 00:23:06.630 04:29:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:06.630 04:29:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:06.630 04:29:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:06.630 04:29:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:06.630 04:29:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:06.630 04:29:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:06.630 04:29:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:06.630 04:29:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:06.630 04:29:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:06.630 04:29:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:06.630 04:29:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:06.630 04:29:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:06.630 04:29:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:06.630 04:29:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:06.630 04:29:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:06.630 04:29:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:06.630 04:29:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:06.630 04:29:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:06.630 04:29:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:06.630 04:29:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.630 04:29:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.630 04:29:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.630 04:29:43 -- paths/export.sh@5 -- # export PATH 00:23:06.630 04:29:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:06.630 04:29:43 -- nvmf/common.sh@46 -- # : 0 00:23:06.630 04:29:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:06.630 04:29:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:06.630 04:29:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:06.630 04:29:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:06.630 04:29:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:06.630 04:29:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:06.630 04:29:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:06.630 04:29:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:06.630 04:29:43 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:06.630 04:29:43 -- host/async_init.sh@14 -- # null_block_size=512 00:23:06.630 04:29:43 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:06.630 04:29:43 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:06.630 04:29:43 -- host/async_init.sh@20 -- # uuidgen 00:23:06.630 04:29:43 -- host/async_init.sh@20 -- # tr -d - 00:23:06.630 04:29:43 -- host/async_init.sh@20 -- # nguid=4b55473cc75a48abb70a5a15a2d1aef7 00:23:06.630 04:29:43 -- host/async_init.sh@22 -- # nvmftestinit 00:23:06.630 04:29:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:06.630 04:29:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:06.630 04:29:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:06.630 04:29:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:06.630 04:29:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:06.630 04:29:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:06.630 04:29:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:06.630 04:29:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:06.630 04:29:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:06.630 04:29:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:06.630 04:29:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:06.630 04:29:43 -- common/autotest_common.sh@10 -- # set +x 00:23:08.529 04:29:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:08.529 04:29:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:08.529 04:29:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:08.529 04:29:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:08.529 04:29:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:08.529 04:29:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:08.529 04:29:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:08.529 04:29:45 -- nvmf/common.sh@294 -- # net_devs=() 00:23:08.529 04:29:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:08.529 04:29:45 -- nvmf/common.sh@295 -- # e810=() 00:23:08.529 04:29:45 -- nvmf/common.sh@295 -- # local -ga e810 00:23:08.529 04:29:45 -- nvmf/common.sh@296 -- # x722=() 00:23:08.529 04:29:45 -- nvmf/common.sh@296 -- # local -ga x722 00:23:08.529 04:29:45 -- nvmf/common.sh@297 -- # mlx=() 00:23:08.529 04:29:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:08.529 04:29:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:08.529 04:29:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:08.529 04:29:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:08.529 04:29:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:08.529 04:29:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:08.529 04:29:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:08.529 04:29:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:08.529 04:29:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:08.529 04:29:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:08.529 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:08.530 04:29:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:08.530 04:29:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:08.530 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:08.530 04:29:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:08.530 04:29:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:08.530 04:29:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:08.530 04:29:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:08.530 04:29:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:08.530 04:29:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:08.530 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:08.530 04:29:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:08.530 04:29:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:08.530 04:29:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:08.530 04:29:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:08.530 04:29:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:08.530 04:29:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:08.530 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:08.530 04:29:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:08.530 04:29:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:08.530 04:29:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:08.530 04:29:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:08.530 04:29:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:08.530 04:29:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:08.530 04:29:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:08.530 04:29:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:08.530 04:29:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:08.530 04:29:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:08.530 04:29:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:08.530 04:29:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:08.530 04:29:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:08.530 04:29:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:08.530 04:29:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:08.530 04:29:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:08.530 04:29:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:08.530 04:29:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:08.530 04:29:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:08.530 04:29:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:08.530 04:29:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:08.530 04:29:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:08.530 04:29:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:08.530 04:29:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:08.530 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:08.530 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:23:08.530 00:23:08.530 --- 10.0.0.2 ping statistics --- 00:23:08.530 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:08.530 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:23:08.530 04:29:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:08.530 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:08.530 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:23:08.530 00:23:08.530 --- 10.0.0.1 ping statistics --- 00:23:08.530 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:08.530 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:23:08.530 04:29:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:08.530 04:29:45 -- nvmf/common.sh@410 -- # return 0 00:23:08.530 04:29:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:08.530 04:29:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:08.530 04:29:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:08.530 04:29:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:08.530 04:29:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:08.530 04:29:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:08.530 04:29:45 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:08.530 04:29:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:08.530 04:29:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:08.530 04:29:45 -- common/autotest_common.sh@10 -- # set +x 00:23:08.530 04:29:45 -- nvmf/common.sh@469 -- # nvmfpid=3969905 00:23:08.530 04:29:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:08.530 04:29:45 -- nvmf/common.sh@470 -- # waitforlisten 3969905 00:23:08.530 04:29:45 -- common/autotest_common.sh@829 -- # '[' -z 3969905 ']' 00:23:08.530 04:29:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:08.530 04:29:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:08.530 04:29:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:08.530 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:08.530 04:29:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:08.530 04:29:45 -- common/autotest_common.sh@10 -- # set +x 00:23:08.789 [2024-11-28 04:29:45.844914] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:08.789 [2024-11-28 04:29:45.844981] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:08.789 EAL: No free 2048 kB hugepages reported on node 1 00:23:08.789 [2024-11-28 04:29:45.908784] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:08.789 [2024-11-28 04:29:46.031251] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:08.789 [2024-11-28 04:29:46.031396] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:08.789 [2024-11-28 04:29:46.031415] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:08.789 [2024-11-28 04:29:46.031437] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:08.789 [2024-11-28 04:29:46.031475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:09.724 04:29:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:09.724 04:29:46 -- common/autotest_common.sh@862 -- # return 0 00:23:09.724 04:29:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:09.724 04:29:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.724 04:29:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:09.724 04:29:46 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:09.724 04:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.724 [2024-11-28 04:29:46.885964] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:09.724 04:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.724 04:29:46 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:09.724 04:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.724 null0 00:23:09.724 04:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.724 04:29:46 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:09.724 04:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.724 04:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.724 04:29:46 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:09.724 04:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.724 04:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.724 04:29:46 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 4b55473cc75a48abb70a5a15a2d1aef7 00:23:09.724 04:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.724 04:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.724 04:29:46 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:09.724 04:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.724 [2024-11-28 04:29:46.926198] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:09.724 04:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.724 04:29:46 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:09.724 04:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.724 04:29:46 -- common/autotest_common.sh@10 -- # set +x 00:23:09.982 nvme0n1 00:23:09.982 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.982 04:29:47 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:09.982 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.982 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:09.982 [ 00:23:09.982 { 00:23:09.982 "name": "nvme0n1", 00:23:09.982 "aliases": [ 00:23:09.982 "4b55473c-c75a-48ab-b70a-5a15a2d1aef7" 00:23:09.982 ], 00:23:09.982 "product_name": "NVMe disk", 00:23:09.982 "block_size": 512, 00:23:09.982 "num_blocks": 2097152, 00:23:09.982 "uuid": "4b55473c-c75a-48ab-b70a-5a15a2d1aef7", 00:23:09.982 "assigned_rate_limits": { 00:23:09.982 "rw_ios_per_sec": 0, 00:23:09.982 "rw_mbytes_per_sec": 0, 00:23:09.982 "r_mbytes_per_sec": 0, 00:23:09.982 "w_mbytes_per_sec": 0 00:23:09.982 }, 00:23:09.982 "claimed": false, 00:23:09.982 "zoned": false, 00:23:09.982 "supported_io_types": { 00:23:09.982 "read": true, 00:23:09.982 "write": true, 00:23:09.982 "unmap": false, 00:23:09.982 "write_zeroes": true, 00:23:09.982 "flush": true, 00:23:09.982 "reset": true, 00:23:09.982 "compare": true, 00:23:09.982 "compare_and_write": true, 00:23:09.982 "abort": true, 00:23:09.982 "nvme_admin": true, 00:23:09.982 "nvme_io": true 00:23:09.982 }, 00:23:09.982 "driver_specific": { 00:23:09.982 "nvme": [ 00:23:09.982 { 00:23:09.982 "trid": { 00:23:09.982 "trtype": "TCP", 00:23:09.982 "adrfam": "IPv4", 00:23:09.982 "traddr": "10.0.0.2", 00:23:09.982 "trsvcid": "4420", 00:23:09.982 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:09.982 }, 00:23:09.982 "ctrlr_data": { 00:23:09.982 "cntlid": 1, 00:23:09.982 "vendor_id": "0x8086", 00:23:09.982 "model_number": "SPDK bdev Controller", 00:23:09.982 "serial_number": "00000000000000000000", 00:23:09.982 "firmware_revision": "24.01.1", 00:23:09.982 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:09.982 "oacs": { 00:23:09.982 "security": 0, 00:23:09.982 "format": 0, 00:23:09.982 "firmware": 0, 00:23:09.982 "ns_manage": 0 00:23:09.982 }, 00:23:09.982 "multi_ctrlr": true, 00:23:09.982 "ana_reporting": false 00:23:09.982 }, 00:23:09.982 "vs": { 00:23:09.982 "nvme_version": "1.3" 00:23:09.982 }, 00:23:09.982 "ns_data": { 00:23:09.982 "id": 1, 00:23:09.982 "can_share": true 00:23:09.982 } 00:23:09.982 } 00:23:09.982 ], 00:23:09.982 "mp_policy": "active_passive" 00:23:09.982 } 00:23:09.982 } 00:23:09.982 ] 00:23:09.982 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.982 04:29:47 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:09.982 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.982 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:09.982 [2024-11-28 04:29:47.174858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:09.982 [2024-11-28 04:29:47.174953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc95ba0 (9): Bad file descriptor 00:23:10.240 [2024-11-28 04:29:47.306681] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:10.240 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.240 04:29:47 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:10.240 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.240 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.240 [ 00:23:10.240 { 00:23:10.240 "name": "nvme0n1", 00:23:10.240 "aliases": [ 00:23:10.240 "4b55473c-c75a-48ab-b70a-5a15a2d1aef7" 00:23:10.240 ], 00:23:10.240 "product_name": "NVMe disk", 00:23:10.240 "block_size": 512, 00:23:10.240 "num_blocks": 2097152, 00:23:10.240 "uuid": "4b55473c-c75a-48ab-b70a-5a15a2d1aef7", 00:23:10.240 "assigned_rate_limits": { 00:23:10.240 "rw_ios_per_sec": 0, 00:23:10.240 "rw_mbytes_per_sec": 0, 00:23:10.240 "r_mbytes_per_sec": 0, 00:23:10.240 "w_mbytes_per_sec": 0 00:23:10.240 }, 00:23:10.240 "claimed": false, 00:23:10.240 "zoned": false, 00:23:10.240 "supported_io_types": { 00:23:10.240 "read": true, 00:23:10.240 "write": true, 00:23:10.240 "unmap": false, 00:23:10.240 "write_zeroes": true, 00:23:10.240 "flush": true, 00:23:10.240 "reset": true, 00:23:10.240 "compare": true, 00:23:10.240 "compare_and_write": true, 00:23:10.240 "abort": true, 00:23:10.240 "nvme_admin": true, 00:23:10.240 "nvme_io": true 00:23:10.240 }, 00:23:10.240 "driver_specific": { 00:23:10.240 "nvme": [ 00:23:10.240 { 00:23:10.240 "trid": { 00:23:10.240 "trtype": "TCP", 00:23:10.240 "adrfam": "IPv4", 00:23:10.240 "traddr": "10.0.0.2", 00:23:10.240 "trsvcid": "4420", 00:23:10.240 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:10.240 }, 00:23:10.240 "ctrlr_data": { 00:23:10.240 "cntlid": 2, 00:23:10.240 "vendor_id": "0x8086", 00:23:10.240 "model_number": "SPDK bdev Controller", 00:23:10.240 "serial_number": "00000000000000000000", 00:23:10.240 "firmware_revision": "24.01.1", 00:23:10.240 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:10.240 "oacs": { 00:23:10.240 "security": 0, 00:23:10.240 "format": 0, 00:23:10.240 "firmware": 0, 00:23:10.240 "ns_manage": 0 00:23:10.240 }, 00:23:10.240 "multi_ctrlr": true, 00:23:10.240 "ana_reporting": false 00:23:10.240 }, 00:23:10.240 "vs": { 00:23:10.240 "nvme_version": "1.3" 00:23:10.240 }, 00:23:10.240 "ns_data": { 00:23:10.240 "id": 1, 00:23:10.240 "can_share": true 00:23:10.240 } 00:23:10.240 } 00:23:10.240 ], 00:23:10.240 "mp_policy": "active_passive" 00:23:10.240 } 00:23:10.240 } 00:23:10.240 ] 00:23:10.240 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.240 04:29:47 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:10.240 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.240 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.240 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.240 04:29:47 -- host/async_init.sh@53 -- # mktemp 00:23:10.240 04:29:47 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.PEgP7rXDLi 00:23:10.240 04:29:47 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:10.240 04:29:47 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.PEgP7rXDLi 00:23:10.240 04:29:47 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:10.240 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.240 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.240 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.240 04:29:47 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:10.240 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.240 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.240 [2024-11-28 04:29:47.351460] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:10.241 [2024-11-28 04:29:47.351639] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:10.241 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.241 04:29:47 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.PEgP7rXDLi 00:23:10.241 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.241 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.241 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.241 04:29:47 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.PEgP7rXDLi 00:23:10.241 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.241 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.241 [2024-11-28 04:29:47.367492] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:10.241 nvme0n1 00:23:10.241 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.241 04:29:47 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:10.241 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.241 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.241 [ 00:23:10.241 { 00:23:10.241 "name": "nvme0n1", 00:23:10.241 "aliases": [ 00:23:10.241 "4b55473c-c75a-48ab-b70a-5a15a2d1aef7" 00:23:10.241 ], 00:23:10.241 "product_name": "NVMe disk", 00:23:10.241 "block_size": 512, 00:23:10.241 "num_blocks": 2097152, 00:23:10.241 "uuid": "4b55473c-c75a-48ab-b70a-5a15a2d1aef7", 00:23:10.241 "assigned_rate_limits": { 00:23:10.241 "rw_ios_per_sec": 0, 00:23:10.241 "rw_mbytes_per_sec": 0, 00:23:10.241 "r_mbytes_per_sec": 0, 00:23:10.241 "w_mbytes_per_sec": 0 00:23:10.241 }, 00:23:10.241 "claimed": false, 00:23:10.241 "zoned": false, 00:23:10.241 "supported_io_types": { 00:23:10.241 "read": true, 00:23:10.241 "write": true, 00:23:10.241 "unmap": false, 00:23:10.241 "write_zeroes": true, 00:23:10.241 "flush": true, 00:23:10.241 "reset": true, 00:23:10.241 "compare": true, 00:23:10.241 "compare_and_write": true, 00:23:10.241 "abort": true, 00:23:10.241 "nvme_admin": true, 00:23:10.241 "nvme_io": true 00:23:10.241 }, 00:23:10.241 "driver_specific": { 00:23:10.241 "nvme": [ 00:23:10.241 { 00:23:10.241 "trid": { 00:23:10.241 "trtype": "TCP", 00:23:10.241 "adrfam": "IPv4", 00:23:10.241 "traddr": "10.0.0.2", 00:23:10.241 "trsvcid": "4421", 00:23:10.241 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:10.241 }, 00:23:10.241 "ctrlr_data": { 00:23:10.241 "cntlid": 3, 00:23:10.241 "vendor_id": "0x8086", 00:23:10.241 "model_number": "SPDK bdev Controller", 00:23:10.241 "serial_number": "00000000000000000000", 00:23:10.241 "firmware_revision": "24.01.1", 00:23:10.241 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:10.241 "oacs": { 00:23:10.241 "security": 0, 00:23:10.241 "format": 0, 00:23:10.241 "firmware": 0, 00:23:10.241 "ns_manage": 0 00:23:10.241 }, 00:23:10.241 "multi_ctrlr": true, 00:23:10.241 "ana_reporting": false 00:23:10.241 }, 00:23:10.241 "vs": { 00:23:10.241 "nvme_version": "1.3" 00:23:10.241 }, 00:23:10.241 "ns_data": { 00:23:10.241 "id": 1, 00:23:10.241 "can_share": true 00:23:10.241 } 00:23:10.241 } 00:23:10.241 ], 00:23:10.241 "mp_policy": "active_passive" 00:23:10.241 } 00:23:10.241 } 00:23:10.241 ] 00:23:10.241 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.241 04:29:47 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:10.241 04:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.241 04:29:47 -- common/autotest_common.sh@10 -- # set +x 00:23:10.241 04:29:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.241 04:29:47 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.PEgP7rXDLi 00:23:10.241 04:29:47 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:10.241 04:29:47 -- host/async_init.sh@78 -- # nvmftestfini 00:23:10.241 04:29:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:10.241 04:29:47 -- nvmf/common.sh@116 -- # sync 00:23:10.241 04:29:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:10.241 04:29:47 -- nvmf/common.sh@119 -- # set +e 00:23:10.241 04:29:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:10.241 04:29:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:10.241 rmmod nvme_tcp 00:23:10.241 rmmod nvme_fabrics 00:23:10.241 rmmod nvme_keyring 00:23:10.241 04:29:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:10.241 04:29:47 -- nvmf/common.sh@123 -- # set -e 00:23:10.241 04:29:47 -- nvmf/common.sh@124 -- # return 0 00:23:10.241 04:29:47 -- nvmf/common.sh@477 -- # '[' -n 3969905 ']' 00:23:10.241 04:29:47 -- nvmf/common.sh@478 -- # killprocess 3969905 00:23:10.241 04:29:47 -- common/autotest_common.sh@936 -- # '[' -z 3969905 ']' 00:23:10.241 04:29:47 -- common/autotest_common.sh@940 -- # kill -0 3969905 00:23:10.241 04:29:47 -- common/autotest_common.sh@941 -- # uname 00:23:10.241 04:29:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:10.241 04:29:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3969905 00:23:10.500 04:29:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:10.500 04:29:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:10.500 04:29:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3969905' 00:23:10.500 killing process with pid 3969905 00:23:10.500 04:29:47 -- common/autotest_common.sh@955 -- # kill 3969905 00:23:10.500 04:29:47 -- common/autotest_common.sh@960 -- # wait 3969905 00:23:10.500 04:29:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:10.500 04:29:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:10.500 04:29:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:10.500 04:29:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:10.500 04:29:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:10.500 04:29:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:10.500 04:29:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:10.500 04:29:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.030 04:29:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:13.030 00:23:13.031 real 0m6.379s 00:23:13.031 user 0m3.149s 00:23:13.031 sys 0m1.892s 00:23:13.031 04:29:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:13.031 04:29:49 -- common/autotest_common.sh@10 -- # set +x 00:23:13.031 ************************************ 00:23:13.031 END TEST nvmf_async_init 00:23:13.031 ************************************ 00:23:13.031 04:29:49 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:13.031 04:29:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:13.031 04:29:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:13.031 04:29:49 -- common/autotest_common.sh@10 -- # set +x 00:23:13.031 ************************************ 00:23:13.031 START TEST dma 00:23:13.031 ************************************ 00:23:13.031 04:29:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:13.031 * Looking for test storage... 00:23:13.031 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:13.031 04:29:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:13.031 04:29:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:13.031 04:29:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:13.031 04:29:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:13.031 04:29:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:13.031 04:29:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:13.031 04:29:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:13.031 04:29:50 -- scripts/common.sh@335 -- # IFS=.-: 00:23:13.031 04:29:50 -- scripts/common.sh@335 -- # read -ra ver1 00:23:13.031 04:29:50 -- scripts/common.sh@336 -- # IFS=.-: 00:23:13.031 04:29:50 -- scripts/common.sh@336 -- # read -ra ver2 00:23:13.031 04:29:50 -- scripts/common.sh@337 -- # local 'op=<' 00:23:13.031 04:29:50 -- scripts/common.sh@339 -- # ver1_l=2 00:23:13.031 04:29:50 -- scripts/common.sh@340 -- # ver2_l=1 00:23:13.031 04:29:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:13.031 04:29:50 -- scripts/common.sh@343 -- # case "$op" in 00:23:13.031 04:29:50 -- scripts/common.sh@344 -- # : 1 00:23:13.031 04:29:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:13.031 04:29:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:13.031 04:29:50 -- scripts/common.sh@364 -- # decimal 1 00:23:13.031 04:29:50 -- scripts/common.sh@352 -- # local d=1 00:23:13.031 04:29:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:13.031 04:29:50 -- scripts/common.sh@354 -- # echo 1 00:23:13.031 04:29:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:13.031 04:29:50 -- scripts/common.sh@365 -- # decimal 2 00:23:13.031 04:29:50 -- scripts/common.sh@352 -- # local d=2 00:23:13.031 04:29:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:13.031 04:29:50 -- scripts/common.sh@354 -- # echo 2 00:23:13.031 04:29:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:13.031 04:29:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:13.031 04:29:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:13.031 04:29:50 -- scripts/common.sh@367 -- # return 0 00:23:13.031 04:29:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:13.031 04:29:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:13.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.031 --rc genhtml_branch_coverage=1 00:23:13.031 --rc genhtml_function_coverage=1 00:23:13.031 --rc genhtml_legend=1 00:23:13.031 --rc geninfo_all_blocks=1 00:23:13.031 --rc geninfo_unexecuted_blocks=1 00:23:13.031 00:23:13.031 ' 00:23:13.031 04:29:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:13.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.031 --rc genhtml_branch_coverage=1 00:23:13.031 --rc genhtml_function_coverage=1 00:23:13.031 --rc genhtml_legend=1 00:23:13.031 --rc geninfo_all_blocks=1 00:23:13.031 --rc geninfo_unexecuted_blocks=1 00:23:13.031 00:23:13.031 ' 00:23:13.031 04:29:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:13.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.031 --rc genhtml_branch_coverage=1 00:23:13.031 --rc genhtml_function_coverage=1 00:23:13.031 --rc genhtml_legend=1 00:23:13.031 --rc geninfo_all_blocks=1 00:23:13.031 --rc geninfo_unexecuted_blocks=1 00:23:13.031 00:23:13.031 ' 00:23:13.031 04:29:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:13.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.031 --rc genhtml_branch_coverage=1 00:23:13.031 --rc genhtml_function_coverage=1 00:23:13.031 --rc genhtml_legend=1 00:23:13.031 --rc geninfo_all_blocks=1 00:23:13.031 --rc geninfo_unexecuted_blocks=1 00:23:13.031 00:23:13.031 ' 00:23:13.031 04:29:50 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:13.031 04:29:50 -- nvmf/common.sh@7 -- # uname -s 00:23:13.031 04:29:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:13.031 04:29:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:13.031 04:29:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:13.031 04:29:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:13.031 04:29:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:13.031 04:29:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:13.031 04:29:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:13.031 04:29:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:13.031 04:29:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:13.031 04:29:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:13.031 04:29:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.031 04:29:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.031 04:29:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:13.031 04:29:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:13.031 04:29:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:13.031 04:29:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:13.031 04:29:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:13.031 04:29:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:13.031 04:29:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:13.031 04:29:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.031 04:29:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.031 04:29:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.031 04:29:50 -- paths/export.sh@5 -- # export PATH 00:23:13.031 04:29:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.031 04:29:50 -- nvmf/common.sh@46 -- # : 0 00:23:13.031 04:29:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:13.031 04:29:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:13.031 04:29:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:13.031 04:29:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:13.031 04:29:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:13.031 04:29:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:13.031 04:29:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:13.031 04:29:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:13.031 04:29:50 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:13.031 04:29:50 -- host/dma.sh@13 -- # exit 0 00:23:13.031 00:23:13.031 real 0m0.154s 00:23:13.031 user 0m0.108s 00:23:13.031 sys 0m0.056s 00:23:13.031 04:29:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:13.031 04:29:50 -- common/autotest_common.sh@10 -- # set +x 00:23:13.031 ************************************ 00:23:13.031 END TEST dma 00:23:13.031 ************************************ 00:23:13.031 04:29:50 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:13.031 04:29:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:13.031 04:29:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:13.031 04:29:50 -- common/autotest_common.sh@10 -- # set +x 00:23:13.031 ************************************ 00:23:13.031 START TEST nvmf_identify 00:23:13.031 ************************************ 00:23:13.031 04:29:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:13.031 * Looking for test storage... 00:23:13.031 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:13.031 04:29:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:13.031 04:29:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:13.031 04:29:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:13.031 04:29:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:13.031 04:29:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:13.031 04:29:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:13.032 04:29:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:13.032 04:29:50 -- scripts/common.sh@335 -- # IFS=.-: 00:23:13.032 04:29:50 -- scripts/common.sh@335 -- # read -ra ver1 00:23:13.032 04:29:50 -- scripts/common.sh@336 -- # IFS=.-: 00:23:13.032 04:29:50 -- scripts/common.sh@336 -- # read -ra ver2 00:23:13.032 04:29:50 -- scripts/common.sh@337 -- # local 'op=<' 00:23:13.032 04:29:50 -- scripts/common.sh@339 -- # ver1_l=2 00:23:13.032 04:29:50 -- scripts/common.sh@340 -- # ver2_l=1 00:23:13.032 04:29:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:13.032 04:29:50 -- scripts/common.sh@343 -- # case "$op" in 00:23:13.032 04:29:50 -- scripts/common.sh@344 -- # : 1 00:23:13.032 04:29:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:13.032 04:29:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:13.032 04:29:50 -- scripts/common.sh@364 -- # decimal 1 00:23:13.032 04:29:50 -- scripts/common.sh@352 -- # local d=1 00:23:13.032 04:29:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:13.032 04:29:50 -- scripts/common.sh@354 -- # echo 1 00:23:13.032 04:29:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:13.032 04:29:50 -- scripts/common.sh@365 -- # decimal 2 00:23:13.032 04:29:50 -- scripts/common.sh@352 -- # local d=2 00:23:13.032 04:29:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:13.032 04:29:50 -- scripts/common.sh@354 -- # echo 2 00:23:13.032 04:29:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:13.032 04:29:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:13.032 04:29:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:13.032 04:29:50 -- scripts/common.sh@367 -- # return 0 00:23:13.032 04:29:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:13.032 04:29:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:13.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.032 --rc genhtml_branch_coverage=1 00:23:13.032 --rc genhtml_function_coverage=1 00:23:13.032 --rc genhtml_legend=1 00:23:13.032 --rc geninfo_all_blocks=1 00:23:13.032 --rc geninfo_unexecuted_blocks=1 00:23:13.032 00:23:13.032 ' 00:23:13.032 04:29:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:13.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.032 --rc genhtml_branch_coverage=1 00:23:13.032 --rc genhtml_function_coverage=1 00:23:13.032 --rc genhtml_legend=1 00:23:13.032 --rc geninfo_all_blocks=1 00:23:13.032 --rc geninfo_unexecuted_blocks=1 00:23:13.032 00:23:13.032 ' 00:23:13.032 04:29:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:13.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.032 --rc genhtml_branch_coverage=1 00:23:13.032 --rc genhtml_function_coverage=1 00:23:13.032 --rc genhtml_legend=1 00:23:13.032 --rc geninfo_all_blocks=1 00:23:13.032 --rc geninfo_unexecuted_blocks=1 00:23:13.032 00:23:13.032 ' 00:23:13.032 04:29:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:13.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.032 --rc genhtml_branch_coverage=1 00:23:13.032 --rc genhtml_function_coverage=1 00:23:13.032 --rc genhtml_legend=1 00:23:13.032 --rc geninfo_all_blocks=1 00:23:13.032 --rc geninfo_unexecuted_blocks=1 00:23:13.032 00:23:13.032 ' 00:23:13.032 04:29:50 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:13.032 04:29:50 -- nvmf/common.sh@7 -- # uname -s 00:23:13.032 04:29:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:13.032 04:29:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:13.032 04:29:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:13.032 04:29:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:13.032 04:29:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:13.032 04:29:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:13.032 04:29:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:13.032 04:29:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:13.032 04:29:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:13.032 04:29:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:13.032 04:29:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.032 04:29:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.032 04:29:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:13.032 04:29:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:13.032 04:29:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:13.032 04:29:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:13.032 04:29:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:13.032 04:29:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:13.032 04:29:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:13.032 04:29:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.032 04:29:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.032 04:29:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.032 04:29:50 -- paths/export.sh@5 -- # export PATH 00:23:13.032 04:29:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.032 04:29:50 -- nvmf/common.sh@46 -- # : 0 00:23:13.032 04:29:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:13.032 04:29:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:13.032 04:29:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:13.032 04:29:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:13.032 04:29:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:13.032 04:29:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:13.032 04:29:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:13.032 04:29:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:13.032 04:29:50 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:13.032 04:29:50 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:13.032 04:29:50 -- host/identify.sh@14 -- # nvmftestinit 00:23:13.032 04:29:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:13.032 04:29:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:13.032 04:29:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:13.032 04:29:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:13.032 04:29:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:13.032 04:29:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.032 04:29:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.032 04:29:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.032 04:29:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:13.032 04:29:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:13.032 04:29:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:13.032 04:29:50 -- common/autotest_common.sh@10 -- # set +x 00:23:15.561 04:29:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:15.561 04:29:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:15.561 04:29:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:15.561 04:29:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:15.561 04:29:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:15.561 04:29:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:15.561 04:29:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:15.561 04:29:52 -- nvmf/common.sh@294 -- # net_devs=() 00:23:15.561 04:29:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:15.561 04:29:52 -- nvmf/common.sh@295 -- # e810=() 00:23:15.561 04:29:52 -- nvmf/common.sh@295 -- # local -ga e810 00:23:15.561 04:29:52 -- nvmf/common.sh@296 -- # x722=() 00:23:15.561 04:29:52 -- nvmf/common.sh@296 -- # local -ga x722 00:23:15.561 04:29:52 -- nvmf/common.sh@297 -- # mlx=() 00:23:15.561 04:29:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:15.561 04:29:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:15.561 04:29:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:15.561 04:29:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:15.561 04:29:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:15.562 04:29:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:15.562 04:29:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.562 04:29:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:15.562 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:15.562 04:29:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.562 04:29:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:15.562 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:15.562 04:29:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:15.562 04:29:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.562 04:29:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.562 04:29:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.562 04:29:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.562 04:29:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:15.562 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:15.562 04:29:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.562 04:29:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.562 04:29:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.562 04:29:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.562 04:29:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.562 04:29:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:15.562 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:15.562 04:29:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.562 04:29:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:15.562 04:29:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:15.562 04:29:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:15.562 04:29:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:15.562 04:29:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:15.562 04:29:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:15.562 04:29:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:15.562 04:29:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:15.562 04:29:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:15.562 04:29:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:15.562 04:29:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:15.562 04:29:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:15.562 04:29:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:15.562 04:29:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:15.562 04:29:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:15.562 04:29:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:15.562 04:29:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:15.562 04:29:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:15.562 04:29:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:15.562 04:29:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:15.562 04:29:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:15.562 04:29:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:15.562 04:29:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:15.562 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:15.562 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:23:15.562 00:23:15.562 --- 10.0.0.2 ping statistics --- 00:23:15.562 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.562 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:23:15.562 04:29:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:15.562 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:15.562 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:23:15.562 00:23:15.562 --- 10.0.0.1 ping statistics --- 00:23:15.562 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.562 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:23:15.562 04:29:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:15.562 04:29:52 -- nvmf/common.sh@410 -- # return 0 00:23:15.562 04:29:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:15.562 04:29:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:15.562 04:29:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:15.562 04:29:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:15.562 04:29:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:15.562 04:29:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:15.562 04:29:52 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:15.562 04:29:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:15.562 04:29:52 -- common/autotest_common.sh@10 -- # set +x 00:23:15.562 04:29:52 -- host/identify.sh@19 -- # nvmfpid=3972192 00:23:15.562 04:29:52 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:15.562 04:29:52 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:15.562 04:29:52 -- host/identify.sh@23 -- # waitforlisten 3972192 00:23:15.562 04:29:52 -- common/autotest_common.sh@829 -- # '[' -z 3972192 ']' 00:23:15.562 04:29:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:15.562 04:29:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:15.562 04:29:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:15.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:15.562 04:29:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:15.562 04:29:52 -- common/autotest_common.sh@10 -- # set +x 00:23:15.562 [2024-11-28 04:29:52.512507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:15.562 [2024-11-28 04:29:52.512612] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:15.562 EAL: No free 2048 kB hugepages reported on node 1 00:23:15.562 [2024-11-28 04:29:52.581213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:15.562 [2024-11-28 04:29:52.698374] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:15.562 [2024-11-28 04:29:52.698553] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:15.562 [2024-11-28 04:29:52.698574] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:15.562 [2024-11-28 04:29:52.698589] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:15.562 [2024-11-28 04:29:52.698649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:15.562 [2024-11-28 04:29:52.698707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:15.562 [2024-11-28 04:29:52.698834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:15.562 [2024-11-28 04:29:52.698837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:16.495 04:29:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:16.495 04:29:53 -- common/autotest_common.sh@862 -- # return 0 00:23:16.495 04:29:53 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:16.495 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 [2024-11-28 04:29:53.472957] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:16.495 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.495 04:29:53 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:16.495 04:29:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 04:29:53 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:16.495 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 Malloc0 00:23:16.495 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.495 04:29:53 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:16.495 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.495 04:29:53 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:16.495 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.495 04:29:53 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:16.495 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 [2024-11-28 04:29:53.550138] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:16.495 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.495 04:29:53 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:16.495 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.495 04:29:53 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:16.495 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.495 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.495 [2024-11-28 04:29:53.565895] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:16.495 [ 00:23:16.495 { 00:23:16.495 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:16.495 "subtype": "Discovery", 00:23:16.495 "listen_addresses": [ 00:23:16.495 { 00:23:16.495 "transport": "TCP", 00:23:16.495 "trtype": "TCP", 00:23:16.495 "adrfam": "IPv4", 00:23:16.495 "traddr": "10.0.0.2", 00:23:16.495 "trsvcid": "4420" 00:23:16.495 } 00:23:16.495 ], 00:23:16.495 "allow_any_host": true, 00:23:16.495 "hosts": [] 00:23:16.495 }, 00:23:16.495 { 00:23:16.495 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:16.495 "subtype": "NVMe", 00:23:16.495 "listen_addresses": [ 00:23:16.495 { 00:23:16.495 "transport": "TCP", 00:23:16.495 "trtype": "TCP", 00:23:16.496 "adrfam": "IPv4", 00:23:16.496 "traddr": "10.0.0.2", 00:23:16.496 "trsvcid": "4420" 00:23:16.496 } 00:23:16.496 ], 00:23:16.496 "allow_any_host": true, 00:23:16.496 "hosts": [], 00:23:16.496 "serial_number": "SPDK00000000000001", 00:23:16.496 "model_number": "SPDK bdev Controller", 00:23:16.496 "max_namespaces": 32, 00:23:16.496 "min_cntlid": 1, 00:23:16.496 "max_cntlid": 65519, 00:23:16.496 "namespaces": [ 00:23:16.496 { 00:23:16.496 "nsid": 1, 00:23:16.496 "bdev_name": "Malloc0", 00:23:16.496 "name": "Malloc0", 00:23:16.496 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:16.496 "eui64": "ABCDEF0123456789", 00:23:16.496 "uuid": "12bef709-0d12-46c6-9004-96ea54b589eb" 00:23:16.496 } 00:23:16.496 ] 00:23:16.496 } 00:23:16.496 ] 00:23:16.496 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.496 04:29:53 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:16.496 [2024-11-28 04:29:53.592776] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:16.496 [2024-11-28 04:29:53.592817] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3972353 ] 00:23:16.496 EAL: No free 2048 kB hugepages reported on node 1 00:23:16.496 [2024-11-28 04:29:53.623937] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:16.496 [2024-11-28 04:29:53.624001] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:16.496 [2024-11-28 04:29:53.624011] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:16.496 [2024-11-28 04:29:53.624030] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:16.496 [2024-11-28 04:29:53.624044] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:16.496 [2024-11-28 04:29:53.627580] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:16.496 [2024-11-28 04:29:53.627650] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1b18e10 0 00:23:16.496 [2024-11-28 04:29:53.635542] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:16.496 [2024-11-28 04:29:53.635564] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:16.496 [2024-11-28 04:29:53.635577] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:16.496 [2024-11-28 04:29:53.635584] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:16.496 [2024-11-28 04:29:53.635639] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.635652] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.635660] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.496 [2024-11-28 04:29:53.635681] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:16.496 [2024-11-28 04:29:53.635708] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.496 [2024-11-28 04:29:53.643538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.496 [2024-11-28 04:29:53.643556] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.496 [2024-11-28 04:29:53.643564] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.643573] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.496 [2024-11-28 04:29:53.643591] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:16.496 [2024-11-28 04:29:53.643602] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:16.496 [2024-11-28 04:29:53.643612] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:16.496 [2024-11-28 04:29:53.643632] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.643640] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.643647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.496 [2024-11-28 04:29:53.643658] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.496 [2024-11-28 04:29:53.643682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.496 [2024-11-28 04:29:53.643830] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.496 [2024-11-28 04:29:53.643842] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.496 [2024-11-28 04:29:53.643849] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.643855] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.496 [2024-11-28 04:29:53.643867] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:16.496 [2024-11-28 04:29:53.643880] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:16.496 [2024-11-28 04:29:53.643892] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.643899] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.643905] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.496 [2024-11-28 04:29:53.643916] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.496 [2024-11-28 04:29:53.643938] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.496 [2024-11-28 04:29:53.644036] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.496 [2024-11-28 04:29:53.644051] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.496 [2024-11-28 04:29:53.644058] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644064] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.496 [2024-11-28 04:29:53.644075] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:16.496 [2024-11-28 04:29:53.644095] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:16.496 [2024-11-28 04:29:53.644107] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644121] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.496 [2024-11-28 04:29:53.644132] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.496 [2024-11-28 04:29:53.644154] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.496 [2024-11-28 04:29:53.644241] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.496 [2024-11-28 04:29:53.644253] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.496 [2024-11-28 04:29:53.644260] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644266] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.496 [2024-11-28 04:29:53.644277] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:16.496 [2024-11-28 04:29:53.644294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644302] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644309] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.496 [2024-11-28 04:29:53.644319] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.496 [2024-11-28 04:29:53.644340] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.496 [2024-11-28 04:29:53.644429] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.496 [2024-11-28 04:29:53.644444] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.496 [2024-11-28 04:29:53.644451] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644458] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.496 [2024-11-28 04:29:53.644468] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:16.496 [2024-11-28 04:29:53.644477] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:16.496 [2024-11-28 04:29:53.644490] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:16.496 [2024-11-28 04:29:53.644600] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:16.496 [2024-11-28 04:29:53.644610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:16.496 [2024-11-28 04:29:53.644627] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644641] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.496 [2024-11-28 04:29:53.644651] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.496 [2024-11-28 04:29:53.644689] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.496 [2024-11-28 04:29:53.644865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.496 [2024-11-28 04:29:53.644878] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.496 [2024-11-28 04:29:53.644885] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644895] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.496 [2024-11-28 04:29:53.644907] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:16.496 [2024-11-28 04:29:53.644923] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644931] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.496 [2024-11-28 04:29:53.644937] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.496 [2024-11-28 04:29:53.644948] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.497 [2024-11-28 04:29:53.644969] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.497 [2024-11-28 04:29:53.645056] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.497 [2024-11-28 04:29:53.645068] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.497 [2024-11-28 04:29:53.645075] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645081] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.497 [2024-11-28 04:29:53.645091] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:16.497 [2024-11-28 04:29:53.645099] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:16.497 [2024-11-28 04:29:53.645112] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:16.497 [2024-11-28 04:29:53.645132] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:16.497 [2024-11-28 04:29:53.645149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.645173] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.497 [2024-11-28 04:29:53.645195] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.497 [2024-11-28 04:29:53.645325] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.497 [2024-11-28 04:29:53.645338] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.497 [2024-11-28 04:29:53.645345] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645352] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b18e10): datao=0, datal=4096, cccid=0 00:23:16.497 [2024-11-28 04:29:53.645360] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b98b30) on tqpair(0x1b18e10): expected_datao=0, payload_size=4096 00:23:16.497 [2024-11-28 04:29:53.645373] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645383] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645395] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.497 [2024-11-28 04:29:53.645405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.497 [2024-11-28 04:29:53.645411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.497 [2024-11-28 04:29:53.645432] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:16.497 [2024-11-28 04:29:53.645442] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:16.497 [2024-11-28 04:29:53.645454] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:16.497 [2024-11-28 04:29:53.645463] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:16.497 [2024-11-28 04:29:53.645471] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:16.497 [2024-11-28 04:29:53.645479] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:16.497 [2024-11-28 04:29:53.645498] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:16.497 [2024-11-28 04:29:53.645512] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645535] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.645547] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:16.497 [2024-11-28 04:29:53.645570] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.497 [2024-11-28 04:29:53.645671] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.497 [2024-11-28 04:29:53.645683] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.497 [2024-11-28 04:29:53.645690] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645696] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98b30) on tqpair=0x1b18e10 00:23:16.497 [2024-11-28 04:29:53.645712] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645726] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.645736] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.497 [2024-11-28 04:29:53.645746] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645753] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645759] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.645768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.497 [2024-11-28 04:29:53.645778] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645785] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645791] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.645800] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.497 [2024-11-28 04:29:53.645810] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.645831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.497 [2024-11-28 04:29:53.645840] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:16.497 [2024-11-28 04:29:53.645860] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:16.497 [2024-11-28 04:29:53.645891] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645899] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.645905] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.645915] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.497 [2024-11-28 04:29:53.645953] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98b30, cid 0, qid 0 00:23:16.497 [2024-11-28 04:29:53.645964] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98c90, cid 1, qid 0 00:23:16.497 [2024-11-28 04:29:53.645971] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98df0, cid 2, qid 0 00:23:16.497 [2024-11-28 04:29:53.645978] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98f50, cid 3, qid 0 00:23:16.497 [2024-11-28 04:29:53.645985] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b990b0, cid 4, qid 0 00:23:16.497 [2024-11-28 04:29:53.646191] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.497 [2024-11-28 04:29:53.646204] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.497 [2024-11-28 04:29:53.646210] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.646217] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b990b0) on tqpair=0x1b18e10 00:23:16.497 [2024-11-28 04:29:53.646228] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:16.497 [2024-11-28 04:29:53.646236] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:16.497 [2024-11-28 04:29:53.646253] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.646262] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.646269] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.646279] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.497 [2024-11-28 04:29:53.646300] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b990b0, cid 4, qid 0 00:23:16.497 [2024-11-28 04:29:53.646436] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.497 [2024-11-28 04:29:53.646448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.497 [2024-11-28 04:29:53.646455] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.646461] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b18e10): datao=0, datal=4096, cccid=4 00:23:16.497 [2024-11-28 04:29:53.646469] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b990b0) on tqpair(0x1b18e10): expected_datao=0, payload_size=4096 00:23:16.497 [2024-11-28 04:29:53.646485] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.646494] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.690537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.497 [2024-11-28 04:29:53.690555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.497 [2024-11-28 04:29:53.690562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.690569] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b990b0) on tqpair=0x1b18e10 00:23:16.497 [2024-11-28 04:29:53.690590] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:16.497 [2024-11-28 04:29:53.690643] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.690653] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.690660] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.690674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.497 [2024-11-28 04:29:53.690687] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.690694] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.497 [2024-11-28 04:29:53.690700] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1b18e10) 00:23:16.497 [2024-11-28 04:29:53.690709] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.498 [2024-11-28 04:29:53.690738] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b990b0, cid 4, qid 0 00:23:16.498 [2024-11-28 04:29:53.690765] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b99210, cid 5, qid 0 00:23:16.498 [2024-11-28 04:29:53.690923] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.498 [2024-11-28 04:29:53.690937] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.498 [2024-11-28 04:29:53.690944] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.690950] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b18e10): datao=0, datal=1024, cccid=4 00:23:16.498 [2024-11-28 04:29:53.690958] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b990b0) on tqpair(0x1b18e10): expected_datao=0, payload_size=1024 00:23:16.498 [2024-11-28 04:29:53.690968] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.690976] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.690985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.498 [2024-11-28 04:29:53.690993] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.498 [2024-11-28 04:29:53.691000] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.691006] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b99210) on tqpair=0x1b18e10 00:23:16.498 [2024-11-28 04:29:53.732690] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.498 [2024-11-28 04:29:53.732708] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.498 [2024-11-28 04:29:53.732716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.732723] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b990b0) on tqpair=0x1b18e10 00:23:16.498 [2024-11-28 04:29:53.732743] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.732751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.732758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b18e10) 00:23:16.498 [2024-11-28 04:29:53.732769] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.498 [2024-11-28 04:29:53.732800] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b990b0, cid 4, qid 0 00:23:16.498 [2024-11-28 04:29:53.732995] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.498 [2024-11-28 04:29:53.733008] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.498 [2024-11-28 04:29:53.733014] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733021] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b18e10): datao=0, datal=3072, cccid=4 00:23:16.498 [2024-11-28 04:29:53.733028] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b990b0) on tqpair(0x1b18e10): expected_datao=0, payload_size=3072 00:23:16.498 [2024-11-28 04:29:53.733039] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733047] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733058] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.498 [2024-11-28 04:29:53.733068] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.498 [2024-11-28 04:29:53.733079] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733087] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b990b0) on tqpair=0x1b18e10 00:23:16.498 [2024-11-28 04:29:53.733103] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733111] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733118] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1b18e10) 00:23:16.498 [2024-11-28 04:29:53.733128] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.498 [2024-11-28 04:29:53.733157] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b990b0, cid 4, qid 0 00:23:16.498 [2024-11-28 04:29:53.733265] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.498 [2024-11-28 04:29:53.733278] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.498 [2024-11-28 04:29:53.733285] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733291] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1b18e10): datao=0, datal=8, cccid=4 00:23:16.498 [2024-11-28 04:29:53.733298] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b990b0) on tqpair(0x1b18e10): expected_datao=0, payload_size=8 00:23:16.498 [2024-11-28 04:29:53.733308] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.733316] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.773633] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.498 [2024-11-28 04:29:53.773651] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.498 [2024-11-28 04:29:53.773659] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.498 [2024-11-28 04:29:53.773666] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b990b0) on tqpair=0x1b18e10 00:23:16.498 ===================================================== 00:23:16.498 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:16.498 ===================================================== 00:23:16.498 Controller Capabilities/Features 00:23:16.498 ================================ 00:23:16.498 Vendor ID: 0000 00:23:16.498 Subsystem Vendor ID: 0000 00:23:16.498 Serial Number: .................... 00:23:16.498 Model Number: ........................................ 00:23:16.498 Firmware Version: 24.01.1 00:23:16.498 Recommended Arb Burst: 0 00:23:16.498 IEEE OUI Identifier: 00 00 00 00:23:16.498 Multi-path I/O 00:23:16.498 May have multiple subsystem ports: No 00:23:16.498 May have multiple controllers: No 00:23:16.498 Associated with SR-IOV VF: No 00:23:16.498 Max Data Transfer Size: 131072 00:23:16.498 Max Number of Namespaces: 0 00:23:16.498 Max Number of I/O Queues: 1024 00:23:16.498 NVMe Specification Version (VS): 1.3 00:23:16.498 NVMe Specification Version (Identify): 1.3 00:23:16.498 Maximum Queue Entries: 128 00:23:16.498 Contiguous Queues Required: Yes 00:23:16.498 Arbitration Mechanisms Supported 00:23:16.498 Weighted Round Robin: Not Supported 00:23:16.498 Vendor Specific: Not Supported 00:23:16.498 Reset Timeout: 15000 ms 00:23:16.498 Doorbell Stride: 4 bytes 00:23:16.498 NVM Subsystem Reset: Not Supported 00:23:16.498 Command Sets Supported 00:23:16.498 NVM Command Set: Supported 00:23:16.498 Boot Partition: Not Supported 00:23:16.498 Memory Page Size Minimum: 4096 bytes 00:23:16.498 Memory Page Size Maximum: 4096 bytes 00:23:16.498 Persistent Memory Region: Not Supported 00:23:16.498 Optional Asynchronous Events Supported 00:23:16.498 Namespace Attribute Notices: Not Supported 00:23:16.498 Firmware Activation Notices: Not Supported 00:23:16.498 ANA Change Notices: Not Supported 00:23:16.498 PLE Aggregate Log Change Notices: Not Supported 00:23:16.498 LBA Status Info Alert Notices: Not Supported 00:23:16.498 EGE Aggregate Log Change Notices: Not Supported 00:23:16.498 Normal NVM Subsystem Shutdown event: Not Supported 00:23:16.498 Zone Descriptor Change Notices: Not Supported 00:23:16.498 Discovery Log Change Notices: Supported 00:23:16.498 Controller Attributes 00:23:16.498 128-bit Host Identifier: Not Supported 00:23:16.498 Non-Operational Permissive Mode: Not Supported 00:23:16.498 NVM Sets: Not Supported 00:23:16.498 Read Recovery Levels: Not Supported 00:23:16.498 Endurance Groups: Not Supported 00:23:16.498 Predictable Latency Mode: Not Supported 00:23:16.498 Traffic Based Keep ALive: Not Supported 00:23:16.498 Namespace Granularity: Not Supported 00:23:16.498 SQ Associations: Not Supported 00:23:16.498 UUID List: Not Supported 00:23:16.498 Multi-Domain Subsystem: Not Supported 00:23:16.498 Fixed Capacity Management: Not Supported 00:23:16.498 Variable Capacity Management: Not Supported 00:23:16.498 Delete Endurance Group: Not Supported 00:23:16.498 Delete NVM Set: Not Supported 00:23:16.498 Extended LBA Formats Supported: Not Supported 00:23:16.498 Flexible Data Placement Supported: Not Supported 00:23:16.498 00:23:16.498 Controller Memory Buffer Support 00:23:16.498 ================================ 00:23:16.498 Supported: No 00:23:16.498 00:23:16.498 Persistent Memory Region Support 00:23:16.498 ================================ 00:23:16.498 Supported: No 00:23:16.498 00:23:16.498 Admin Command Set Attributes 00:23:16.498 ============================ 00:23:16.498 Security Send/Receive: Not Supported 00:23:16.498 Format NVM: Not Supported 00:23:16.498 Firmware Activate/Download: Not Supported 00:23:16.498 Namespace Management: Not Supported 00:23:16.498 Device Self-Test: Not Supported 00:23:16.498 Directives: Not Supported 00:23:16.498 NVMe-MI: Not Supported 00:23:16.498 Virtualization Management: Not Supported 00:23:16.498 Doorbell Buffer Config: Not Supported 00:23:16.498 Get LBA Status Capability: Not Supported 00:23:16.498 Command & Feature Lockdown Capability: Not Supported 00:23:16.498 Abort Command Limit: 1 00:23:16.498 Async Event Request Limit: 4 00:23:16.498 Number of Firmware Slots: N/A 00:23:16.498 Firmware Slot 1 Read-Only: N/A 00:23:16.498 Firmware Activation Without Reset: N/A 00:23:16.498 Multiple Update Detection Support: N/A 00:23:16.498 Firmware Update Granularity: No Information Provided 00:23:16.498 Per-Namespace SMART Log: No 00:23:16.498 Asymmetric Namespace Access Log Page: Not Supported 00:23:16.498 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:16.498 Command Effects Log Page: Not Supported 00:23:16.498 Get Log Page Extended Data: Supported 00:23:16.498 Telemetry Log Pages: Not Supported 00:23:16.498 Persistent Event Log Pages: Not Supported 00:23:16.498 Supported Log Pages Log Page: May Support 00:23:16.499 Commands Supported & Effects Log Page: Not Supported 00:23:16.499 Feature Identifiers & Effects Log Page:May Support 00:23:16.499 NVMe-MI Commands & Effects Log Page: May Support 00:23:16.499 Data Area 4 for Telemetry Log: Not Supported 00:23:16.499 Error Log Page Entries Supported: 128 00:23:16.499 Keep Alive: Not Supported 00:23:16.499 00:23:16.499 NVM Command Set Attributes 00:23:16.499 ========================== 00:23:16.499 Submission Queue Entry Size 00:23:16.499 Max: 1 00:23:16.499 Min: 1 00:23:16.499 Completion Queue Entry Size 00:23:16.499 Max: 1 00:23:16.499 Min: 1 00:23:16.499 Number of Namespaces: 0 00:23:16.499 Compare Command: Not Supported 00:23:16.499 Write Uncorrectable Command: Not Supported 00:23:16.499 Dataset Management Command: Not Supported 00:23:16.499 Write Zeroes Command: Not Supported 00:23:16.499 Set Features Save Field: Not Supported 00:23:16.499 Reservations: Not Supported 00:23:16.499 Timestamp: Not Supported 00:23:16.499 Copy: Not Supported 00:23:16.499 Volatile Write Cache: Not Present 00:23:16.499 Atomic Write Unit (Normal): 1 00:23:16.499 Atomic Write Unit (PFail): 1 00:23:16.499 Atomic Compare & Write Unit: 1 00:23:16.499 Fused Compare & Write: Supported 00:23:16.499 Scatter-Gather List 00:23:16.499 SGL Command Set: Supported 00:23:16.499 SGL Keyed: Supported 00:23:16.499 SGL Bit Bucket Descriptor: Not Supported 00:23:16.499 SGL Metadata Pointer: Not Supported 00:23:16.499 Oversized SGL: Not Supported 00:23:16.499 SGL Metadata Address: Not Supported 00:23:16.499 SGL Offset: Supported 00:23:16.499 Transport SGL Data Block: Not Supported 00:23:16.499 Replay Protected Memory Block: Not Supported 00:23:16.499 00:23:16.499 Firmware Slot Information 00:23:16.499 ========================= 00:23:16.499 Active slot: 0 00:23:16.499 00:23:16.499 00:23:16.499 Error Log 00:23:16.499 ========= 00:23:16.499 00:23:16.499 Active Namespaces 00:23:16.499 ================= 00:23:16.499 Discovery Log Page 00:23:16.499 ================== 00:23:16.499 Generation Counter: 2 00:23:16.499 Number of Records: 2 00:23:16.499 Record Format: 0 00:23:16.499 00:23:16.499 Discovery Log Entry 0 00:23:16.499 ---------------------- 00:23:16.499 Transport Type: 3 (TCP) 00:23:16.499 Address Family: 1 (IPv4) 00:23:16.499 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:16.499 Entry Flags: 00:23:16.499 Duplicate Returned Information: 1 00:23:16.499 Explicit Persistent Connection Support for Discovery: 1 00:23:16.499 Transport Requirements: 00:23:16.499 Secure Channel: Not Required 00:23:16.499 Port ID: 0 (0x0000) 00:23:16.499 Controller ID: 65535 (0xffff) 00:23:16.499 Admin Max SQ Size: 128 00:23:16.499 Transport Service Identifier: 4420 00:23:16.499 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:16.499 Transport Address: 10.0.0.2 00:23:16.499 Discovery Log Entry 1 00:23:16.499 ---------------------- 00:23:16.499 Transport Type: 3 (TCP) 00:23:16.499 Address Family: 1 (IPv4) 00:23:16.499 Subsystem Type: 2 (NVM Subsystem) 00:23:16.499 Entry Flags: 00:23:16.499 Duplicate Returned Information: 0 00:23:16.499 Explicit Persistent Connection Support for Discovery: 0 00:23:16.499 Transport Requirements: 00:23:16.499 Secure Channel: Not Required 00:23:16.499 Port ID: 0 (0x0000) 00:23:16.499 Controller ID: 65535 (0xffff) 00:23:16.499 Admin Max SQ Size: 128 00:23:16.499 Transport Service Identifier: 4420 00:23:16.499 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:16.499 Transport Address: 10.0.0.2 [2024-11-28 04:29:53.773795] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:16.499 [2024-11-28 04:29:53.773823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.499 [2024-11-28 04:29:53.773836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.499 [2024-11-28 04:29:53.773846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.499 [2024-11-28 04:29:53.773855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.499 [2024-11-28 04:29:53.773870] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.773878] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.773884] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b18e10) 00:23:16.499 [2024-11-28 04:29:53.773895] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.499 [2024-11-28 04:29:53.773923] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98f50, cid 3, qid 0 00:23:16.499 [2024-11-28 04:29:53.774014] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.499 [2024-11-28 04:29:53.774029] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.499 [2024-11-28 04:29:53.774036] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.774043] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98f50) on tqpair=0x1b18e10 00:23:16.499 [2024-11-28 04:29:53.774058] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.774066] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.774072] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b18e10) 00:23:16.499 [2024-11-28 04:29:53.774087] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.499 [2024-11-28 04:29:53.774115] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98f50, cid 3, qid 0 00:23:16.499 [2024-11-28 04:29:53.774250] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.499 [2024-11-28 04:29:53.774262] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.499 [2024-11-28 04:29:53.774269] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.774276] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98f50) on tqpair=0x1b18e10 00:23:16.499 [2024-11-28 04:29:53.774287] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:16.499 [2024-11-28 04:29:53.774295] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:16.499 [2024-11-28 04:29:53.774311] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.774319] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.774326] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b18e10) 00:23:16.499 [2024-11-28 04:29:53.774336] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.499 [2024-11-28 04:29:53.774357] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98f50, cid 3, qid 0 00:23:16.499 [2024-11-28 04:29:53.774468] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.499 [2024-11-28 04:29:53.774483] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.499 [2024-11-28 04:29:53.774489] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.774496] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98f50) on tqpair=0x1b18e10 00:23:16.499 [2024-11-28 04:29:53.774515] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.778532] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.778546] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1b18e10) 00:23:16.499 [2024-11-28 04:29:53.778558] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.499 [2024-11-28 04:29:53.778582] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b98f50, cid 3, qid 0 00:23:16.499 [2024-11-28 04:29:53.778707] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.499 [2024-11-28 04:29:53.778719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.499 [2024-11-28 04:29:53.778726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.499 [2024-11-28 04:29:53.778733] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b98f50) on tqpair=0x1b18e10 00:23:16.499 [2024-11-28 04:29:53.778748] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:23:16.499 00:23:16.499 04:29:53 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:16.761 [2024-11-28 04:29:53.812911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:16.761 [2024-11-28 04:29:53.812954] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3972355 ] 00:23:16.761 EAL: No free 2048 kB hugepages reported on node 1 00:23:16.761 [2024-11-28 04:29:53.843712] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:16.761 [2024-11-28 04:29:53.843765] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:16.761 [2024-11-28 04:29:53.843775] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:16.761 [2024-11-28 04:29:53.843789] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:16.761 [2024-11-28 04:29:53.843801] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:16.761 [2024-11-28 04:29:53.847561] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:16.761 [2024-11-28 04:29:53.847608] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xc16e10 0 00:23:16.761 [2024-11-28 04:29:53.855536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:16.761 [2024-11-28 04:29:53.855555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:16.761 [2024-11-28 04:29:53.855563] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:16.761 [2024-11-28 04:29:53.855568] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:16.761 [2024-11-28 04:29:53.855606] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.855618] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.855624] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.761 [2024-11-28 04:29:53.855638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:16.761 [2024-11-28 04:29:53.855663] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.761 [2024-11-28 04:29:53.862537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.761 [2024-11-28 04:29:53.862554] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.761 [2024-11-28 04:29:53.862562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.862568] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.761 [2024-11-28 04:29:53.862586] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:16.761 [2024-11-28 04:29:53.862597] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:16.761 [2024-11-28 04:29:53.862606] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:16.761 [2024-11-28 04:29:53.862622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.862630] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.862637] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.761 [2024-11-28 04:29:53.862648] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.761 [2024-11-28 04:29:53.862670] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.761 [2024-11-28 04:29:53.862823] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.761 [2024-11-28 04:29:53.862835] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.761 [2024-11-28 04:29:53.862842] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.862848] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.761 [2024-11-28 04:29:53.862857] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:16.761 [2024-11-28 04:29:53.862869] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:16.761 [2024-11-28 04:29:53.862882] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.862893] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.862900] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.761 [2024-11-28 04:29:53.862910] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.761 [2024-11-28 04:29:53.862932] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.761 [2024-11-28 04:29:53.863038] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.761 [2024-11-28 04:29:53.863053] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.761 [2024-11-28 04:29:53.863060] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.863066] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.761 [2024-11-28 04:29:53.863075] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:16.761 [2024-11-28 04:29:53.863088] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:16.761 [2024-11-28 04:29:53.863100] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.863107] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.761 [2024-11-28 04:29:53.863113] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.761 [2024-11-28 04:29:53.863123] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.761 [2024-11-28 04:29:53.863144] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.762 [2024-11-28 04:29:53.863266] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.762 [2024-11-28 04:29:53.863278] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.762 [2024-11-28 04:29:53.863284] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863291] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.762 [2024-11-28 04:29:53.863299] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:16.762 [2024-11-28 04:29:53.863315] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863323] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863329] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.863340] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.762 [2024-11-28 04:29:53.863360] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.762 [2024-11-28 04:29:53.863457] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.762 [2024-11-28 04:29:53.863471] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.762 [2024-11-28 04:29:53.863478] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863484] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.762 [2024-11-28 04:29:53.863492] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:16.762 [2024-11-28 04:29:53.863500] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:16.762 [2024-11-28 04:29:53.863513] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:16.762 [2024-11-28 04:29:53.863622] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:16.762 [2024-11-28 04:29:53.863631] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:16.762 [2024-11-28 04:29:53.863647] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863655] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.863672] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.762 [2024-11-28 04:29:53.863693] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.762 [2024-11-28 04:29:53.863894] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.762 [2024-11-28 04:29:53.863910] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.762 [2024-11-28 04:29:53.863916] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863922] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.762 [2024-11-28 04:29:53.863931] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:16.762 [2024-11-28 04:29:53.863948] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863956] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.863962] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.863973] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.762 [2024-11-28 04:29:53.863993] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.762 [2024-11-28 04:29:53.864104] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.762 [2024-11-28 04:29:53.864116] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.762 [2024-11-28 04:29:53.864122] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864129] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.762 [2024-11-28 04:29:53.864136] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:16.762 [2024-11-28 04:29:53.864144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:16.762 [2024-11-28 04:29:53.864157] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:16.762 [2024-11-28 04:29:53.864170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:16.762 [2024-11-28 04:29:53.864184] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864191] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864197] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.864208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.762 [2024-11-28 04:29:53.864228] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.762 [2024-11-28 04:29:53.864392] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.762 [2024-11-28 04:29:53.864407] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.762 [2024-11-28 04:29:53.864413] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864420] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=4096, cccid=0 00:23:16.762 [2024-11-28 04:29:53.864427] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc96b30) on tqpair(0xc16e10): expected_datao=0, payload_size=4096 00:23:16.762 [2024-11-28 04:29:53.864442] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864450] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864462] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.762 [2024-11-28 04:29:53.864472] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.762 [2024-11-28 04:29:53.864478] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864485] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.762 [2024-11-28 04:29:53.864496] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:16.762 [2024-11-28 04:29:53.864505] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:16.762 [2024-11-28 04:29:53.864512] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:16.762 [2024-11-28 04:29:53.864518] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:16.762 [2024-11-28 04:29:53.864538] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:16.762 [2024-11-28 04:29:53.864547] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:16.762 [2024-11-28 04:29:53.864566] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:16.762 [2024-11-28 04:29:53.864579] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864586] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864592] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.864603] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:16.762 [2024-11-28 04:29:53.864624] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.762 [2024-11-28 04:29:53.864736] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.762 [2024-11-28 04:29:53.864751] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.762 [2024-11-28 04:29:53.864757] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864764] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96b30) on tqpair=0xc16e10 00:23:16.762 [2024-11-28 04:29:53.864774] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864781] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864787] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.864797] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.762 [2024-11-28 04:29:53.864807] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864813] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864819] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.864828] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.762 [2024-11-28 04:29:53.864837] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864843] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864849] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.864858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.762 [2024-11-28 04:29:53.864871] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864878] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864884] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.864893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.762 [2024-11-28 04:29:53.864916] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:16.762 [2024-11-28 04:29:53.864935] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:16.762 [2024-11-28 04:29:53.864947] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864953] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.762 [2024-11-28 04:29:53.864959] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc16e10) 00:23:16.762 [2024-11-28 04:29:53.864969] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.762 [2024-11-28 04:29:53.865004] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96b30, cid 0, qid 0 00:23:16.762 [2024-11-28 04:29:53.865015] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96c90, cid 1, qid 0 00:23:16.762 [2024-11-28 04:29:53.865022] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96df0, cid 2, qid 0 00:23:16.763 [2024-11-28 04:29:53.865029] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.763 [2024-11-28 04:29:53.865035] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc970b0, cid 4, qid 0 00:23:16.763 [2024-11-28 04:29:53.865256] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.763 [2024-11-28 04:29:53.865271] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.763 [2024-11-28 04:29:53.865278] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865284] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc970b0) on tqpair=0xc16e10 00:23:16.763 [2024-11-28 04:29:53.865292] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:16.763 [2024-11-28 04:29:53.865301] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.865316] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.865332] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.865343] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865350] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865356] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc16e10) 00:23:16.763 [2024-11-28 04:29:53.865382] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:16.763 [2024-11-28 04:29:53.865403] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc970b0, cid 4, qid 0 00:23:16.763 [2024-11-28 04:29:53.865577] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.763 [2024-11-28 04:29:53.865593] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.763 [2024-11-28 04:29:53.865600] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865606] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc970b0) on tqpair=0xc16e10 00:23:16.763 [2024-11-28 04:29:53.865672] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.865695] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.865711] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865725] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc16e10) 00:23:16.763 [2024-11-28 04:29:53.865735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.763 [2024-11-28 04:29:53.865756] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc970b0, cid 4, qid 0 00:23:16.763 [2024-11-28 04:29:53.865906] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.763 [2024-11-28 04:29:53.865920] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.763 [2024-11-28 04:29:53.865927] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865933] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=4096, cccid=4 00:23:16.763 [2024-11-28 04:29:53.865940] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc970b0) on tqpair(0xc16e10): expected_datao=0, payload_size=4096 00:23:16.763 [2024-11-28 04:29:53.865971] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.865980] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.910539] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.763 [2024-11-28 04:29:53.910557] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.763 [2024-11-28 04:29:53.910564] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.910571] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc970b0) on tqpair=0xc16e10 00:23:16.763 [2024-11-28 04:29:53.910595] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:16.763 [2024-11-28 04:29:53.910615] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.910634] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.910648] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.910655] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.910661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc16e10) 00:23:16.763 [2024-11-28 04:29:53.910672] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.763 [2024-11-28 04:29:53.910695] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc970b0, cid 4, qid 0 00:23:16.763 [2024-11-28 04:29:53.910859] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.763 [2024-11-28 04:29:53.910874] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.763 [2024-11-28 04:29:53.910880] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.910886] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=4096, cccid=4 00:23:16.763 [2024-11-28 04:29:53.910894] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc970b0) on tqpair(0xc16e10): expected_datao=0, payload_size=4096 00:23:16.763 [2024-11-28 04:29:53.910934] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.910943] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.911003] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.763 [2024-11-28 04:29:53.911015] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.763 [2024-11-28 04:29:53.911021] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.911031] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc970b0) on tqpair=0xc16e10 00:23:16.763 [2024-11-28 04:29:53.911057] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.911083] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.911097] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.911104] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.911111] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc16e10) 00:23:16.763 [2024-11-28 04:29:53.911121] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.763 [2024-11-28 04:29:53.911143] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc970b0, cid 4, qid 0 00:23:16.763 [2024-11-28 04:29:53.911265] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.763 [2024-11-28 04:29:53.911279] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.763 [2024-11-28 04:29:53.911286] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.911292] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=4096, cccid=4 00:23:16.763 [2024-11-28 04:29:53.911299] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc970b0) on tqpair(0xc16e10): expected_datao=0, payload_size=4096 00:23:16.763 [2024-11-28 04:29:53.911328] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.911338] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.952718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.763 [2024-11-28 04:29:53.952737] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.763 [2024-11-28 04:29:53.952744] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.952751] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc970b0) on tqpair=0xc16e10 00:23:16.763 [2024-11-28 04:29:53.952766] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.952782] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.952798] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.952810] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.952819] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.952827] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:16.763 [2024-11-28 04:29:53.952835] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:16.763 [2024-11-28 04:29:53.952844] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:16.763 [2024-11-28 04:29:53.952863] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.952871] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.952877] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc16e10) 00:23:16.763 [2024-11-28 04:29:53.952888] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.763 [2024-11-28 04:29:53.952904] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.952912] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.952919] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc16e10) 00:23:16.763 [2024-11-28 04:29:53.952928] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:16.763 [2024-11-28 04:29:53.952954] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc970b0, cid 4, qid 0 00:23:16.763 [2024-11-28 04:29:53.952966] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc97210, cid 5, qid 0 00:23:16.763 [2024-11-28 04:29:53.953076] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.763 [2024-11-28 04:29:53.953091] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.763 [2024-11-28 04:29:53.953098] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.763 [2024-11-28 04:29:53.953104] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc970b0) on tqpair=0xc16e10 00:23:16.763 [2024-11-28 04:29:53.953115] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.763 [2024-11-28 04:29:53.953123] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.763 [2024-11-28 04:29:53.953130] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.953136] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc97210) on tqpair=0xc16e10 00:23:16.764 [2024-11-28 04:29:53.953152] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.953161] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.953167] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc16e10) 00:23:16.764 [2024-11-28 04:29:53.953177] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.764 [2024-11-28 04:29:53.953199] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc97210, cid 5, qid 0 00:23:16.764 [2024-11-28 04:29:53.953308] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.764 [2024-11-28 04:29:53.953323] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.764 [2024-11-28 04:29:53.953329] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.953336] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc97210) on tqpair=0xc16e10 00:23:16.764 [2024-11-28 04:29:53.953352] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.953360] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.953366] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc16e10) 00:23:16.764 [2024-11-28 04:29:53.953377] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.764 [2024-11-28 04:29:53.953397] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc97210, cid 5, qid 0 00:23:16.764 [2024-11-28 04:29:53.953493] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.764 [2024-11-28 04:29:53.953508] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.764 [2024-11-28 04:29:53.953515] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.953521] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc97210) on tqpair=0xc16e10 00:23:16.764 [2024-11-28 04:29:53.957567] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957577] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957583] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc16e10) 00:23:16.764 [2024-11-28 04:29:53.957594] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.764 [2024-11-28 04:29:53.957620] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc97210, cid 5, qid 0 00:23:16.764 [2024-11-28 04:29:53.957754] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.764 [2024-11-28 04:29:53.957769] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.764 [2024-11-28 04:29:53.957776] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957782] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc97210) on tqpair=0xc16e10 00:23:16.764 [2024-11-28 04:29:53.957803] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957812] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957819] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc16e10) 00:23:16.764 [2024-11-28 04:29:53.957829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.764 [2024-11-28 04:29:53.957841] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957848] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957855] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc16e10) 00:23:16.764 [2024-11-28 04:29:53.957864] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.764 [2024-11-28 04:29:53.957876] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957883] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957890] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xc16e10) 00:23:16.764 [2024-11-28 04:29:53.957899] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.764 [2024-11-28 04:29:53.957911] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957918] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.957924] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xc16e10) 00:23:16.764 [2024-11-28 04:29:53.957949] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.764 [2024-11-28 04:29:53.957972] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc97210, cid 5, qid 0 00:23:16.764 [2024-11-28 04:29:53.957982] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc970b0, cid 4, qid 0 00:23:16.764 [2024-11-28 04:29:53.957990] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc97370, cid 6, qid 0 00:23:16.764 [2024-11-28 04:29:53.957997] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc974d0, cid 7, qid 0 00:23:16.764 [2024-11-28 04:29:53.958246] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.764 [2024-11-28 04:29:53.958259] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.764 [2024-11-28 04:29:53.958265] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958271] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=8192, cccid=5 00:23:16.764 [2024-11-28 04:29:53.958279] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc97210) on tqpair(0xc16e10): expected_datao=0, payload_size=8192 00:23:16.764 [2024-11-28 04:29:53.958300] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958309] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958318] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.764 [2024-11-28 04:29:53.958327] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.764 [2024-11-28 04:29:53.958333] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958343] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=512, cccid=4 00:23:16.764 [2024-11-28 04:29:53.958351] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc970b0) on tqpair(0xc16e10): expected_datao=0, payload_size=512 00:23:16.764 [2024-11-28 04:29:53.958361] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958368] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.764 [2024-11-28 04:29:53.958385] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.764 [2024-11-28 04:29:53.958391] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958397] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=512, cccid=6 00:23:16.764 [2024-11-28 04:29:53.958405] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc97370) on tqpair(0xc16e10): expected_datao=0, payload_size=512 00:23:16.764 [2024-11-28 04:29:53.958415] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958421] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:16.764 [2024-11-28 04:29:53.958438] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:16.764 [2024-11-28 04:29:53.958444] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958450] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc16e10): datao=0, datal=4096, cccid=7 00:23:16.764 [2024-11-28 04:29:53.958458] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xc974d0) on tqpair(0xc16e10): expected_datao=0, payload_size=4096 00:23:16.764 [2024-11-28 04:29:53.958468] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958476] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958487] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.764 [2024-11-28 04:29:53.958496] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.764 [2024-11-28 04:29:53.958503] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958509] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc97210) on tqpair=0xc16e10 00:23:16.764 [2024-11-28 04:29:53.958538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.764 [2024-11-28 04:29:53.958551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.764 [2024-11-28 04:29:53.958557] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958564] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc970b0) on tqpair=0xc16e10 00:23:16.764 [2024-11-28 04:29:53.958578] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.764 [2024-11-28 04:29:53.958603] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.764 [2024-11-28 04:29:53.958610] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958616] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc97370) on tqpair=0xc16e10 00:23:16.764 [2024-11-28 04:29:53.958626] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.764 [2024-11-28 04:29:53.958635] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.764 [2024-11-28 04:29:53.958641] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.764 [2024-11-28 04:29:53.958647] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc974d0) on tqpair=0xc16e10 00:23:16.764 ===================================================== 00:23:16.764 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:16.764 ===================================================== 00:23:16.764 Controller Capabilities/Features 00:23:16.764 ================================ 00:23:16.764 Vendor ID: 8086 00:23:16.764 Subsystem Vendor ID: 8086 00:23:16.764 Serial Number: SPDK00000000000001 00:23:16.764 Model Number: SPDK bdev Controller 00:23:16.764 Firmware Version: 24.01.1 00:23:16.764 Recommended Arb Burst: 6 00:23:16.764 IEEE OUI Identifier: e4 d2 5c 00:23:16.764 Multi-path I/O 00:23:16.764 May have multiple subsystem ports: Yes 00:23:16.764 May have multiple controllers: Yes 00:23:16.764 Associated with SR-IOV VF: No 00:23:16.764 Max Data Transfer Size: 131072 00:23:16.764 Max Number of Namespaces: 32 00:23:16.764 Max Number of I/O Queues: 127 00:23:16.764 NVMe Specification Version (VS): 1.3 00:23:16.764 NVMe Specification Version (Identify): 1.3 00:23:16.764 Maximum Queue Entries: 128 00:23:16.764 Contiguous Queues Required: Yes 00:23:16.764 Arbitration Mechanisms Supported 00:23:16.764 Weighted Round Robin: Not Supported 00:23:16.765 Vendor Specific: Not Supported 00:23:16.765 Reset Timeout: 15000 ms 00:23:16.765 Doorbell Stride: 4 bytes 00:23:16.765 NVM Subsystem Reset: Not Supported 00:23:16.765 Command Sets Supported 00:23:16.765 NVM Command Set: Supported 00:23:16.765 Boot Partition: Not Supported 00:23:16.765 Memory Page Size Minimum: 4096 bytes 00:23:16.765 Memory Page Size Maximum: 4096 bytes 00:23:16.765 Persistent Memory Region: Not Supported 00:23:16.765 Optional Asynchronous Events Supported 00:23:16.765 Namespace Attribute Notices: Supported 00:23:16.765 Firmware Activation Notices: Not Supported 00:23:16.765 ANA Change Notices: Not Supported 00:23:16.765 PLE Aggregate Log Change Notices: Not Supported 00:23:16.765 LBA Status Info Alert Notices: Not Supported 00:23:16.765 EGE Aggregate Log Change Notices: Not Supported 00:23:16.765 Normal NVM Subsystem Shutdown event: Not Supported 00:23:16.765 Zone Descriptor Change Notices: Not Supported 00:23:16.765 Discovery Log Change Notices: Not Supported 00:23:16.765 Controller Attributes 00:23:16.765 128-bit Host Identifier: Supported 00:23:16.765 Non-Operational Permissive Mode: Not Supported 00:23:16.765 NVM Sets: Not Supported 00:23:16.765 Read Recovery Levels: Not Supported 00:23:16.765 Endurance Groups: Not Supported 00:23:16.765 Predictable Latency Mode: Not Supported 00:23:16.765 Traffic Based Keep ALive: Not Supported 00:23:16.765 Namespace Granularity: Not Supported 00:23:16.765 SQ Associations: Not Supported 00:23:16.765 UUID List: Not Supported 00:23:16.765 Multi-Domain Subsystem: Not Supported 00:23:16.765 Fixed Capacity Management: Not Supported 00:23:16.765 Variable Capacity Management: Not Supported 00:23:16.765 Delete Endurance Group: Not Supported 00:23:16.765 Delete NVM Set: Not Supported 00:23:16.765 Extended LBA Formats Supported: Not Supported 00:23:16.765 Flexible Data Placement Supported: Not Supported 00:23:16.765 00:23:16.765 Controller Memory Buffer Support 00:23:16.765 ================================ 00:23:16.765 Supported: No 00:23:16.765 00:23:16.765 Persistent Memory Region Support 00:23:16.765 ================================ 00:23:16.765 Supported: No 00:23:16.765 00:23:16.765 Admin Command Set Attributes 00:23:16.765 ============================ 00:23:16.765 Security Send/Receive: Not Supported 00:23:16.765 Format NVM: Not Supported 00:23:16.765 Firmware Activate/Download: Not Supported 00:23:16.765 Namespace Management: Not Supported 00:23:16.765 Device Self-Test: Not Supported 00:23:16.765 Directives: Not Supported 00:23:16.765 NVMe-MI: Not Supported 00:23:16.765 Virtualization Management: Not Supported 00:23:16.765 Doorbell Buffer Config: Not Supported 00:23:16.765 Get LBA Status Capability: Not Supported 00:23:16.765 Command & Feature Lockdown Capability: Not Supported 00:23:16.765 Abort Command Limit: 4 00:23:16.765 Async Event Request Limit: 4 00:23:16.765 Number of Firmware Slots: N/A 00:23:16.765 Firmware Slot 1 Read-Only: N/A 00:23:16.765 Firmware Activation Without Reset: N/A 00:23:16.765 Multiple Update Detection Support: N/A 00:23:16.765 Firmware Update Granularity: No Information Provided 00:23:16.765 Per-Namespace SMART Log: No 00:23:16.765 Asymmetric Namespace Access Log Page: Not Supported 00:23:16.765 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:16.765 Command Effects Log Page: Supported 00:23:16.765 Get Log Page Extended Data: Supported 00:23:16.765 Telemetry Log Pages: Not Supported 00:23:16.765 Persistent Event Log Pages: Not Supported 00:23:16.765 Supported Log Pages Log Page: May Support 00:23:16.765 Commands Supported & Effects Log Page: Not Supported 00:23:16.765 Feature Identifiers & Effects Log Page:May Support 00:23:16.765 NVMe-MI Commands & Effects Log Page: May Support 00:23:16.765 Data Area 4 for Telemetry Log: Not Supported 00:23:16.765 Error Log Page Entries Supported: 128 00:23:16.765 Keep Alive: Supported 00:23:16.765 Keep Alive Granularity: 10000 ms 00:23:16.765 00:23:16.765 NVM Command Set Attributes 00:23:16.765 ========================== 00:23:16.765 Submission Queue Entry Size 00:23:16.765 Max: 64 00:23:16.765 Min: 64 00:23:16.765 Completion Queue Entry Size 00:23:16.765 Max: 16 00:23:16.765 Min: 16 00:23:16.765 Number of Namespaces: 32 00:23:16.765 Compare Command: Supported 00:23:16.765 Write Uncorrectable Command: Not Supported 00:23:16.765 Dataset Management Command: Supported 00:23:16.765 Write Zeroes Command: Supported 00:23:16.765 Set Features Save Field: Not Supported 00:23:16.765 Reservations: Supported 00:23:16.765 Timestamp: Not Supported 00:23:16.765 Copy: Supported 00:23:16.765 Volatile Write Cache: Present 00:23:16.765 Atomic Write Unit (Normal): 1 00:23:16.765 Atomic Write Unit (PFail): 1 00:23:16.765 Atomic Compare & Write Unit: 1 00:23:16.765 Fused Compare & Write: Supported 00:23:16.765 Scatter-Gather List 00:23:16.765 SGL Command Set: Supported 00:23:16.765 SGL Keyed: Supported 00:23:16.765 SGL Bit Bucket Descriptor: Not Supported 00:23:16.765 SGL Metadata Pointer: Not Supported 00:23:16.765 Oversized SGL: Not Supported 00:23:16.765 SGL Metadata Address: Not Supported 00:23:16.765 SGL Offset: Supported 00:23:16.765 Transport SGL Data Block: Not Supported 00:23:16.765 Replay Protected Memory Block: Not Supported 00:23:16.765 00:23:16.765 Firmware Slot Information 00:23:16.765 ========================= 00:23:16.765 Active slot: 1 00:23:16.765 Slot 1 Firmware Revision: 24.01.1 00:23:16.765 00:23:16.765 00:23:16.765 Commands Supported and Effects 00:23:16.765 ============================== 00:23:16.765 Admin Commands 00:23:16.765 -------------- 00:23:16.765 Get Log Page (02h): Supported 00:23:16.765 Identify (06h): Supported 00:23:16.765 Abort (08h): Supported 00:23:16.765 Set Features (09h): Supported 00:23:16.765 Get Features (0Ah): Supported 00:23:16.765 Asynchronous Event Request (0Ch): Supported 00:23:16.765 Keep Alive (18h): Supported 00:23:16.765 I/O Commands 00:23:16.765 ------------ 00:23:16.765 Flush (00h): Supported LBA-Change 00:23:16.765 Write (01h): Supported LBA-Change 00:23:16.765 Read (02h): Supported 00:23:16.765 Compare (05h): Supported 00:23:16.765 Write Zeroes (08h): Supported LBA-Change 00:23:16.765 Dataset Management (09h): Supported LBA-Change 00:23:16.765 Copy (19h): Supported LBA-Change 00:23:16.765 Unknown (79h): Supported LBA-Change 00:23:16.765 Unknown (7Ah): Supported 00:23:16.765 00:23:16.765 Error Log 00:23:16.765 ========= 00:23:16.765 00:23:16.765 Arbitration 00:23:16.765 =========== 00:23:16.765 Arbitration Burst: 1 00:23:16.765 00:23:16.765 Power Management 00:23:16.765 ================ 00:23:16.765 Number of Power States: 1 00:23:16.765 Current Power State: Power State #0 00:23:16.765 Power State #0: 00:23:16.765 Max Power: 0.00 W 00:23:16.765 Non-Operational State: Operational 00:23:16.765 Entry Latency: Not Reported 00:23:16.765 Exit Latency: Not Reported 00:23:16.765 Relative Read Throughput: 0 00:23:16.765 Relative Read Latency: 0 00:23:16.765 Relative Write Throughput: 0 00:23:16.765 Relative Write Latency: 0 00:23:16.765 Idle Power: Not Reported 00:23:16.765 Active Power: Not Reported 00:23:16.765 Non-Operational Permissive Mode: Not Supported 00:23:16.765 00:23:16.765 Health Information 00:23:16.765 ================== 00:23:16.765 Critical Warnings: 00:23:16.765 Available Spare Space: OK 00:23:16.765 Temperature: OK 00:23:16.765 Device Reliability: OK 00:23:16.765 Read Only: No 00:23:16.765 Volatile Memory Backup: OK 00:23:16.765 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:16.765 Temperature Threshold: [2024-11-28 04:29:53.958768] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.765 [2024-11-28 04:29:53.958780] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.765 [2024-11-28 04:29:53.958786] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xc16e10) 00:23:16.765 [2024-11-28 04:29:53.958797] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.765 [2024-11-28 04:29:53.958823] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc974d0, cid 7, qid 0 00:23:16.765 [2024-11-28 04:29:53.958978] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.765 [2024-11-28 04:29:53.958993] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.765 [2024-11-28 04:29:53.959000] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.765 [2024-11-28 04:29:53.959007] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc974d0) on tqpair=0xc16e10 00:23:16.765 [2024-11-28 04:29:53.959047] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:16.765 [2024-11-28 04:29:53.959068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.765 [2024-11-28 04:29:53.959080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.766 [2024-11-28 04:29:53.959089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.766 [2024-11-28 04:29:53.959099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:16.766 [2024-11-28 04:29:53.959111] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959118] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959124] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.959135] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.959172] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.959340] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.959356] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.959362] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959369] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.959380] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959387] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959394] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.959404] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.959430] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.959551] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.959566] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.959573] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959579] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.959587] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:16.766 [2024-11-28 04:29:53.959595] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:16.766 [2024-11-28 04:29:53.959611] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959620] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959626] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.959637] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.959661] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.959773] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.959789] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.959795] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959802] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.959818] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959827] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959833] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.959844] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.959864] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.959960] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.959975] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.959982] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.959988] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.960005] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960013] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960020] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.960030] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.960051] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.960148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.960162] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.960169] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960175] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.960192] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960201] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960207] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.960217] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.960237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.960334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.960349] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.960355] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960362] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.960378] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960387] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960393] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.960404] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.960424] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.960518] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.960540] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.960547] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960554] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.960570] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960579] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960585] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.960596] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.960617] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.960718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.960732] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.960739] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960745] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.960762] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960771] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960777] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.960787] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.766 [2024-11-28 04:29:53.960808] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.766 [2024-11-28 04:29:53.960904] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.766 [2024-11-28 04:29:53.960919] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.766 [2024-11-28 04:29:53.960926] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960932] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.766 [2024-11-28 04:29:53.960948] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960957] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.766 [2024-11-28 04:29:53.960963] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.766 [2024-11-28 04:29:53.960973] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.767 [2024-11-28 04:29:53.960994] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.767 [2024-11-28 04:29:53.961091] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.767 [2024-11-28 04:29:53.961106] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.767 [2024-11-28 04:29:53.961112] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.961119] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.767 [2024-11-28 04:29:53.961135] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.961144] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.961150] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.767 [2024-11-28 04:29:53.961161] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.767 [2024-11-28 04:29:53.961181] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.767 [2024-11-28 04:29:53.961281] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.767 [2024-11-28 04:29:53.961300] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.767 [2024-11-28 04:29:53.961307] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.961313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.767 [2024-11-28 04:29:53.961330] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.961339] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.961345] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.767 [2024-11-28 04:29:53.961356] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.767 [2024-11-28 04:29:53.961376] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.767 [2024-11-28 04:29:53.961473] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.767 [2024-11-28 04:29:53.961487] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.767 [2024-11-28 04:29:53.961494] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.961500] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.767 [2024-11-28 04:29:53.961517] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.965549] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.965560] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc16e10) 00:23:16.767 [2024-11-28 04:29:53.965571] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:16.767 [2024-11-28 04:29:53.965594] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xc96f50, cid 3, qid 0 00:23:16.767 [2024-11-28 04:29:53.965729] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:16.767 [2024-11-28 04:29:53.965744] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:16.767 [2024-11-28 04:29:53.965751] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:16.767 [2024-11-28 04:29:53.965757] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xc96f50) on tqpair=0xc16e10 00:23:16.767 [2024-11-28 04:29:53.965771] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:23:16.767 0 Kelvin (-273 Celsius) 00:23:16.767 Available Spare: 0% 00:23:16.767 Available Spare Threshold: 0% 00:23:16.767 Life Percentage Used: 0% 00:23:16.767 Data Units Read: 0 00:23:16.767 Data Units Written: 0 00:23:16.767 Host Read Commands: 0 00:23:16.767 Host Write Commands: 0 00:23:16.767 Controller Busy Time: 0 minutes 00:23:16.767 Power Cycles: 0 00:23:16.767 Power On Hours: 0 hours 00:23:16.767 Unsafe Shutdowns: 0 00:23:16.767 Unrecoverable Media Errors: 0 00:23:16.767 Lifetime Error Log Entries: 0 00:23:16.767 Warning Temperature Time: 0 minutes 00:23:16.767 Critical Temperature Time: 0 minutes 00:23:16.767 00:23:16.767 Number of Queues 00:23:16.767 ================ 00:23:16.767 Number of I/O Submission Queues: 127 00:23:16.767 Number of I/O Completion Queues: 127 00:23:16.767 00:23:16.767 Active Namespaces 00:23:16.767 ================= 00:23:16.767 Namespace ID:1 00:23:16.767 Error Recovery Timeout: Unlimited 00:23:16.767 Command Set Identifier: NVM (00h) 00:23:16.767 Deallocate: Supported 00:23:16.767 Deallocated/Unwritten Error: Not Supported 00:23:16.767 Deallocated Read Value: Unknown 00:23:16.767 Deallocate in Write Zeroes: Not Supported 00:23:16.767 Deallocated Guard Field: 0xFFFF 00:23:16.767 Flush: Supported 00:23:16.767 Reservation: Supported 00:23:16.767 Namespace Sharing Capabilities: Multiple Controllers 00:23:16.767 Size (in LBAs): 131072 (0GiB) 00:23:16.767 Capacity (in LBAs): 131072 (0GiB) 00:23:16.767 Utilization (in LBAs): 131072 (0GiB) 00:23:16.767 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:16.767 EUI64: ABCDEF0123456789 00:23:16.767 UUID: 12bef709-0d12-46c6-9004-96ea54b589eb 00:23:16.767 Thin Provisioning: Not Supported 00:23:16.767 Per-NS Atomic Units: Yes 00:23:16.767 Atomic Boundary Size (Normal): 0 00:23:16.767 Atomic Boundary Size (PFail): 0 00:23:16.767 Atomic Boundary Offset: 0 00:23:16.767 Maximum Single Source Range Length: 65535 00:23:16.767 Maximum Copy Length: 65535 00:23:16.767 Maximum Source Range Count: 1 00:23:16.767 NGUID/EUI64 Never Reused: No 00:23:16.767 Namespace Write Protected: No 00:23:16.767 Number of LBA Formats: 1 00:23:16.767 Current LBA Format: LBA Format #00 00:23:16.767 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:16.767 00:23:16.767 04:29:53 -- host/identify.sh@51 -- # sync 00:23:16.767 04:29:53 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:16.767 04:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:16.767 04:29:53 -- common/autotest_common.sh@10 -- # set +x 00:23:16.767 04:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:16.767 04:29:53 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:16.767 04:29:53 -- host/identify.sh@56 -- # nvmftestfini 00:23:16.767 04:29:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:16.767 04:29:53 -- nvmf/common.sh@116 -- # sync 00:23:16.767 04:29:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:16.767 04:29:53 -- nvmf/common.sh@119 -- # set +e 00:23:16.767 04:29:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:16.767 04:29:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:16.767 rmmod nvme_tcp 00:23:16.767 rmmod nvme_fabrics 00:23:16.767 rmmod nvme_keyring 00:23:16.767 04:29:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:16.767 04:29:54 -- nvmf/common.sh@123 -- # set -e 00:23:16.767 04:29:54 -- nvmf/common.sh@124 -- # return 0 00:23:16.767 04:29:54 -- nvmf/common.sh@477 -- # '[' -n 3972192 ']' 00:23:16.767 04:29:54 -- nvmf/common.sh@478 -- # killprocess 3972192 00:23:16.767 04:29:54 -- common/autotest_common.sh@936 -- # '[' -z 3972192 ']' 00:23:16.767 04:29:54 -- common/autotest_common.sh@940 -- # kill -0 3972192 00:23:16.767 04:29:54 -- common/autotest_common.sh@941 -- # uname 00:23:16.767 04:29:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:16.767 04:29:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3972192 00:23:17.026 04:29:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:17.026 04:29:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:17.026 04:29:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3972192' 00:23:17.026 killing process with pid 3972192 00:23:17.026 04:29:54 -- common/autotest_common.sh@955 -- # kill 3972192 00:23:17.026 [2024-11-28 04:29:54.084531] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:17.026 04:29:54 -- common/autotest_common.sh@960 -- # wait 3972192 00:23:17.285 04:29:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:17.285 04:29:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:17.285 04:29:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:17.285 04:29:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:17.285 04:29:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:17.285 04:29:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:17.285 04:29:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:17.285 04:29:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:19.188 04:29:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:19.188 00:23:19.188 real 0m6.377s 00:23:19.188 user 0m7.593s 00:23:19.188 sys 0m2.010s 00:23:19.188 04:29:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:19.188 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:19.188 ************************************ 00:23:19.188 END TEST nvmf_identify 00:23:19.188 ************************************ 00:23:19.189 04:29:56 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:19.189 04:29:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:19.189 04:29:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:19.189 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:19.189 ************************************ 00:23:19.189 START TEST nvmf_perf 00:23:19.189 ************************************ 00:23:19.189 04:29:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:19.189 * Looking for test storage... 00:23:19.447 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:19.447 04:29:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:19.447 04:29:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:19.447 04:29:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:19.447 04:29:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:19.447 04:29:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:19.447 04:29:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:19.447 04:29:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:19.447 04:29:56 -- scripts/common.sh@335 -- # IFS=.-: 00:23:19.447 04:29:56 -- scripts/common.sh@335 -- # read -ra ver1 00:23:19.447 04:29:56 -- scripts/common.sh@336 -- # IFS=.-: 00:23:19.447 04:29:56 -- scripts/common.sh@336 -- # read -ra ver2 00:23:19.447 04:29:56 -- scripts/common.sh@337 -- # local 'op=<' 00:23:19.447 04:29:56 -- scripts/common.sh@339 -- # ver1_l=2 00:23:19.447 04:29:56 -- scripts/common.sh@340 -- # ver2_l=1 00:23:19.447 04:29:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:19.447 04:29:56 -- scripts/common.sh@343 -- # case "$op" in 00:23:19.447 04:29:56 -- scripts/common.sh@344 -- # : 1 00:23:19.447 04:29:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:19.447 04:29:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:19.447 04:29:56 -- scripts/common.sh@364 -- # decimal 1 00:23:19.447 04:29:56 -- scripts/common.sh@352 -- # local d=1 00:23:19.447 04:29:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:19.447 04:29:56 -- scripts/common.sh@354 -- # echo 1 00:23:19.447 04:29:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:19.447 04:29:56 -- scripts/common.sh@365 -- # decimal 2 00:23:19.447 04:29:56 -- scripts/common.sh@352 -- # local d=2 00:23:19.447 04:29:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:19.447 04:29:56 -- scripts/common.sh@354 -- # echo 2 00:23:19.447 04:29:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:19.447 04:29:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:19.447 04:29:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:19.447 04:29:56 -- scripts/common.sh@367 -- # return 0 00:23:19.447 04:29:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:19.447 04:29:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:19.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:19.447 --rc genhtml_branch_coverage=1 00:23:19.447 --rc genhtml_function_coverage=1 00:23:19.447 --rc genhtml_legend=1 00:23:19.447 --rc geninfo_all_blocks=1 00:23:19.447 --rc geninfo_unexecuted_blocks=1 00:23:19.447 00:23:19.447 ' 00:23:19.447 04:29:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:19.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:19.447 --rc genhtml_branch_coverage=1 00:23:19.447 --rc genhtml_function_coverage=1 00:23:19.447 --rc genhtml_legend=1 00:23:19.447 --rc geninfo_all_blocks=1 00:23:19.447 --rc geninfo_unexecuted_blocks=1 00:23:19.447 00:23:19.447 ' 00:23:19.447 04:29:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:19.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:19.447 --rc genhtml_branch_coverage=1 00:23:19.447 --rc genhtml_function_coverage=1 00:23:19.447 --rc genhtml_legend=1 00:23:19.447 --rc geninfo_all_blocks=1 00:23:19.447 --rc geninfo_unexecuted_blocks=1 00:23:19.447 00:23:19.447 ' 00:23:19.447 04:29:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:19.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:19.447 --rc genhtml_branch_coverage=1 00:23:19.447 --rc genhtml_function_coverage=1 00:23:19.447 --rc genhtml_legend=1 00:23:19.447 --rc geninfo_all_blocks=1 00:23:19.447 --rc geninfo_unexecuted_blocks=1 00:23:19.447 00:23:19.447 ' 00:23:19.447 04:29:56 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:19.447 04:29:56 -- nvmf/common.sh@7 -- # uname -s 00:23:19.447 04:29:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:19.447 04:29:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:19.447 04:29:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:19.447 04:29:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:19.447 04:29:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:19.447 04:29:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:19.447 04:29:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:19.447 04:29:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:19.447 04:29:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:19.447 04:29:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:19.447 04:29:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:19.447 04:29:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:19.447 04:29:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:19.447 04:29:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:19.447 04:29:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:19.447 04:29:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:19.447 04:29:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:19.447 04:29:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:19.447 04:29:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:19.447 04:29:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:19.447 04:29:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:19.447 04:29:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:19.447 04:29:56 -- paths/export.sh@5 -- # export PATH 00:23:19.448 04:29:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:19.448 04:29:56 -- nvmf/common.sh@46 -- # : 0 00:23:19.448 04:29:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:19.448 04:29:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:19.448 04:29:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:19.448 04:29:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:19.448 04:29:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:19.448 04:29:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:19.448 04:29:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:19.448 04:29:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:19.448 04:29:56 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:19.448 04:29:56 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:19.448 04:29:56 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:19.448 04:29:56 -- host/perf.sh@17 -- # nvmftestinit 00:23:19.448 04:29:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:19.448 04:29:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:19.448 04:29:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:19.448 04:29:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:19.448 04:29:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:19.448 04:29:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:19.448 04:29:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:19.448 04:29:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:19.448 04:29:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:19.448 04:29:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:19.448 04:29:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:19.448 04:29:56 -- common/autotest_common.sh@10 -- # set +x 00:23:21.348 04:29:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:21.348 04:29:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:21.348 04:29:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:21.348 04:29:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:21.348 04:29:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:21.348 04:29:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:21.348 04:29:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:21.348 04:29:58 -- nvmf/common.sh@294 -- # net_devs=() 00:23:21.348 04:29:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:21.348 04:29:58 -- nvmf/common.sh@295 -- # e810=() 00:23:21.348 04:29:58 -- nvmf/common.sh@295 -- # local -ga e810 00:23:21.348 04:29:58 -- nvmf/common.sh@296 -- # x722=() 00:23:21.348 04:29:58 -- nvmf/common.sh@296 -- # local -ga x722 00:23:21.348 04:29:58 -- nvmf/common.sh@297 -- # mlx=() 00:23:21.348 04:29:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:21.348 04:29:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:21.348 04:29:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:21.348 04:29:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:21.348 04:29:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:21.348 04:29:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:21.348 04:29:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:21.348 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:21.348 04:29:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:21.348 04:29:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:21.348 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:21.348 04:29:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:21.348 04:29:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:21.348 04:29:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:21.348 04:29:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:21.348 04:29:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:21.348 04:29:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:21.348 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:21.348 04:29:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:21.348 04:29:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:21.348 04:29:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:21.348 04:29:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:21.348 04:29:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:21.348 04:29:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:21.348 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:21.348 04:29:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:21.348 04:29:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:21.348 04:29:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:21.348 04:29:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:21.348 04:29:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:21.348 04:29:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:21.348 04:29:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:21.348 04:29:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:21.348 04:29:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:21.348 04:29:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:21.348 04:29:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:21.348 04:29:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:21.348 04:29:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:21.348 04:29:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:21.348 04:29:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:21.348 04:29:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:21.348 04:29:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:21.348 04:29:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:21.348 04:29:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:21.348 04:29:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:21.348 04:29:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:21.348 04:29:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:21.607 04:29:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:21.607 04:29:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:21.607 04:29:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:21.607 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:21.607 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:23:21.607 00:23:21.607 --- 10.0.0.2 ping statistics --- 00:23:21.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:21.607 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:23:21.607 04:29:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:21.607 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:21.607 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:23:21.607 00:23:21.607 --- 10.0.0.1 ping statistics --- 00:23:21.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:21.607 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:23:21.607 04:29:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:21.607 04:29:58 -- nvmf/common.sh@410 -- # return 0 00:23:21.607 04:29:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:21.607 04:29:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:21.607 04:29:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:21.607 04:29:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:21.607 04:29:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:21.607 04:29:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:21.607 04:29:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:21.607 04:29:58 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:21.607 04:29:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:21.607 04:29:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:21.607 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:23:21.607 04:29:58 -- nvmf/common.sh@469 -- # nvmfpid=3974429 00:23:21.607 04:29:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:21.607 04:29:58 -- nvmf/common.sh@470 -- # waitforlisten 3974429 00:23:21.607 04:29:58 -- common/autotest_common.sh@829 -- # '[' -z 3974429 ']' 00:23:21.607 04:29:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:21.607 04:29:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:21.607 04:29:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:21.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:21.607 04:29:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:21.607 04:29:58 -- common/autotest_common.sh@10 -- # set +x 00:23:21.607 [2024-11-28 04:29:58.746285] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:21.607 [2024-11-28 04:29:58.746365] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:21.607 EAL: No free 2048 kB hugepages reported on node 1 00:23:21.607 [2024-11-28 04:29:58.814008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:21.866 [2024-11-28 04:29:58.929280] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:21.866 [2024-11-28 04:29:58.929432] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:21.866 [2024-11-28 04:29:58.929451] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:21.866 [2024-11-28 04:29:58.929465] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:21.866 [2024-11-28 04:29:58.929554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:21.866 [2024-11-28 04:29:58.929599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:21.866 [2024-11-28 04:29:58.929693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:21.866 [2024-11-28 04:29:58.929696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:22.431 04:29:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:22.431 04:29:59 -- common/autotest_common.sh@862 -- # return 0 00:23:22.431 04:29:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:22.431 04:29:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:22.431 04:29:59 -- common/autotest_common.sh@10 -- # set +x 00:23:22.689 04:29:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:22.689 04:29:59 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:22.689 04:29:59 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:25.987 04:30:02 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:25.987 04:30:02 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:25.987 04:30:03 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:25.987 04:30:03 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:26.245 04:30:03 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:26.245 04:30:03 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:26.245 04:30:03 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:26.245 04:30:03 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:26.245 04:30:03 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:26.501 [2024-11-28 04:30:03.640048] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:26.501 04:30:03 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:26.759 04:30:03 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:26.759 04:30:03 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:27.016 04:30:04 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:27.016 04:30:04 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:27.274 04:30:04 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:27.531 [2024-11-28 04:30:04.651921] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:27.531 04:30:04 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:27.789 04:30:04 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:27.789 04:30:04 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:27.789 04:30:04 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:27.789 04:30:04 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:29.161 Initializing NVMe Controllers 00:23:29.161 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:29.161 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:29.161 Initialization complete. Launching workers. 00:23:29.161 ======================================================== 00:23:29.161 Latency(us) 00:23:29.161 Device Information : IOPS MiB/s Average min max 00:23:29.161 PCIE (0000:88:00.0) NSID 1 from core 0: 84261.06 329.14 379.11 10.65 7227.83 00:23:29.161 ======================================================== 00:23:29.161 Total : 84261.06 329.14 379.11 10.65 7227.83 00:23:29.161 00:23:29.161 04:30:06 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:29.161 EAL: No free 2048 kB hugepages reported on node 1 00:23:30.096 Initializing NVMe Controllers 00:23:30.096 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:30.096 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:30.096 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:30.096 Initialization complete. Launching workers. 00:23:30.096 ======================================================== 00:23:30.096 Latency(us) 00:23:30.096 Device Information : IOPS MiB/s Average min max 00:23:30.096 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 121.00 0.47 8327.04 151.45 45958.94 00:23:30.096 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 52.00 0.20 19623.85 7933.99 55878.31 00:23:30.096 ======================================================== 00:23:30.096 Total : 173.00 0.68 11722.61 151.45 55878.31 00:23:30.096 00:23:30.096 04:30:07 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:30.354 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.727 Initializing NVMe Controllers 00:23:31.727 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:31.727 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:31.727 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:31.727 Initialization complete. Launching workers. 00:23:31.727 ======================================================== 00:23:31.727 Latency(us) 00:23:31.727 Device Information : IOPS MiB/s Average min max 00:23:31.727 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8667.82 33.86 3692.06 575.52 9168.62 00:23:31.727 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3912.79 15.28 8189.83 4806.34 15828.84 00:23:31.727 ======================================================== 00:23:31.727 Total : 12580.62 49.14 5090.95 575.52 15828.84 00:23:31.727 00:23:31.727 04:30:08 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:31.727 04:30:08 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:31.727 04:30:08 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:31.727 EAL: No free 2048 kB hugepages reported on node 1 00:23:34.256 Initializing NVMe Controllers 00:23:34.256 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:34.256 Controller IO queue size 128, less than required. 00:23:34.256 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:34.256 Controller IO queue size 128, less than required. 00:23:34.256 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:34.256 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:34.256 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:34.256 Initialization complete. Launching workers. 00:23:34.256 ======================================================== 00:23:34.256 Latency(us) 00:23:34.256 Device Information : IOPS MiB/s Average min max 00:23:34.256 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1626.91 406.73 79536.44 48749.10 120161.52 00:23:34.256 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 583.47 145.87 228231.04 71268.72 363632.60 00:23:34.256 ======================================================== 00:23:34.256 Total : 2210.37 552.59 118786.97 48749.10 363632.60 00:23:34.256 00:23:34.256 04:30:11 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:34.256 EAL: No free 2048 kB hugepages reported on node 1 00:23:34.256 No valid NVMe controllers or AIO or URING devices found 00:23:34.256 Initializing NVMe Controllers 00:23:34.256 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:34.256 Controller IO queue size 128, less than required. 00:23:34.256 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:34.256 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:34.256 Controller IO queue size 128, less than required. 00:23:34.256 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:34.256 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:34.256 WARNING: Some requested NVMe devices were skipped 00:23:34.256 04:30:11 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:34.256 EAL: No free 2048 kB hugepages reported on node 1 00:23:36.785 Initializing NVMe Controllers 00:23:36.785 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:36.785 Controller IO queue size 128, less than required. 00:23:36.785 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:36.785 Controller IO queue size 128, less than required. 00:23:36.785 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:36.785 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:36.785 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:36.785 Initialization complete. Launching workers. 00:23:36.785 00:23:36.785 ==================== 00:23:36.785 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:36.785 TCP transport: 00:23:36.785 polls: 10152 00:23:36.786 idle_polls: 6786 00:23:36.786 sock_completions: 3366 00:23:36.786 nvme_completions: 3682 00:23:36.786 submitted_requests: 5700 00:23:36.786 queued_requests: 1 00:23:36.786 00:23:36.786 ==================== 00:23:36.786 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:36.786 TCP transport: 00:23:36.786 polls: 13457 00:23:36.786 idle_polls: 8460 00:23:36.786 sock_completions: 4997 00:23:36.786 nvme_completions: 6012 00:23:36.786 submitted_requests: 9156 00:23:36.786 queued_requests: 1 00:23:36.786 ======================================================== 00:23:36.786 Latency(us) 00:23:36.786 Device Information : IOPS MiB/s Average min max 00:23:36.786 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 983.95 245.99 134216.79 77270.77 225077.72 00:23:36.786 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1566.42 391.61 82696.19 40326.07 116668.18 00:23:36.786 ======================================================== 00:23:36.786 Total : 2550.37 637.59 102573.18 40326.07 225077.72 00:23:36.786 00:23:36.786 04:30:13 -- host/perf.sh@66 -- # sync 00:23:36.786 04:30:13 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:37.043 04:30:14 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:37.043 04:30:14 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:37.043 04:30:14 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:40.340 04:30:17 -- host/perf.sh@72 -- # ls_guid=9c8533d6-3c6e-42db-b2b4-d1bb48004871 00:23:40.340 04:30:17 -- host/perf.sh@73 -- # get_lvs_free_mb 9c8533d6-3c6e-42db-b2b4-d1bb48004871 00:23:40.340 04:30:17 -- common/autotest_common.sh@1353 -- # local lvs_uuid=9c8533d6-3c6e-42db-b2b4-d1bb48004871 00:23:40.340 04:30:17 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:40.340 04:30:17 -- common/autotest_common.sh@1355 -- # local fc 00:23:40.340 04:30:17 -- common/autotest_common.sh@1356 -- # local cs 00:23:40.340 04:30:17 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:40.597 04:30:17 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:40.597 { 00:23:40.597 "uuid": "9c8533d6-3c6e-42db-b2b4-d1bb48004871", 00:23:40.597 "name": "lvs_0", 00:23:40.597 "base_bdev": "Nvme0n1", 00:23:40.597 "total_data_clusters": 238234, 00:23:40.597 "free_clusters": 238234, 00:23:40.597 "block_size": 512, 00:23:40.597 "cluster_size": 4194304 00:23:40.597 } 00:23:40.597 ]' 00:23:40.597 04:30:17 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="9c8533d6-3c6e-42db-b2b4-d1bb48004871") .free_clusters' 00:23:40.597 04:30:17 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:40.597 04:30:17 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="9c8533d6-3c6e-42db-b2b4-d1bb48004871") .cluster_size' 00:23:40.597 04:30:17 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:40.597 04:30:17 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:40.597 04:30:17 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:40.597 952936 00:23:40.597 04:30:17 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:40.597 04:30:17 -- host/perf.sh@78 -- # free_mb=20480 00:23:40.597 04:30:17 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9c8533d6-3c6e-42db-b2b4-d1bb48004871 lbd_0 20480 00:23:40.854 04:30:18 -- host/perf.sh@80 -- # lb_guid=aa790fc0-6011-4d5c-b32a-76680182c437 00:23:40.854 04:30:18 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore aa790fc0-6011-4d5c-b32a-76680182c437 lvs_n_0 00:23:41.787 04:30:19 -- host/perf.sh@83 -- # ls_nested_guid=55635386-fa7a-4275-84f6-f0260d751077 00:23:41.787 04:30:19 -- host/perf.sh@84 -- # get_lvs_free_mb 55635386-fa7a-4275-84f6-f0260d751077 00:23:41.787 04:30:19 -- common/autotest_common.sh@1353 -- # local lvs_uuid=55635386-fa7a-4275-84f6-f0260d751077 00:23:41.787 04:30:19 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:41.787 04:30:19 -- common/autotest_common.sh@1355 -- # local fc 00:23:41.787 04:30:19 -- common/autotest_common.sh@1356 -- # local cs 00:23:41.787 04:30:19 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:42.045 04:30:19 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:42.045 { 00:23:42.045 "uuid": "9c8533d6-3c6e-42db-b2b4-d1bb48004871", 00:23:42.045 "name": "lvs_0", 00:23:42.045 "base_bdev": "Nvme0n1", 00:23:42.045 "total_data_clusters": 238234, 00:23:42.045 "free_clusters": 233114, 00:23:42.045 "block_size": 512, 00:23:42.045 "cluster_size": 4194304 00:23:42.045 }, 00:23:42.045 { 00:23:42.045 "uuid": "55635386-fa7a-4275-84f6-f0260d751077", 00:23:42.045 "name": "lvs_n_0", 00:23:42.045 "base_bdev": "aa790fc0-6011-4d5c-b32a-76680182c437", 00:23:42.045 "total_data_clusters": 5114, 00:23:42.045 "free_clusters": 5114, 00:23:42.045 "block_size": 512, 00:23:42.045 "cluster_size": 4194304 00:23:42.045 } 00:23:42.045 ]' 00:23:42.045 04:30:19 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="55635386-fa7a-4275-84f6-f0260d751077") .free_clusters' 00:23:42.045 04:30:19 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:42.045 04:30:19 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="55635386-fa7a-4275-84f6-f0260d751077") .cluster_size' 00:23:42.302 04:30:19 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:42.302 04:30:19 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:42.302 04:30:19 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:42.302 20456 00:23:42.302 04:30:19 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:42.302 04:30:19 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 55635386-fa7a-4275-84f6-f0260d751077 lbd_nest_0 20456 00:23:42.560 04:30:19 -- host/perf.sh@88 -- # lb_nested_guid=eb82f599-b685-440e-bb25-d802327f4a38 00:23:42.560 04:30:19 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:42.560 04:30:19 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:42.560 04:30:19 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 eb82f599-b685-440e-bb25-d802327f4a38 00:23:43.126 04:30:20 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:43.126 04:30:20 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:43.126 04:30:20 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:43.126 04:30:20 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:43.126 04:30:20 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:43.126 04:30:20 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:43.126 EAL: No free 2048 kB hugepages reported on node 1 00:23:55.316 Initializing NVMe Controllers 00:23:55.316 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:55.316 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:55.316 Initialization complete. Launching workers. 00:23:55.316 ======================================================== 00:23:55.316 Latency(us) 00:23:55.316 Device Information : IOPS MiB/s Average min max 00:23:55.316 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 47.10 0.02 21312.51 179.38 45814.04 00:23:55.316 ======================================================== 00:23:55.316 Total : 47.10 0.02 21312.51 179.38 45814.04 00:23:55.316 00:23:55.316 04:30:30 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:55.316 04:30:30 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:55.316 EAL: No free 2048 kB hugepages reported on node 1 00:24:05.276 Initializing NVMe Controllers 00:24:05.276 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:05.276 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:05.276 Initialization complete. Launching workers. 00:24:05.276 ======================================================== 00:24:05.276 Latency(us) 00:24:05.276 Device Information : IOPS MiB/s Average min max 00:24:05.276 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 78.88 9.86 12687.02 4832.81 55831.37 00:24:05.276 ======================================================== 00:24:05.276 Total : 78.88 9.86 12687.02 4832.81 55831.37 00:24:05.276 00:24:05.276 04:30:41 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:05.276 04:30:41 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:05.276 04:30:41 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:05.276 EAL: No free 2048 kB hugepages reported on node 1 00:24:15.237 Initializing NVMe Controllers 00:24:15.237 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:15.237 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:15.237 Initialization complete. Launching workers. 00:24:15.237 ======================================================== 00:24:15.237 Latency(us) 00:24:15.237 Device Information : IOPS MiB/s Average min max 00:24:15.237 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7808.58 3.81 4101.61 295.83 41994.61 00:24:15.237 ======================================================== 00:24:15.237 Total : 7808.58 3.81 4101.61 295.83 41994.61 00:24:15.237 00:24:15.237 04:30:51 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:15.237 04:30:51 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:15.237 EAL: No free 2048 kB hugepages reported on node 1 00:24:25.277 Initializing NVMe Controllers 00:24:25.277 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:25.277 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:25.277 Initialization complete. Launching workers. 00:24:25.277 ======================================================== 00:24:25.277 Latency(us) 00:24:25.277 Device Information : IOPS MiB/s Average min max 00:24:25.277 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3430.60 428.82 9334.07 648.17 21144.11 00:24:25.277 ======================================================== 00:24:25.277 Total : 3430.60 428.82 9334.07 648.17 21144.11 00:24:25.277 00:24:25.277 04:31:01 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:25.277 04:31:01 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:25.277 04:31:01 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:25.277 EAL: No free 2048 kB hugepages reported on node 1 00:24:35.242 Initializing NVMe Controllers 00:24:35.242 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:35.242 Controller IO queue size 128, less than required. 00:24:35.242 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:35.242 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:35.242 Initialization complete. Launching workers. 00:24:35.242 ======================================================== 00:24:35.242 Latency(us) 00:24:35.242 Device Information : IOPS MiB/s Average min max 00:24:35.242 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12043.34 5.88 10629.96 1821.59 25994.60 00:24:35.242 ======================================================== 00:24:35.242 Total : 12043.34 5.88 10629.96 1821.59 25994.60 00:24:35.242 00:24:35.242 04:31:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:35.242 04:31:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:35.242 EAL: No free 2048 kB hugepages reported on node 1 00:24:45.207 Initializing NVMe Controllers 00:24:45.207 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:45.207 Controller IO queue size 128, less than required. 00:24:45.207 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:45.207 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:45.207 Initialization complete. Launching workers. 00:24:45.207 ======================================================== 00:24:45.207 Latency(us) 00:24:45.207 Device Information : IOPS MiB/s Average min max 00:24:45.207 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1191.02 148.88 107880.83 16027.63 221045.09 00:24:45.207 ======================================================== 00:24:45.207 Total : 1191.02 148.88 107880.83 16027.63 221045.09 00:24:45.207 00:24:45.207 04:31:22 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:45.466 04:31:22 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete eb82f599-b685-440e-bb25-d802327f4a38 00:24:46.399 04:31:23 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:46.656 04:31:23 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete aa790fc0-6011-4d5c-b32a-76680182c437 00:24:46.914 04:31:24 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:47.172 04:31:24 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:47.172 04:31:24 -- host/perf.sh@114 -- # nvmftestfini 00:24:47.172 04:31:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:47.172 04:31:24 -- nvmf/common.sh@116 -- # sync 00:24:47.172 04:31:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:47.172 04:31:24 -- nvmf/common.sh@119 -- # set +e 00:24:47.172 04:31:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:47.172 04:31:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:47.172 rmmod nvme_tcp 00:24:47.172 rmmod nvme_fabrics 00:24:47.172 rmmod nvme_keyring 00:24:47.172 04:31:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:47.172 04:31:24 -- nvmf/common.sh@123 -- # set -e 00:24:47.172 04:31:24 -- nvmf/common.sh@124 -- # return 0 00:24:47.172 04:31:24 -- nvmf/common.sh@477 -- # '[' -n 3974429 ']' 00:24:47.172 04:31:24 -- nvmf/common.sh@478 -- # killprocess 3974429 00:24:47.172 04:31:24 -- common/autotest_common.sh@936 -- # '[' -z 3974429 ']' 00:24:47.172 04:31:24 -- common/autotest_common.sh@940 -- # kill -0 3974429 00:24:47.172 04:31:24 -- common/autotest_common.sh@941 -- # uname 00:24:47.172 04:31:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:47.172 04:31:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3974429 00:24:47.172 04:31:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:47.172 04:31:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:47.172 04:31:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3974429' 00:24:47.172 killing process with pid 3974429 00:24:47.172 04:31:24 -- common/autotest_common.sh@955 -- # kill 3974429 00:24:47.172 04:31:24 -- common/autotest_common.sh@960 -- # wait 3974429 00:24:49.071 04:31:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:49.071 04:31:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:49.071 04:31:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:49.071 04:31:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:49.071 04:31:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:49.071 04:31:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.071 04:31:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.071 04:31:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:50.976 04:31:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:50.976 00:24:50.976 real 1m31.599s 00:24:50.976 user 5m35.842s 00:24:50.976 sys 0m16.050s 00:24:50.976 04:31:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:50.976 04:31:28 -- common/autotest_common.sh@10 -- # set +x 00:24:50.976 ************************************ 00:24:50.976 END TEST nvmf_perf 00:24:50.976 ************************************ 00:24:50.976 04:31:28 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:50.976 04:31:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:50.976 04:31:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:50.976 04:31:28 -- common/autotest_common.sh@10 -- # set +x 00:24:50.976 ************************************ 00:24:50.976 START TEST nvmf_fio_host 00:24:50.976 ************************************ 00:24:50.976 04:31:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:50.976 * Looking for test storage... 00:24:50.976 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:50.976 04:31:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:50.976 04:31:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:50.976 04:31:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:50.976 04:31:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:50.976 04:31:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:50.976 04:31:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:50.976 04:31:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:50.976 04:31:28 -- scripts/common.sh@335 -- # IFS=.-: 00:24:50.976 04:31:28 -- scripts/common.sh@335 -- # read -ra ver1 00:24:50.976 04:31:28 -- scripts/common.sh@336 -- # IFS=.-: 00:24:50.976 04:31:28 -- scripts/common.sh@336 -- # read -ra ver2 00:24:50.976 04:31:28 -- scripts/common.sh@337 -- # local 'op=<' 00:24:50.976 04:31:28 -- scripts/common.sh@339 -- # ver1_l=2 00:24:50.976 04:31:28 -- scripts/common.sh@340 -- # ver2_l=1 00:24:50.976 04:31:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:50.976 04:31:28 -- scripts/common.sh@343 -- # case "$op" in 00:24:50.976 04:31:28 -- scripts/common.sh@344 -- # : 1 00:24:50.976 04:31:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:50.976 04:31:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:50.976 04:31:28 -- scripts/common.sh@364 -- # decimal 1 00:24:50.976 04:31:28 -- scripts/common.sh@352 -- # local d=1 00:24:50.976 04:31:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:50.976 04:31:28 -- scripts/common.sh@354 -- # echo 1 00:24:50.976 04:31:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:50.976 04:31:28 -- scripts/common.sh@365 -- # decimal 2 00:24:50.976 04:31:28 -- scripts/common.sh@352 -- # local d=2 00:24:50.976 04:31:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:50.976 04:31:28 -- scripts/common.sh@354 -- # echo 2 00:24:50.976 04:31:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:50.976 04:31:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:50.976 04:31:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:50.976 04:31:28 -- scripts/common.sh@367 -- # return 0 00:24:50.976 04:31:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:50.976 04:31:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:50.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:50.976 --rc genhtml_branch_coverage=1 00:24:50.976 --rc genhtml_function_coverage=1 00:24:50.976 --rc genhtml_legend=1 00:24:50.976 --rc geninfo_all_blocks=1 00:24:50.976 --rc geninfo_unexecuted_blocks=1 00:24:50.976 00:24:50.976 ' 00:24:50.976 04:31:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:50.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:50.976 --rc genhtml_branch_coverage=1 00:24:50.976 --rc genhtml_function_coverage=1 00:24:50.976 --rc genhtml_legend=1 00:24:50.976 --rc geninfo_all_blocks=1 00:24:50.976 --rc geninfo_unexecuted_blocks=1 00:24:50.976 00:24:50.976 ' 00:24:50.976 04:31:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:50.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:50.976 --rc genhtml_branch_coverage=1 00:24:50.976 --rc genhtml_function_coverage=1 00:24:50.976 --rc genhtml_legend=1 00:24:50.976 --rc geninfo_all_blocks=1 00:24:50.976 --rc geninfo_unexecuted_blocks=1 00:24:50.976 00:24:50.976 ' 00:24:50.976 04:31:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:50.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:50.976 --rc genhtml_branch_coverage=1 00:24:50.976 --rc genhtml_function_coverage=1 00:24:50.976 --rc genhtml_legend=1 00:24:50.976 --rc geninfo_all_blocks=1 00:24:50.976 --rc geninfo_unexecuted_blocks=1 00:24:50.976 00:24:50.976 ' 00:24:50.976 04:31:28 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:50.976 04:31:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:50.976 04:31:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:50.976 04:31:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:50.976 04:31:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.976 04:31:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.976 04:31:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.976 04:31:28 -- paths/export.sh@5 -- # export PATH 00:24:50.976 04:31:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.976 04:31:28 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:50.976 04:31:28 -- nvmf/common.sh@7 -- # uname -s 00:24:50.976 04:31:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:50.976 04:31:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:50.976 04:31:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:50.976 04:31:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:50.976 04:31:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:50.977 04:31:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:50.977 04:31:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:50.977 04:31:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:50.977 04:31:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:50.977 04:31:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:50.977 04:31:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:50.977 04:31:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:50.977 04:31:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:50.977 04:31:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:50.977 04:31:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:50.977 04:31:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:50.977 04:31:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:50.977 04:31:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:50.977 04:31:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:50.977 04:31:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.977 04:31:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.977 04:31:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.977 04:31:28 -- paths/export.sh@5 -- # export PATH 00:24:50.977 04:31:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:50.977 04:31:28 -- nvmf/common.sh@46 -- # : 0 00:24:50.977 04:31:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:50.977 04:31:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:50.977 04:31:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:50.977 04:31:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:50.977 04:31:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:50.977 04:31:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:50.977 04:31:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:50.977 04:31:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:50.977 04:31:28 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:50.977 04:31:28 -- host/fio.sh@14 -- # nvmftestinit 00:24:50.977 04:31:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:50.977 04:31:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:50.977 04:31:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:50.977 04:31:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:50.977 04:31:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:50.977 04:31:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:50.977 04:31:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:50.977 04:31:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:50.977 04:31:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:50.977 04:31:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:50.977 04:31:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:50.977 04:31:28 -- common/autotest_common.sh@10 -- # set +x 00:24:53.509 04:31:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:53.509 04:31:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:53.509 04:31:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:53.509 04:31:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:53.509 04:31:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:53.509 04:31:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:53.509 04:31:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:53.509 04:31:30 -- nvmf/common.sh@294 -- # net_devs=() 00:24:53.509 04:31:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:53.509 04:31:30 -- nvmf/common.sh@295 -- # e810=() 00:24:53.509 04:31:30 -- nvmf/common.sh@295 -- # local -ga e810 00:24:53.509 04:31:30 -- nvmf/common.sh@296 -- # x722=() 00:24:53.509 04:31:30 -- nvmf/common.sh@296 -- # local -ga x722 00:24:53.510 04:31:30 -- nvmf/common.sh@297 -- # mlx=() 00:24:53.510 04:31:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:53.510 04:31:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:53.510 04:31:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:53.510 04:31:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:53.510 04:31:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:53.510 04:31:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.510 04:31:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:53.510 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:53.510 04:31:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.510 04:31:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:53.510 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:53.510 04:31:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:53.510 04:31:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.510 04:31:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.510 04:31:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.510 04:31:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.510 04:31:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:53.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:53.510 04:31:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.510 04:31:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.510 04:31:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.510 04:31:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.510 04:31:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.510 04:31:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:53.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:53.510 04:31:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.510 04:31:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:53.510 04:31:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:53.510 04:31:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:53.510 04:31:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:53.510 04:31:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:53.510 04:31:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:53.510 04:31:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:53.510 04:31:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:53.510 04:31:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:53.510 04:31:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:53.510 04:31:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:53.510 04:31:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:53.510 04:31:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:53.510 04:31:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:53.510 04:31:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:53.510 04:31:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:53.510 04:31:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:53.510 04:31:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:53.510 04:31:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:53.510 04:31:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:53.510 04:31:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:53.510 04:31:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:53.510 04:31:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:53.510 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:53.510 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.328 ms 00:24:53.510 00:24:53.510 --- 10.0.0.2 ping statistics --- 00:24:53.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.510 rtt min/avg/max/mdev = 0.328/0.328/0.328/0.000 ms 00:24:53.510 04:31:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:53.510 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:53.510 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:24:53.510 00:24:53.510 --- 10.0.0.1 ping statistics --- 00:24:53.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.510 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:24:53.510 04:31:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:53.510 04:31:30 -- nvmf/common.sh@410 -- # return 0 00:24:53.510 04:31:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:53.510 04:31:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:53.510 04:31:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:53.510 04:31:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:53.510 04:31:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:53.510 04:31:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:53.510 04:31:30 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:53.510 04:31:30 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:53.510 04:31:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:53.510 04:31:30 -- common/autotest_common.sh@10 -- # set +x 00:24:53.510 04:31:30 -- host/fio.sh@24 -- # nvmfpid=3987492 00:24:53.510 04:31:30 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:53.510 04:31:30 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:53.510 04:31:30 -- host/fio.sh@28 -- # waitforlisten 3987492 00:24:53.510 04:31:30 -- common/autotest_common.sh@829 -- # '[' -z 3987492 ']' 00:24:53.510 04:31:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:53.510 04:31:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:53.510 04:31:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:53.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:53.510 04:31:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:53.510 04:31:30 -- common/autotest_common.sh@10 -- # set +x 00:24:53.510 [2024-11-28 04:31:30.613852] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:53.510 [2024-11-28 04:31:30.613928] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:53.510 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.510 [2024-11-28 04:31:30.682615] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:53.510 [2024-11-28 04:31:30.794621] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:53.510 [2024-11-28 04:31:30.794774] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:53.510 [2024-11-28 04:31:30.794798] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:53.510 [2024-11-28 04:31:30.794811] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:53.510 [2024-11-28 04:31:30.794862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:53.510 [2024-11-28 04:31:30.794946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:53.510 [2024-11-28 04:31:30.794887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:53.510 [2024-11-28 04:31:30.794949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:54.444 04:31:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:54.444 04:31:31 -- common/autotest_common.sh@862 -- # return 0 00:24:54.444 04:31:31 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:54.701 [2024-11-28 04:31:31.838939] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:54.701 04:31:31 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:54.702 04:31:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:54.702 04:31:31 -- common/autotest_common.sh@10 -- # set +x 00:24:54.702 04:31:31 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:54.959 Malloc1 00:24:54.959 04:31:32 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:55.217 04:31:32 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:55.474 04:31:32 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:55.732 [2024-11-28 04:31:32.895118] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:55.732 04:31:32 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:55.989 04:31:33 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:55.989 04:31:33 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:55.989 04:31:33 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:55.989 04:31:33 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:55.989 04:31:33 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:55.989 04:31:33 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:55.989 04:31:33 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:55.989 04:31:33 -- common/autotest_common.sh@1330 -- # shift 00:24:55.989 04:31:33 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:55.989 04:31:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:55.989 04:31:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:55.989 04:31:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:55.989 04:31:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:55.989 04:31:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:55.989 04:31:33 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:55.989 04:31:33 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:56.247 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:56.247 fio-3.35 00:24:56.247 Starting 1 thread 00:24:56.247 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.771 00:24:58.772 test: (groupid=0, jobs=1): err= 0: pid=3987863: Thu Nov 28 04:31:35 2024 00:24:58.772 read: IOPS=9620, BW=37.6MiB/s (39.4MB/s)(75.4MiB/2006msec) 00:24:58.772 slat (nsec): min=1944, max=154534, avg=2451.50, stdev=1705.89 00:24:58.772 clat (usec): min=2323, max=12637, avg=7349.71, stdev=536.75 00:24:58.772 lat (usec): min=2348, max=12640, avg=7352.16, stdev=536.65 00:24:58.772 clat percentiles (usec): 00:24:58.772 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:24:58.772 | 30.00th=[ 7111], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:24:58.772 | 70.00th=[ 7635], 80.00th=[ 7767], 90.00th=[ 7963], 95.00th=[ 8160], 00:24:58.772 | 99.00th=[ 8586], 99.50th=[ 8586], 99.90th=[10552], 99.95th=[11994], 00:24:58.772 | 99.99th=[12518] 00:24:58.772 bw ( KiB/s): min=37680, max=39128, per=99.89%, avg=38440.00, stdev=617.37, samples=4 00:24:58.772 iops : min= 9420, max= 9782, avg=9610.00, stdev=154.34, samples=4 00:24:58.772 write: IOPS=9620, BW=37.6MiB/s (39.4MB/s)(75.4MiB/2006msec); 0 zone resets 00:24:58.772 slat (usec): min=2, max=137, avg= 2.55, stdev= 1.34 00:24:58.772 clat (usec): min=1383, max=10736, avg=5900.98, stdev=462.36 00:24:58.772 lat (usec): min=1392, max=10739, avg=5903.53, stdev=462.32 00:24:58.772 clat percentiles (usec): 00:24:58.772 | 1.00th=[ 4883], 5.00th=[ 5211], 10.00th=[ 5342], 20.00th=[ 5538], 00:24:58.772 | 30.00th=[ 5669], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 5997], 00:24:58.772 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6456], 95.00th=[ 6587], 00:24:58.772 | 99.00th=[ 6915], 99.50th=[ 7046], 99.90th=[ 8979], 99.95th=[ 9765], 00:24:58.772 | 99.99th=[10683] 00:24:58.772 bw ( KiB/s): min=38280, max=38784, per=100.00%, avg=38498.00, stdev=209.47, samples=4 00:24:58.772 iops : min= 9570, max= 9696, avg=9624.50, stdev=52.37, samples=4 00:24:58.772 lat (msec) : 2=0.02%, 4=0.10%, 10=99.79%, 20=0.09% 00:24:58.772 cpu : usr=64.44%, sys=32.37%, ctx=82, majf=0, minf=41 00:24:58.772 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:58.772 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:58.772 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:58.772 issued rwts: total=19299,19298,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:58.772 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:58.772 00:24:58.772 Run status group 0 (all jobs): 00:24:58.772 READ: bw=37.6MiB/s (39.4MB/s), 37.6MiB/s-37.6MiB/s (39.4MB/s-39.4MB/s), io=75.4MiB (79.0MB), run=2006-2006msec 00:24:58.772 WRITE: bw=37.6MiB/s (39.4MB/s), 37.6MiB/s-37.6MiB/s (39.4MB/s-39.4MB/s), io=75.4MiB (79.0MB), run=2006-2006msec 00:24:58.772 04:31:35 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:58.772 04:31:35 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:58.772 04:31:35 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:58.772 04:31:35 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:58.772 04:31:35 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:58.772 04:31:35 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:58.772 04:31:35 -- common/autotest_common.sh@1330 -- # shift 00:24:58.772 04:31:35 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:58.772 04:31:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:58.772 04:31:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:58.772 04:31:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:58.772 04:31:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:58.772 04:31:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:58.772 04:31:35 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:58.772 04:31:35 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:58.772 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:58.772 fio-3.35 00:24:58.772 Starting 1 thread 00:24:58.772 EAL: No free 2048 kB hugepages reported on node 1 00:25:01.326 00:25:01.326 test: (groupid=0, jobs=1): err= 0: pid=3988325: Thu Nov 28 04:31:38 2024 00:25:01.326 read: IOPS=8450, BW=132MiB/s (138MB/s)(265MiB/2006msec) 00:25:01.326 slat (nsec): min=2731, max=90809, avg=3576.06, stdev=1515.57 00:25:01.326 clat (usec): min=2550, max=17434, avg=8784.28, stdev=2020.59 00:25:01.326 lat (usec): min=2553, max=17437, avg=8787.86, stdev=2020.64 00:25:01.326 clat percentiles (usec): 00:25:01.326 | 1.00th=[ 4621], 5.00th=[ 5604], 10.00th=[ 6259], 20.00th=[ 7046], 00:25:01.326 | 30.00th=[ 7635], 40.00th=[ 8160], 50.00th=[ 8717], 60.00th=[ 9241], 00:25:01.326 | 70.00th=[ 9896], 80.00th=[10552], 90.00th=[11338], 95.00th=[12256], 00:25:01.326 | 99.00th=[13829], 99.50th=[14353], 99.90th=[15664], 99.95th=[16188], 00:25:01.326 | 99.99th=[17433] 00:25:01.326 bw ( KiB/s): min=61056, max=79456, per=51.03%, avg=68992.00, stdev=7725.07, samples=4 00:25:01.326 iops : min= 3816, max= 4966, avg=4312.00, stdev=482.82, samples=4 00:25:01.326 write: IOPS=4986, BW=77.9MiB/s (81.7MB/s)(141MiB/1811msec); 0 zone resets 00:25:01.326 slat (usec): min=30, max=172, avg=33.19, stdev= 5.07 00:25:01.326 clat (usec): min=6066, max=23325, avg=11127.24, stdev=1981.60 00:25:01.326 lat (usec): min=6097, max=23357, avg=11160.43, stdev=1981.83 00:25:01.326 clat percentiles (usec): 00:25:01.326 | 1.00th=[ 7046], 5.00th=[ 8225], 10.00th=[ 8717], 20.00th=[ 9372], 00:25:01.326 | 30.00th=[10028], 40.00th=[10421], 50.00th=[10945], 60.00th=[11469], 00:25:01.326 | 70.00th=[11994], 80.00th=[12780], 90.00th=[13829], 95.00th=[14877], 00:25:01.326 | 99.00th=[16057], 99.50th=[16319], 99.90th=[16909], 99.95th=[17171], 00:25:01.326 | 99.99th=[23200] 00:25:01.326 bw ( KiB/s): min=62720, max=82752, per=90.05%, avg=71848.00, stdev=8364.16, samples=4 00:25:01.326 iops : min= 3920, max= 5172, avg=4490.50, stdev=522.76, samples=4 00:25:01.326 lat (msec) : 4=0.22%, 10=57.32%, 20=42.46%, 50=0.01% 00:25:01.326 cpu : usr=76.11%, sys=21.70%, ctx=39, majf=0, minf=70 00:25:01.326 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:25:01.326 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:01.326 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:01.326 issued rwts: total=16952,9031,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:01.326 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:01.326 00:25:01.326 Run status group 0 (all jobs): 00:25:01.326 READ: bw=132MiB/s (138MB/s), 132MiB/s-132MiB/s (138MB/s-138MB/s), io=265MiB (278MB), run=2006-2006msec 00:25:01.326 WRITE: bw=77.9MiB/s (81.7MB/s), 77.9MiB/s-77.9MiB/s (81.7MB/s-81.7MB/s), io=141MiB (148MB), run=1811-1811msec 00:25:01.326 04:31:38 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:01.326 04:31:38 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:01.326 04:31:38 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:01.326 04:31:38 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:01.326 04:31:38 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:01.326 04:31:38 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:01.326 04:31:38 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:01.326 04:31:38 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:01.326 04:31:38 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:01.326 04:31:38 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:01.326 04:31:38 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:01.326 04:31:38 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:04.607 Nvme0n1 00:25:04.607 04:31:41 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:07.215 04:31:44 -- host/fio.sh@53 -- # ls_guid=a1d11fb4-0c3b-413c-83db-427d859636aa 00:25:07.216 04:31:44 -- host/fio.sh@54 -- # get_lvs_free_mb a1d11fb4-0c3b-413c-83db-427d859636aa 00:25:07.216 04:31:44 -- common/autotest_common.sh@1353 -- # local lvs_uuid=a1d11fb4-0c3b-413c-83db-427d859636aa 00:25:07.216 04:31:44 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:07.216 04:31:44 -- common/autotest_common.sh@1355 -- # local fc 00:25:07.216 04:31:44 -- common/autotest_common.sh@1356 -- # local cs 00:25:07.216 04:31:44 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:07.782 04:31:44 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:07.782 { 00:25:07.782 "uuid": "a1d11fb4-0c3b-413c-83db-427d859636aa", 00:25:07.782 "name": "lvs_0", 00:25:07.782 "base_bdev": "Nvme0n1", 00:25:07.782 "total_data_clusters": 930, 00:25:07.782 "free_clusters": 930, 00:25:07.782 "block_size": 512, 00:25:07.782 "cluster_size": 1073741824 00:25:07.782 } 00:25:07.782 ]' 00:25:07.782 04:31:44 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="a1d11fb4-0c3b-413c-83db-427d859636aa") .free_clusters' 00:25:07.782 04:31:44 -- common/autotest_common.sh@1358 -- # fc=930 00:25:07.782 04:31:44 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="a1d11fb4-0c3b-413c-83db-427d859636aa") .cluster_size' 00:25:07.782 04:31:44 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:07.782 04:31:44 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:07.782 04:31:44 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:07.782 952320 00:25:07.782 04:31:44 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:08.046 3ea4d241-4da8-4d0c-9112-403f2949aee4 00:25:08.046 04:31:45 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:08.302 04:31:45 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:08.560 04:31:45 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:08.818 04:31:46 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:08.818 04:31:46 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:08.818 04:31:46 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:08.818 04:31:46 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:08.818 04:31:46 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:08.818 04:31:46 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.818 04:31:46 -- common/autotest_common.sh@1330 -- # shift 00:25:08.818 04:31:46 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:08.818 04:31:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:08.818 04:31:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:08.818 04:31:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:08.818 04:31:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:08.818 04:31:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:08.818 04:31:46 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:08.818 04:31:46 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.075 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:09.076 fio-3.35 00:25:09.076 Starting 1 thread 00:25:09.076 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.602 00:25:11.602 test: (groupid=0, jobs=1): err= 0: pid=3989649: Thu Nov 28 04:31:48 2024 00:25:11.602 read: IOPS=6503, BW=25.4MiB/s (26.6MB/s)(51.0MiB/2007msec) 00:25:11.602 slat (nsec): min=1862, max=166331, avg=2434.98, stdev=2016.69 00:25:11.602 clat (usec): min=1013, max=170701, avg=10816.01, stdev=11227.78 00:25:11.602 lat (usec): min=1016, max=170735, avg=10818.45, stdev=11228.06 00:25:11.602 clat percentiles (msec): 00:25:11.602 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:11.602 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:11.602 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:11.602 | 99.00th=[ 12], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:11.602 | 99.99th=[ 171] 00:25:11.602 bw ( KiB/s): min=18360, max=28696, per=99.78%, avg=25956.00, stdev=5066.96, samples=4 00:25:11.602 iops : min= 4590, max= 7174, avg=6489.00, stdev=1266.74, samples=4 00:25:11.602 write: IOPS=6510, BW=25.4MiB/s (26.7MB/s)(51.0MiB/2007msec); 0 zone resets 00:25:11.602 slat (nsec): min=2014, max=92085, avg=2539.17, stdev=1239.60 00:25:11.602 clat (usec): min=312, max=168965, avg=8722.89, stdev=10523.82 00:25:11.602 lat (usec): min=315, max=168971, avg=8725.43, stdev=10524.03 00:25:11.602 clat percentiles (msec): 00:25:11.602 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:11.602 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:11.602 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:25:11.602 | 99.00th=[ 10], 99.50th=[ 14], 99.90th=[ 169], 99.95th=[ 169], 00:25:11.602 | 99.99th=[ 169] 00:25:11.602 bw ( KiB/s): min=19368, max=28480, per=99.94%, avg=26026.00, stdev=4442.46, samples=4 00:25:11.602 iops : min= 4842, max= 7120, avg=6506.50, stdev=1110.61, samples=4 00:25:11.602 lat (usec) : 500=0.01%, 750=0.01% 00:25:11.602 lat (msec) : 2=0.04%, 4=0.16%, 10=73.75%, 20=25.55%, 250=0.49% 00:25:11.602 cpu : usr=62.51%, sys=34.95%, ctx=112, majf=0, minf=41 00:25:11.602 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:11.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:11.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:11.602 issued rwts: total=13052,13066,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:11.602 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:11.602 00:25:11.602 Run status group 0 (all jobs): 00:25:11.602 READ: bw=25.4MiB/s (26.6MB/s), 25.4MiB/s-25.4MiB/s (26.6MB/s-26.6MB/s), io=51.0MiB (53.5MB), run=2007-2007msec 00:25:11.602 WRITE: bw=25.4MiB/s (26.7MB/s), 25.4MiB/s-25.4MiB/s (26.7MB/s-26.7MB/s), io=51.0MiB (53.5MB), run=2007-2007msec 00:25:11.602 04:31:48 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:11.860 04:31:48 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:12.790 04:31:50 -- host/fio.sh@64 -- # ls_nested_guid=106f5fd0-9bc2-4868-8326-8b508e605caa 00:25:12.790 04:31:50 -- host/fio.sh@65 -- # get_lvs_free_mb 106f5fd0-9bc2-4868-8326-8b508e605caa 00:25:12.790 04:31:50 -- common/autotest_common.sh@1353 -- # local lvs_uuid=106f5fd0-9bc2-4868-8326-8b508e605caa 00:25:12.790 04:31:50 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:12.790 04:31:50 -- common/autotest_common.sh@1355 -- # local fc 00:25:12.790 04:31:50 -- common/autotest_common.sh@1356 -- # local cs 00:25:12.790 04:31:50 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:13.046 04:31:50 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:13.046 { 00:25:13.046 "uuid": "a1d11fb4-0c3b-413c-83db-427d859636aa", 00:25:13.046 "name": "lvs_0", 00:25:13.046 "base_bdev": "Nvme0n1", 00:25:13.046 "total_data_clusters": 930, 00:25:13.046 "free_clusters": 0, 00:25:13.046 "block_size": 512, 00:25:13.046 "cluster_size": 1073741824 00:25:13.046 }, 00:25:13.046 { 00:25:13.046 "uuid": "106f5fd0-9bc2-4868-8326-8b508e605caa", 00:25:13.046 "name": "lvs_n_0", 00:25:13.046 "base_bdev": "3ea4d241-4da8-4d0c-9112-403f2949aee4", 00:25:13.046 "total_data_clusters": 237847, 00:25:13.046 "free_clusters": 237847, 00:25:13.046 "block_size": 512, 00:25:13.046 "cluster_size": 4194304 00:25:13.046 } 00:25:13.046 ]' 00:25:13.046 04:31:50 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="106f5fd0-9bc2-4868-8326-8b508e605caa") .free_clusters' 00:25:13.304 04:31:50 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:13.304 04:31:50 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="106f5fd0-9bc2-4868-8326-8b508e605caa") .cluster_size' 00:25:13.304 04:31:50 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:13.304 04:31:50 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:13.304 04:31:50 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:13.304 951388 00:25:13.304 04:31:50 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:13.868 8a496793-0724-4ac9-8663-293017844e06 00:25:13.868 04:31:51 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:14.125 04:31:51 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:14.383 04:31:51 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:14.641 04:31:51 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:14.641 04:31:51 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:14.641 04:31:51 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:14.641 04:31:51 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:14.641 04:31:51 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:14.641 04:31:51 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:14.641 04:31:51 -- common/autotest_common.sh@1330 -- # shift 00:25:14.641 04:31:51 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:14.641 04:31:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:14.641 04:31:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:14.642 04:31:51 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:14.642 04:31:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:14.642 04:31:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:14.642 04:31:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:14.642 04:31:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:14.642 04:31:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:14.642 04:31:51 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:14.642 04:31:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:14.642 04:31:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:14.642 04:31:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:14.642 04:31:51 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:14.642 04:31:51 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:14.899 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:14.899 fio-3.35 00:25:14.899 Starting 1 thread 00:25:14.899 EAL: No free 2048 kB hugepages reported on node 1 00:25:17.423 00:25:17.423 test: (groupid=0, jobs=1): err= 0: pid=3990411: Thu Nov 28 04:31:54 2024 00:25:17.423 read: IOPS=6059, BW=23.7MiB/s (24.8MB/s)(47.5MiB/2008msec) 00:25:17.423 slat (nsec): min=1912, max=146458, avg=2462.08, stdev=1967.07 00:25:17.423 clat (usec): min=4379, max=19218, avg=11689.63, stdev=1003.77 00:25:17.423 lat (usec): min=4384, max=19221, avg=11692.09, stdev=1003.68 00:25:17.423 clat percentiles (usec): 00:25:17.423 | 1.00th=[ 9372], 5.00th=[10159], 10.00th=[10552], 20.00th=[10945], 00:25:17.423 | 30.00th=[11207], 40.00th=[11469], 50.00th=[11731], 60.00th=[11994], 00:25:17.423 | 70.00th=[12125], 80.00th=[12518], 90.00th=[12911], 95.00th=[13173], 00:25:17.423 | 99.00th=[13960], 99.50th=[14222], 99.90th=[17957], 99.95th=[18220], 00:25:17.423 | 99.99th=[19268] 00:25:17.423 bw ( KiB/s): min=23024, max=24704, per=99.75%, avg=24176.00, stdev=774.75, samples=4 00:25:17.423 iops : min= 5756, max= 6176, avg=6044.00, stdev=193.69, samples=4 00:25:17.423 write: IOPS=6037, BW=23.6MiB/s (24.7MB/s)(47.4MiB/2008msec); 0 zone resets 00:25:17.423 slat (nsec): min=2033, max=95615, avg=2565.97, stdev=1392.64 00:25:17.423 clat (usec): min=2184, max=16843, avg=9328.54, stdev=863.91 00:25:17.423 lat (usec): min=2189, max=16845, avg=9331.11, stdev=863.90 00:25:17.423 clat percentiles (usec): 00:25:17.423 | 1.00th=[ 7373], 5.00th=[ 8029], 10.00th=[ 8291], 20.00th=[ 8717], 00:25:17.423 | 30.00th=[ 8979], 40.00th=[ 9110], 50.00th=[ 9372], 60.00th=[ 9503], 00:25:17.423 | 70.00th=[ 9765], 80.00th=[10028], 90.00th=[10290], 95.00th=[10552], 00:25:17.423 | 99.00th=[11207], 99.50th=[11469], 99.90th=[15270], 99.95th=[16188], 00:25:17.423 | 99.99th=[16909] 00:25:17.423 bw ( KiB/s): min=23960, max=24320, per=99.99%, avg=24150.00, stdev=166.97, samples=4 00:25:17.423 iops : min= 5990, max= 6080, avg=6037.50, stdev=41.74, samples=4 00:25:17.423 lat (msec) : 4=0.05%, 10=41.88%, 20=58.08% 00:25:17.423 cpu : usr=60.89%, sys=36.77%, ctx=108, majf=0, minf=41 00:25:17.423 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:17.423 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:17.423 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:17.423 issued rwts: total=12167,12124,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:17.423 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:17.423 00:25:17.423 Run status group 0 (all jobs): 00:25:17.423 READ: bw=23.7MiB/s (24.8MB/s), 23.7MiB/s-23.7MiB/s (24.8MB/s-24.8MB/s), io=47.5MiB (49.8MB), run=2008-2008msec 00:25:17.423 WRITE: bw=23.6MiB/s (24.7MB/s), 23.6MiB/s-23.6MiB/s (24.7MB/s-24.7MB/s), io=47.4MiB (49.7MB), run=2008-2008msec 00:25:17.423 04:31:54 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:17.681 04:31:54 -- host/fio.sh@74 -- # sync 00:25:17.681 04:31:54 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:21.864 04:31:58 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:21.864 04:31:58 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:25.141 04:32:01 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:25.141 04:32:02 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:27.038 04:32:04 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:27.038 04:32:04 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:27.038 04:32:04 -- host/fio.sh@86 -- # nvmftestfini 00:25:27.038 04:32:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:27.038 04:32:04 -- nvmf/common.sh@116 -- # sync 00:25:27.038 04:32:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:27.038 04:32:04 -- nvmf/common.sh@119 -- # set +e 00:25:27.038 04:32:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:27.038 04:32:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:27.038 rmmod nvme_tcp 00:25:27.038 rmmod nvme_fabrics 00:25:27.038 rmmod nvme_keyring 00:25:27.038 04:32:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:27.038 04:32:04 -- nvmf/common.sh@123 -- # set -e 00:25:27.038 04:32:04 -- nvmf/common.sh@124 -- # return 0 00:25:27.038 04:32:04 -- nvmf/common.sh@477 -- # '[' -n 3987492 ']' 00:25:27.038 04:32:04 -- nvmf/common.sh@478 -- # killprocess 3987492 00:25:27.038 04:32:04 -- common/autotest_common.sh@936 -- # '[' -z 3987492 ']' 00:25:27.038 04:32:04 -- common/autotest_common.sh@940 -- # kill -0 3987492 00:25:27.038 04:32:04 -- common/autotest_common.sh@941 -- # uname 00:25:27.038 04:32:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:27.038 04:32:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3987492 00:25:27.038 04:32:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:27.038 04:32:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:27.038 04:32:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3987492' 00:25:27.038 killing process with pid 3987492 00:25:27.038 04:32:04 -- common/autotest_common.sh@955 -- # kill 3987492 00:25:27.038 04:32:04 -- common/autotest_common.sh@960 -- # wait 3987492 00:25:27.297 04:32:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:27.297 04:32:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:27.297 04:32:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:27.297 04:32:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:27.297 04:32:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:27.297 04:32:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:27.297 04:32:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:27.297 04:32:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:29.199 04:32:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:29.199 00:25:29.199 real 0m38.311s 00:25:29.199 user 2m26.556s 00:25:29.199 sys 0m7.000s 00:25:29.199 04:32:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:29.199 04:32:06 -- common/autotest_common.sh@10 -- # set +x 00:25:29.199 ************************************ 00:25:29.199 END TEST nvmf_fio_host 00:25:29.199 ************************************ 00:25:29.199 04:32:06 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:29.199 04:32:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:29.199 04:32:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:29.199 04:32:06 -- common/autotest_common.sh@10 -- # set +x 00:25:29.199 ************************************ 00:25:29.199 START TEST nvmf_failover 00:25:29.199 ************************************ 00:25:29.199 04:32:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:29.199 * Looking for test storage... 00:25:29.199 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:29.199 04:32:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:29.199 04:32:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:29.199 04:32:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:29.457 04:32:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:29.458 04:32:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:29.458 04:32:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:29.458 04:32:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:29.458 04:32:06 -- scripts/common.sh@335 -- # IFS=.-: 00:25:29.458 04:32:06 -- scripts/common.sh@335 -- # read -ra ver1 00:25:29.458 04:32:06 -- scripts/common.sh@336 -- # IFS=.-: 00:25:29.458 04:32:06 -- scripts/common.sh@336 -- # read -ra ver2 00:25:29.458 04:32:06 -- scripts/common.sh@337 -- # local 'op=<' 00:25:29.458 04:32:06 -- scripts/common.sh@339 -- # ver1_l=2 00:25:29.458 04:32:06 -- scripts/common.sh@340 -- # ver2_l=1 00:25:29.458 04:32:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:29.458 04:32:06 -- scripts/common.sh@343 -- # case "$op" in 00:25:29.458 04:32:06 -- scripts/common.sh@344 -- # : 1 00:25:29.458 04:32:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:29.458 04:32:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:29.458 04:32:06 -- scripts/common.sh@364 -- # decimal 1 00:25:29.458 04:32:06 -- scripts/common.sh@352 -- # local d=1 00:25:29.458 04:32:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:29.458 04:32:06 -- scripts/common.sh@354 -- # echo 1 00:25:29.458 04:32:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:29.458 04:32:06 -- scripts/common.sh@365 -- # decimal 2 00:25:29.458 04:32:06 -- scripts/common.sh@352 -- # local d=2 00:25:29.458 04:32:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:29.458 04:32:06 -- scripts/common.sh@354 -- # echo 2 00:25:29.458 04:32:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:29.458 04:32:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:29.458 04:32:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:29.458 04:32:06 -- scripts/common.sh@367 -- # return 0 00:25:29.458 04:32:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:29.458 04:32:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:29.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:29.458 --rc genhtml_branch_coverage=1 00:25:29.458 --rc genhtml_function_coverage=1 00:25:29.458 --rc genhtml_legend=1 00:25:29.458 --rc geninfo_all_blocks=1 00:25:29.458 --rc geninfo_unexecuted_blocks=1 00:25:29.458 00:25:29.458 ' 00:25:29.458 04:32:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:29.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:29.458 --rc genhtml_branch_coverage=1 00:25:29.458 --rc genhtml_function_coverage=1 00:25:29.458 --rc genhtml_legend=1 00:25:29.458 --rc geninfo_all_blocks=1 00:25:29.458 --rc geninfo_unexecuted_blocks=1 00:25:29.458 00:25:29.458 ' 00:25:29.458 04:32:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:29.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:29.458 --rc genhtml_branch_coverage=1 00:25:29.458 --rc genhtml_function_coverage=1 00:25:29.458 --rc genhtml_legend=1 00:25:29.458 --rc geninfo_all_blocks=1 00:25:29.458 --rc geninfo_unexecuted_blocks=1 00:25:29.458 00:25:29.458 ' 00:25:29.458 04:32:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:29.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:29.458 --rc genhtml_branch_coverage=1 00:25:29.458 --rc genhtml_function_coverage=1 00:25:29.458 --rc genhtml_legend=1 00:25:29.458 --rc geninfo_all_blocks=1 00:25:29.458 --rc geninfo_unexecuted_blocks=1 00:25:29.458 00:25:29.458 ' 00:25:29.458 04:32:06 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:29.458 04:32:06 -- nvmf/common.sh@7 -- # uname -s 00:25:29.458 04:32:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:29.458 04:32:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:29.458 04:32:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:29.458 04:32:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:29.458 04:32:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:29.458 04:32:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:29.458 04:32:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:29.458 04:32:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:29.458 04:32:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:29.458 04:32:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:29.458 04:32:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:29.458 04:32:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:29.458 04:32:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:29.458 04:32:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:29.458 04:32:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:29.458 04:32:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:29.458 04:32:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:29.458 04:32:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:29.458 04:32:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:29.458 04:32:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.458 04:32:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.458 04:32:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.458 04:32:06 -- paths/export.sh@5 -- # export PATH 00:25:29.458 04:32:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.458 04:32:06 -- nvmf/common.sh@46 -- # : 0 00:25:29.458 04:32:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:29.458 04:32:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:29.458 04:32:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:29.458 04:32:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:29.458 04:32:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:29.458 04:32:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:29.458 04:32:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:29.458 04:32:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:29.458 04:32:06 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:29.458 04:32:06 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:29.458 04:32:06 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:29.459 04:32:06 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:29.459 04:32:06 -- host/failover.sh@18 -- # nvmftestinit 00:25:29.459 04:32:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:29.459 04:32:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:29.459 04:32:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:29.459 04:32:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:29.459 04:32:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:29.459 04:32:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:29.459 04:32:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:29.459 04:32:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:29.459 04:32:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:29.459 04:32:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:29.459 04:32:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:29.459 04:32:06 -- common/autotest_common.sh@10 -- # set +x 00:25:31.360 04:32:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:31.360 04:32:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:31.360 04:32:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:31.360 04:32:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:31.360 04:32:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:31.360 04:32:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:31.360 04:32:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:31.360 04:32:08 -- nvmf/common.sh@294 -- # net_devs=() 00:25:31.360 04:32:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:31.360 04:32:08 -- nvmf/common.sh@295 -- # e810=() 00:25:31.360 04:32:08 -- nvmf/common.sh@295 -- # local -ga e810 00:25:31.360 04:32:08 -- nvmf/common.sh@296 -- # x722=() 00:25:31.360 04:32:08 -- nvmf/common.sh@296 -- # local -ga x722 00:25:31.360 04:32:08 -- nvmf/common.sh@297 -- # mlx=() 00:25:31.360 04:32:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:31.360 04:32:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:31.360 04:32:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:31.360 04:32:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:31.360 04:32:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:31.360 04:32:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:31.360 04:32:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:31.360 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:31.360 04:32:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:31.360 04:32:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:31.360 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:31.360 04:32:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:31.360 04:32:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:31.360 04:32:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:31.360 04:32:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:31.360 04:32:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:31.360 04:32:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:31.360 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:31.360 04:32:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:31.360 04:32:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:31.360 04:32:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:31.360 04:32:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:31.360 04:32:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:31.360 04:32:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:31.360 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:31.360 04:32:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:31.360 04:32:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:31.360 04:32:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:31.360 04:32:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:31.360 04:32:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:31.360 04:32:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:31.360 04:32:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:31.360 04:32:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:31.360 04:32:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:31.360 04:32:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:31.360 04:32:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:31.360 04:32:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:31.360 04:32:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:31.360 04:32:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:31.360 04:32:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:31.360 04:32:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:31.360 04:32:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:31.360 04:32:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:31.619 04:32:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:31.619 04:32:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:31.619 04:32:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:31.619 04:32:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:31.619 04:32:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:31.619 04:32:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:31.619 04:32:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:31.619 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:31.619 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:25:31.619 00:25:31.619 --- 10.0.0.2 ping statistics --- 00:25:31.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:31.620 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:25:31.620 04:32:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:31.620 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:31.620 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:25:31.620 00:25:31.620 --- 10.0.0.1 ping statistics --- 00:25:31.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:31.620 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:25:31.620 04:32:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:31.620 04:32:08 -- nvmf/common.sh@410 -- # return 0 00:25:31.620 04:32:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:31.620 04:32:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:31.620 04:32:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:31.620 04:32:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:31.620 04:32:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:31.620 04:32:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:31.620 04:32:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:31.620 04:32:08 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:31.620 04:32:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:31.620 04:32:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:31.620 04:32:08 -- common/autotest_common.sh@10 -- # set +x 00:25:31.620 04:32:08 -- nvmf/common.sh@469 -- # nvmfpid=3993835 00:25:31.620 04:32:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:31.620 04:32:08 -- nvmf/common.sh@470 -- # waitforlisten 3993835 00:25:31.620 04:32:08 -- common/autotest_common.sh@829 -- # '[' -z 3993835 ']' 00:25:31.620 04:32:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:31.620 04:32:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:31.620 04:32:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:31.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:31.620 04:32:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:31.620 04:32:08 -- common/autotest_common.sh@10 -- # set +x 00:25:31.620 [2024-11-28 04:32:08.846698] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:31.620 [2024-11-28 04:32:08.846789] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:31.620 EAL: No free 2048 kB hugepages reported on node 1 00:25:31.620 [2024-11-28 04:32:08.913675] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:31.879 [2024-11-28 04:32:09.024446] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:31.879 [2024-11-28 04:32:09.024602] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:31.879 [2024-11-28 04:32:09.024621] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:31.879 [2024-11-28 04:32:09.024634] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:31.879 [2024-11-28 04:32:09.024687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:31.879 [2024-11-28 04:32:09.024739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:31.879 [2024-11-28 04:32:09.024743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:32.811 04:32:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:32.811 04:32:09 -- common/autotest_common.sh@862 -- # return 0 00:25:32.811 04:32:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:32.811 04:32:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:32.811 04:32:09 -- common/autotest_common.sh@10 -- # set +x 00:25:32.811 04:32:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:32.811 04:32:09 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:32.811 [2024-11-28 04:32:10.092773] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:32.811 04:32:10 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:33.069 Malloc0 00:25:33.326 04:32:10 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:33.585 04:32:10 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:33.843 04:32:10 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:34.100 [2024-11-28 04:32:11.161285] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:34.100 04:32:11 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:34.358 [2024-11-28 04:32:11.414077] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:34.358 04:32:11 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:34.616 [2024-11-28 04:32:11.670954] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:34.616 04:32:11 -- host/failover.sh@31 -- # bdevperf_pid=3994148 00:25:34.616 04:32:11 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:34.616 04:32:11 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:34.616 04:32:11 -- host/failover.sh@34 -- # waitforlisten 3994148 /var/tmp/bdevperf.sock 00:25:34.616 04:32:11 -- common/autotest_common.sh@829 -- # '[' -z 3994148 ']' 00:25:34.616 04:32:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:34.616 04:32:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:34.616 04:32:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:34.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:34.616 04:32:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:34.616 04:32:11 -- common/autotest_common.sh@10 -- # set +x 00:25:35.574 04:32:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:35.574 04:32:12 -- common/autotest_common.sh@862 -- # return 0 00:25:35.574 04:32:12 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:36.139 NVMe0n1 00:25:36.139 04:32:13 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:36.396 00:25:36.396 04:32:13 -- host/failover.sh@39 -- # run_test_pid=3994418 00:25:36.396 04:32:13 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:36.396 04:32:13 -- host/failover.sh@41 -- # sleep 1 00:25:37.825 04:32:14 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:37.825 [2024-11-28 04:32:14.908377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.908990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.825 [2024-11-28 04:32:14.909259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.826 [2024-11-28 04:32:14.909270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfbcb0 is same with the state(5) to be set 00:25:37.826 04:32:14 -- host/failover.sh@45 -- # sleep 3 00:25:41.129 04:32:17 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:41.129 00:25:41.129 04:32:18 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:41.388 [2024-11-28 04:32:18.675897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.675952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.675983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.675994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.388 [2024-11-28 04:32:18.676432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd3a0 is same with the state(5) to be set 00:25:41.646 04:32:18 -- host/failover.sh@50 -- # sleep 3 00:25:44.930 04:32:21 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:44.930 [2024-11-28 04:32:21.942860] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:44.930 04:32:21 -- host/failover.sh@55 -- # sleep 1 00:25:45.869 04:32:22 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:46.128 [2024-11-28 04:32:23.237622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.128 [2024-11-28 04:32:23.237973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.237984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 [2024-11-28 04:32:23.238731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfda80 is same with the state(5) to be set 00:25:46.129 04:32:23 -- host/failover.sh@59 -- # wait 3994418 00:25:52.708 0 00:25:52.708 04:32:28 -- host/failover.sh@61 -- # killprocess 3994148 00:25:52.708 04:32:28 -- common/autotest_common.sh@936 -- # '[' -z 3994148 ']' 00:25:52.708 04:32:28 -- common/autotest_common.sh@940 -- # kill -0 3994148 00:25:52.708 04:32:28 -- common/autotest_common.sh@941 -- # uname 00:25:52.708 04:32:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:52.708 04:32:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3994148 00:25:52.708 04:32:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:52.708 04:32:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:52.708 04:32:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3994148' 00:25:52.708 killing process with pid 3994148 00:25:52.708 04:32:28 -- common/autotest_common.sh@955 -- # kill 3994148 00:25:52.708 04:32:28 -- common/autotest_common.sh@960 -- # wait 3994148 00:25:52.708 04:32:29 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:52.708 [2024-11-28 04:32:11.726944] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:52.708 [2024-11-28 04:32:11.727028] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3994148 ] 00:25:52.708 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.708 [2024-11-28 04:32:11.785179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:52.708 [2024-11-28 04:32:11.892839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:52.708 Running I/O for 15 seconds... 00:25:52.708 [2024-11-28 04:32:14.909586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.708 [2024-11-28 04:32:14.909628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.708 [2024-11-28 04:32:14.909658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:118576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.708 [2024-11-28 04:32:14.909674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.708 [2024-11-28 04:32:14.909691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.708 [2024-11-28 04:32:14.909706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:118072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:118128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:118136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.909982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.909997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:118616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:118184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:118656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.709 [2024-11-28 04:32:14.910490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.709 [2024-11-28 04:32:14.910504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:118824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.710 [2024-11-28 04:32:14.910642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:118832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:118840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.710 [2024-11-28 04:32:14.910704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:118264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.910956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:118856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.710 [2024-11-28 04:32:14.910984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.910998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:118880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.710 [2024-11-28 04:32:14.911079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:118888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.710 [2024-11-28 04:32:14.911116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.710 [2024-11-28 04:32:14.911365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.710 [2024-11-28 04:32:14.911380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.911393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:118912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:118920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.911459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:118928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.911491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:118936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:118944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.911588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:118960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:118968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:118976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:118984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:118992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:119000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:119008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:119016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.911816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:119024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:119032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:119048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.911931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:119056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.911974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:119064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.911993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.711 [2024-11-28 04:32:14.912223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.711 [2024-11-28 04:32:14.912238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:119072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.711 [2024-11-28 04:32:14.912252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:118568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:118624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:118648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:118672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:119080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:119088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:119104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:119112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:119144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:119152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:119160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:119168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:119176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:119184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:119192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.912932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:119200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.912976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:119208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.912989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.913004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:119216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.913018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.913033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:119224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.913046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.913061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:119232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.712 [2024-11-28 04:32:14.913075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.913089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:119240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.913103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.712 [2024-11-28 04:32:14.913117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:119248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.712 [2024-11-28 04:32:14.913130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:118680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:14.913159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:118696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:14.913186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:118720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:14.913214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:14.913251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:14.913283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:14.913316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:118808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:14.913343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca86a0 is same with the state(5) to be set 00:25:52.713 [2024-11-28 04:32:14.913375] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:52.713 [2024-11-28 04:32:14.913386] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:52.713 [2024-11-28 04:32:14.913401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118816 len:8 PRP1 0x0 PRP2 0x0 00:25:52.713 [2024-11-28 04:32:14.913414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913474] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ca86a0 was disconnected and freed. reset controller. 00:25:52.713 [2024-11-28 04:32:14.913498] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:52.713 [2024-11-28 04:32:14.913551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.713 [2024-11-28 04:32:14.913571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913585] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.713 [2024-11-28 04:32:14.913598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.713 [2024-11-28 04:32:14.913629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.713 [2024-11-28 04:32:14.913655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:14.913668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:52.713 [2024-11-28 04:32:14.915917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:52.713 [2024-11-28 04:32:14.915955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c89870 (9): Bad file descriptor 00:25:52.713 [2024-11-28 04:32:14.947520] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:52.713 [2024-11-28 04:32:18.676594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:129576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:129600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:129624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:129632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:129648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:129672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:129680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:129688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:129696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:129704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:129720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.676986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:129736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.676999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.677014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:129760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.713 [2024-11-28 04:32:18.677027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.713 [2024-11-28 04:32:18.677041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:129768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:129776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:129784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:128960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:128976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:128992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:129000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:129024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:129040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:129064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:129088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:129096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:129112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:129136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:129168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:129176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:129248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:129272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:129280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:129808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:129832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.714 [2024-11-28 04:32:18.677654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:129840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:129848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.714 [2024-11-28 04:32:18.677710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.714 [2024-11-28 04:32:18.677725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:129856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.677738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:129296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:129304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:129360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:129368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:129424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:129432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:129440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:129448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.677985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.677999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:129864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:129872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.678039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:129880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.678066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:129888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:129896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:129904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:129912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:129920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:129928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:129936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:129944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:129952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.678317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:129960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:129968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:129976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:129984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.678424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:129992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.678451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:130000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.678478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:130008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.715 [2024-11-28 04:32:18.678519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:130016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.715 [2024-11-28 04:32:18.678593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:130024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.715 [2024-11-28 04:32:18.678606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:130032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.678634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:130040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.678661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:130048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.678689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:130056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:129456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:129464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:129496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:129504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:129512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:129520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:129528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:129552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:130064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.678981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.678995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:130072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:130080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:130088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:130096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:130104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:130112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:130120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:130128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:130136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:130144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:130152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:130160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:130168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:130176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.716 [2024-11-28 04:32:18.679363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:130184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:130192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.716 [2024-11-28 04:32:18.679431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:130200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.716 [2024-11-28 04:32:18.679444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:130208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:130216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:130224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:130232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:130240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:130248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:130256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:130264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:130272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:130280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:130288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:130296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:130304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:130312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:130320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:130328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.717 [2024-11-28 04:32:18.679934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:129568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.679978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:129584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.679991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:129592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:129608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:129616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:129640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:129656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:129664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:129712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:129728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:129744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:129752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:129792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.717 [2024-11-28 04:32:18.680294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.717 [2024-11-28 04:32:18.680308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:129800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:18.680320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:18.680335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:129816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:18.680351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:18.680366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c95d10 is same with the state(5) to be set 00:25:52.718 [2024-11-28 04:32:18.680382] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:52.718 [2024-11-28 04:32:18.680393] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:52.718 [2024-11-28 04:32:18.680405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:129824 len:8 PRP1 0x0 PRP2 0x0 00:25:52.718 [2024-11-28 04:32:18.680417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:18.680478] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c95d10 was disconnected and freed. reset controller. 00:25:52.718 [2024-11-28 04:32:18.680512] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:52.718 [2024-11-28 04:32:18.680566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.718 [2024-11-28 04:32:18.680586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:18.680601] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.718 [2024-11-28 04:32:18.680614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:18.680628] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.718 [2024-11-28 04:32:18.680641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:18.680654] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.718 [2024-11-28 04:32:18.680667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:18.680680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:52.718 [2024-11-28 04:32:18.680718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c89870 (9): Bad file descriptor 00:25:52.718 [2024-11-28 04:32:18.682874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:52.718 [2024-11-28 04:32:18.796724] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:52.718 [2024-11-28 04:32:23.238858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:123064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.238900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.238930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:123080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.238946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.238963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:122488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.238977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.238992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:122496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:122512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:122520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:122536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:122584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:122592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:123088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:123096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:123104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:123120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:123144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:123160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:123168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.718 [2024-11-28 04:32:23.239415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.718 [2024-11-28 04:32:23.239429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:123176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:122600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:122640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:122648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:122688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:122696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:122720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:122736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:122752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:123192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:123200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:123216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:123248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:123264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:123272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.719 [2024-11-28 04:32:23.239889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:123280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.719 [2024-11-28 04:32:23.239916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:123288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:123296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.719 [2024-11-28 04:32:23.239970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.239984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:122776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.239997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:122824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:122840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:122856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:122872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:122880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:122896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:123304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.719 [2024-11-28 04:32:23.240217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:123312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.719 [2024-11-28 04:32:23.240244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:123320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.719 [2024-11-28 04:32:23.240270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.719 [2024-11-28 04:32:23.240284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:123328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:123336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:123344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:123352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:123360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:123368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:123376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:123384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:123392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:123400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:123408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:123416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:123424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:123432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:123440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:123448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:123456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.720 [2024-11-28 04:32:23.240763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:123464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:123472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:122936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:122960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:122992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:123016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.720 [2024-11-28 04:32:23.240965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:123024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.720 [2024-11-28 04:32:23.240978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.240992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:123032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:123072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:123112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:123480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:123488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:123496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:123504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:123512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:123520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:123528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:123536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:123544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:123552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:123560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:123568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:123576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:123584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:123592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:123600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:123608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:123616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:123624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:123632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:123640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:123648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.721 [2024-11-28 04:32:23.241691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:123656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:123664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:123672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.721 [2024-11-28 04:32:23.241789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:123680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.721 [2024-11-28 04:32:23.241802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.241817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:123688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.241832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.241848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:123696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.241861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.241876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:123704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.241889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.241904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:123712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.241917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.241932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:123720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.241949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.241964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:123728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.241978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.241993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:123736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.242006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:123744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.242035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:123752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.242063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:123760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.242091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:123768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:123776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.242148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:123784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:123792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.242215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:123800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:123808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:123816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:52.722 [2024-11-28 04:32:23.242299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:123824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:123832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:123840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:123136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:123152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:123184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:123208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:123224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:123232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:123240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:52.722 [2024-11-28 04:32:23.242611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.722 [2024-11-28 04:32:23.242625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cac630 is same with the state(5) to be set 00:25:52.722 [2024-11-28 04:32:23.242642] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:52.722 [2024-11-28 04:32:23.242653] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:52.722 [2024-11-28 04:32:23.242666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123256 len:8 PRP1 0x0 PRP2 0x0 00:25:52.722 [2024-11-28 04:32:23.242679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.723 [2024-11-28 04:32:23.242741] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1cac630 was disconnected and freed. reset controller. 00:25:52.723 [2024-11-28 04:32:23.242764] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:52.723 [2024-11-28 04:32:23.242799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.723 [2024-11-28 04:32:23.242817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.723 [2024-11-28 04:32:23.242843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.723 [2024-11-28 04:32:23.242857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.723 [2024-11-28 04:32:23.242870] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.723 [2024-11-28 04:32:23.242882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.723 [2024-11-28 04:32:23.242896] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:52.723 [2024-11-28 04:32:23.242908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:52.723 [2024-11-28 04:32:23.242922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:52.723 [2024-11-28 04:32:23.242974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c89870 (9): Bad file descriptor 00:25:52.723 [2024-11-28 04:32:23.245276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:52.723 [2024-11-28 04:32:23.274796] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:52.723 00:25:52.723 Latency(us) 00:25:52.723 [2024-11-28T03:32:30.034Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:52.723 [2024-11-28T03:32:30.034Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:52.723 Verification LBA range: start 0x0 length 0x4000 00:25:52.723 NVMe0n1 : 15.01 12882.83 50.32 664.62 0.00 9431.37 640.19 14466.47 00:25:52.723 [2024-11-28T03:32:30.034Z] =================================================================================================================== 00:25:52.723 [2024-11-28T03:32:30.034Z] Total : 12882.83 50.32 664.62 0.00 9431.37 640.19 14466.47 00:25:52.723 Received shutdown signal, test time was about 15.000000 seconds 00:25:52.723 00:25:52.723 Latency(us) 00:25:52.723 [2024-11-28T03:32:30.034Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:52.723 [2024-11-28T03:32:30.034Z] =================================================================================================================== 00:25:52.723 [2024-11-28T03:32:30.034Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:52.723 04:32:29 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:52.723 04:32:29 -- host/failover.sh@65 -- # count=3 00:25:52.723 04:32:29 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:52.723 04:32:29 -- host/failover.sh@73 -- # bdevperf_pid=3996319 00:25:52.723 04:32:29 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:52.723 04:32:29 -- host/failover.sh@75 -- # waitforlisten 3996319 /var/tmp/bdevperf.sock 00:25:52.723 04:32:29 -- common/autotest_common.sh@829 -- # '[' -z 3996319 ']' 00:25:52.723 04:32:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:52.723 04:32:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:52.723 04:32:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:52.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:52.723 04:32:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:52.723 04:32:29 -- common/autotest_common.sh@10 -- # set +x 00:25:52.981 04:32:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:52.981 04:32:30 -- common/autotest_common.sh@862 -- # return 0 00:25:52.981 04:32:30 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:53.240 [2024-11-28 04:32:30.405927] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:53.240 04:32:30 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:53.497 [2024-11-28 04:32:30.662610] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:53.497 04:32:30 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.062 NVMe0n1 00:25:54.062 04:32:31 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.321 00:25:54.321 04:32:31 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.892 00:25:54.892 04:32:31 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.892 04:32:31 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:55.151 04:32:32 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:55.409 04:32:32 -- host/failover.sh@87 -- # sleep 3 00:25:58.699 04:32:35 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:58.699 04:32:35 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:58.699 04:32:35 -- host/failover.sh@90 -- # run_test_pid=3997141 00:25:58.699 04:32:35 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:58.699 04:32:35 -- host/failover.sh@92 -- # wait 3997141 00:25:59.635 0 00:25:59.635 04:32:36 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:59.635 [2024-11-28 04:32:29.147058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:59.635 [2024-11-28 04:32:29.147149] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3996319 ] 00:25:59.635 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.635 [2024-11-28 04:32:29.208043] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:59.635 [2024-11-28 04:32:29.312470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:59.635 [2024-11-28 04:32:32.484184] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:59.635 [2024-11-28 04:32:32.484271] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.635 [2024-11-28 04:32:32.484295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.635 [2024-11-28 04:32:32.484326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.635 [2024-11-28 04:32:32.484340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.635 [2024-11-28 04:32:32.484355] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.635 [2024-11-28 04:32:32.484368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.635 [2024-11-28 04:32:32.484382] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.635 [2024-11-28 04:32:32.484396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.636 [2024-11-28 04:32:32.484409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:59.636 [2024-11-28 04:32:32.484445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:59.636 [2024-11-28 04:32:32.484474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13d3870 (9): Bad file descriptor 00:25:59.636 [2024-11-28 04:32:32.535654] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.636 Running I/O for 1 seconds... 00:25:59.636 00:25:59.636 Latency(us) 00:25:59.636 [2024-11-28T03:32:36.947Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:59.636 [2024-11-28T03:32:36.947Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:59.636 Verification LBA range: start 0x0 length 0x4000 00:25:59.636 NVMe0n1 : 1.01 12894.19 50.37 0.00 0.00 9883.08 1316.79 14951.92 00:25:59.636 [2024-11-28T03:32:36.947Z] =================================================================================================================== 00:25:59.636 [2024-11-28T03:32:36.947Z] Total : 12894.19 50.37 0.00 0.00 9883.08 1316.79 14951.92 00:25:59.636 04:32:36 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:59.636 04:32:36 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:00.205 04:32:37 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:00.463 04:32:37 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:00.463 04:32:37 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:00.463 04:32:37 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:01.031 04:32:38 -- host/failover.sh@101 -- # sleep 3 00:26:04.322 04:32:41 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:04.322 04:32:41 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:04.322 04:32:41 -- host/failover.sh@108 -- # killprocess 3996319 00:26:04.322 04:32:41 -- common/autotest_common.sh@936 -- # '[' -z 3996319 ']' 00:26:04.322 04:32:41 -- common/autotest_common.sh@940 -- # kill -0 3996319 00:26:04.322 04:32:41 -- common/autotest_common.sh@941 -- # uname 00:26:04.322 04:32:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:04.322 04:32:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3996319 00:26:04.322 04:32:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:04.322 04:32:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:04.322 04:32:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3996319' 00:26:04.322 killing process with pid 3996319 00:26:04.322 04:32:41 -- common/autotest_common.sh@955 -- # kill 3996319 00:26:04.322 04:32:41 -- common/autotest_common.sh@960 -- # wait 3996319 00:26:04.322 04:32:41 -- host/failover.sh@110 -- # sync 00:26:04.322 04:32:41 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:04.580 04:32:41 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:04.580 04:32:41 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:04.580 04:32:41 -- host/failover.sh@116 -- # nvmftestfini 00:26:04.580 04:32:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:04.580 04:32:41 -- nvmf/common.sh@116 -- # sync 00:26:04.580 04:32:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:04.580 04:32:41 -- nvmf/common.sh@119 -- # set +e 00:26:04.580 04:32:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:04.580 04:32:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:04.580 rmmod nvme_tcp 00:26:04.580 rmmod nvme_fabrics 00:26:04.840 rmmod nvme_keyring 00:26:04.840 04:32:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:04.840 04:32:41 -- nvmf/common.sh@123 -- # set -e 00:26:04.840 04:32:41 -- nvmf/common.sh@124 -- # return 0 00:26:04.840 04:32:41 -- nvmf/common.sh@477 -- # '[' -n 3993835 ']' 00:26:04.840 04:32:41 -- nvmf/common.sh@478 -- # killprocess 3993835 00:26:04.840 04:32:41 -- common/autotest_common.sh@936 -- # '[' -z 3993835 ']' 00:26:04.840 04:32:41 -- common/autotest_common.sh@940 -- # kill -0 3993835 00:26:04.840 04:32:41 -- common/autotest_common.sh@941 -- # uname 00:26:04.840 04:32:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:04.840 04:32:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3993835 00:26:04.840 04:32:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:04.840 04:32:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:04.840 04:32:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3993835' 00:26:04.840 killing process with pid 3993835 00:26:04.840 04:32:41 -- common/autotest_common.sh@955 -- # kill 3993835 00:26:04.840 04:32:41 -- common/autotest_common.sh@960 -- # wait 3993835 00:26:05.099 04:32:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:05.099 04:32:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:05.099 04:32:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:05.099 04:32:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:05.099 04:32:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:05.099 04:32:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:05.099 04:32:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:05.099 04:32:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:07.003 04:32:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:07.003 00:26:07.003 real 0m37.883s 00:26:07.003 user 2m14.144s 00:26:07.003 sys 0m6.119s 00:26:07.003 04:32:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:07.003 04:32:44 -- common/autotest_common.sh@10 -- # set +x 00:26:07.003 ************************************ 00:26:07.003 END TEST nvmf_failover 00:26:07.003 ************************************ 00:26:07.262 04:32:44 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:07.262 04:32:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:07.262 04:32:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:07.262 04:32:44 -- common/autotest_common.sh@10 -- # set +x 00:26:07.262 ************************************ 00:26:07.262 START TEST nvmf_discovery 00:26:07.262 ************************************ 00:26:07.262 04:32:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:07.262 * Looking for test storage... 00:26:07.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:07.262 04:32:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:07.262 04:32:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:07.262 04:32:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:07.262 04:32:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:07.262 04:32:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:07.262 04:32:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:07.262 04:32:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:07.262 04:32:44 -- scripts/common.sh@335 -- # IFS=.-: 00:26:07.262 04:32:44 -- scripts/common.sh@335 -- # read -ra ver1 00:26:07.262 04:32:44 -- scripts/common.sh@336 -- # IFS=.-: 00:26:07.262 04:32:44 -- scripts/common.sh@336 -- # read -ra ver2 00:26:07.262 04:32:44 -- scripts/common.sh@337 -- # local 'op=<' 00:26:07.262 04:32:44 -- scripts/common.sh@339 -- # ver1_l=2 00:26:07.262 04:32:44 -- scripts/common.sh@340 -- # ver2_l=1 00:26:07.262 04:32:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:07.262 04:32:44 -- scripts/common.sh@343 -- # case "$op" in 00:26:07.262 04:32:44 -- scripts/common.sh@344 -- # : 1 00:26:07.262 04:32:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:07.262 04:32:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:07.262 04:32:44 -- scripts/common.sh@364 -- # decimal 1 00:26:07.262 04:32:44 -- scripts/common.sh@352 -- # local d=1 00:26:07.262 04:32:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:07.262 04:32:44 -- scripts/common.sh@354 -- # echo 1 00:26:07.262 04:32:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:07.262 04:32:44 -- scripts/common.sh@365 -- # decimal 2 00:26:07.262 04:32:44 -- scripts/common.sh@352 -- # local d=2 00:26:07.262 04:32:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:07.262 04:32:44 -- scripts/common.sh@354 -- # echo 2 00:26:07.262 04:32:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:07.262 04:32:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:07.262 04:32:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:07.262 04:32:44 -- scripts/common.sh@367 -- # return 0 00:26:07.262 04:32:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:07.262 04:32:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:07.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:07.262 --rc genhtml_branch_coverage=1 00:26:07.262 --rc genhtml_function_coverage=1 00:26:07.262 --rc genhtml_legend=1 00:26:07.262 --rc geninfo_all_blocks=1 00:26:07.262 --rc geninfo_unexecuted_blocks=1 00:26:07.262 00:26:07.262 ' 00:26:07.262 04:32:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:07.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:07.262 --rc genhtml_branch_coverage=1 00:26:07.262 --rc genhtml_function_coverage=1 00:26:07.262 --rc genhtml_legend=1 00:26:07.262 --rc geninfo_all_blocks=1 00:26:07.262 --rc geninfo_unexecuted_blocks=1 00:26:07.262 00:26:07.262 ' 00:26:07.262 04:32:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:07.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:07.262 --rc genhtml_branch_coverage=1 00:26:07.262 --rc genhtml_function_coverage=1 00:26:07.262 --rc genhtml_legend=1 00:26:07.262 --rc geninfo_all_blocks=1 00:26:07.262 --rc geninfo_unexecuted_blocks=1 00:26:07.262 00:26:07.262 ' 00:26:07.262 04:32:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:07.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:07.262 --rc genhtml_branch_coverage=1 00:26:07.262 --rc genhtml_function_coverage=1 00:26:07.262 --rc genhtml_legend=1 00:26:07.262 --rc geninfo_all_blocks=1 00:26:07.262 --rc geninfo_unexecuted_blocks=1 00:26:07.262 00:26:07.262 ' 00:26:07.262 04:32:44 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:07.262 04:32:44 -- nvmf/common.sh@7 -- # uname -s 00:26:07.262 04:32:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:07.262 04:32:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:07.262 04:32:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:07.262 04:32:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:07.262 04:32:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:07.262 04:32:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:07.262 04:32:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:07.262 04:32:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:07.262 04:32:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:07.262 04:32:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:07.262 04:32:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:07.263 04:32:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:07.263 04:32:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:07.263 04:32:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:07.263 04:32:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:07.263 04:32:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:07.263 04:32:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:07.263 04:32:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:07.263 04:32:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:07.263 04:32:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.263 04:32:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.263 04:32:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.263 04:32:44 -- paths/export.sh@5 -- # export PATH 00:26:07.263 04:32:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.263 04:32:44 -- nvmf/common.sh@46 -- # : 0 00:26:07.263 04:32:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:07.263 04:32:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:07.263 04:32:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:07.263 04:32:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:07.263 04:32:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:07.263 04:32:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:07.263 04:32:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:07.263 04:32:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:07.263 04:32:44 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:07.263 04:32:44 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:07.263 04:32:44 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:07.263 04:32:44 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:07.263 04:32:44 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:07.263 04:32:44 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:07.263 04:32:44 -- host/discovery.sh@25 -- # nvmftestinit 00:26:07.263 04:32:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:07.263 04:32:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:07.263 04:32:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:07.263 04:32:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:07.263 04:32:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:07.263 04:32:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:07.263 04:32:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:07.263 04:32:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:07.263 04:32:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:07.263 04:32:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:07.263 04:32:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:07.263 04:32:44 -- common/autotest_common.sh@10 -- # set +x 00:26:09.165 04:32:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:09.165 04:32:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:09.165 04:32:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:09.165 04:32:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:09.165 04:32:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:09.165 04:32:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:09.165 04:32:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:09.165 04:32:46 -- nvmf/common.sh@294 -- # net_devs=() 00:26:09.165 04:32:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:09.165 04:32:46 -- nvmf/common.sh@295 -- # e810=() 00:26:09.166 04:32:46 -- nvmf/common.sh@295 -- # local -ga e810 00:26:09.166 04:32:46 -- nvmf/common.sh@296 -- # x722=() 00:26:09.166 04:32:46 -- nvmf/common.sh@296 -- # local -ga x722 00:26:09.166 04:32:46 -- nvmf/common.sh@297 -- # mlx=() 00:26:09.166 04:32:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:09.166 04:32:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:09.166 04:32:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:09.166 04:32:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:09.166 04:32:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:09.166 04:32:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:09.166 04:32:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:09.166 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:09.166 04:32:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:09.166 04:32:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:09.166 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:09.166 04:32:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:09.166 04:32:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:09.166 04:32:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:09.166 04:32:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:09.166 04:32:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:09.166 04:32:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:09.166 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:09.166 04:32:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:09.166 04:32:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:09.166 04:32:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:09.166 04:32:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:09.166 04:32:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:09.166 04:32:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:09.166 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:09.166 04:32:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:09.166 04:32:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:09.166 04:32:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:09.166 04:32:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:09.166 04:32:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:09.166 04:32:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:09.166 04:32:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:09.166 04:32:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:09.166 04:32:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:09.166 04:32:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:09.166 04:32:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:09.166 04:32:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:09.166 04:32:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:09.166 04:32:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:09.166 04:32:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:09.166 04:32:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:09.166 04:32:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:09.166 04:32:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:09.424 04:32:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:09.424 04:32:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:09.424 04:32:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:09.424 04:32:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:09.424 04:32:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:09.424 04:32:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:09.424 04:32:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:09.424 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:09.424 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.331 ms 00:26:09.424 00:26:09.424 --- 10.0.0.2 ping statistics --- 00:26:09.424 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:09.424 rtt min/avg/max/mdev = 0.331/0.331/0.331/0.000 ms 00:26:09.424 04:32:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:09.424 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:09.424 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:26:09.424 00:26:09.424 --- 10.0.0.1 ping statistics --- 00:26:09.424 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:09.424 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:26:09.424 04:32:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:09.424 04:32:46 -- nvmf/common.sh@410 -- # return 0 00:26:09.424 04:32:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:09.424 04:32:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:09.424 04:32:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:09.424 04:32:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:09.424 04:32:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:09.424 04:32:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:09.424 04:32:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:09.424 04:32:46 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:09.424 04:32:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:09.424 04:32:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:09.424 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:26:09.424 04:32:46 -- nvmf/common.sh@469 -- # nvmfpid=3999781 00:26:09.424 04:32:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:09.424 04:32:46 -- nvmf/common.sh@470 -- # waitforlisten 3999781 00:26:09.424 04:32:46 -- common/autotest_common.sh@829 -- # '[' -z 3999781 ']' 00:26:09.424 04:32:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:09.424 04:32:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:09.424 04:32:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:09.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:09.424 04:32:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:09.424 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:26:09.424 [2024-11-28 04:32:46.617431] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:09.424 [2024-11-28 04:32:46.617535] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:09.424 EAL: No free 2048 kB hugepages reported on node 1 00:26:09.424 [2024-11-28 04:32:46.685511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:09.683 [2024-11-28 04:32:46.802888] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:09.683 [2024-11-28 04:32:46.803048] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:09.683 [2024-11-28 04:32:46.803066] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:09.683 [2024-11-28 04:32:46.803077] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:09.683 [2024-11-28 04:32:46.803115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:10.618 04:32:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:10.618 04:32:47 -- common/autotest_common.sh@862 -- # return 0 00:26:10.618 04:32:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:10.618 04:32:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:10.618 04:32:47 -- common/autotest_common.sh@10 -- # set +x 00:26:10.618 04:32:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:10.618 04:32:47 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:10.618 04:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.618 04:32:47 -- common/autotest_common.sh@10 -- # set +x 00:26:10.618 [2024-11-28 04:32:47.672060] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:10.618 04:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.618 04:32:47 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:10.618 04:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.618 04:32:47 -- common/autotest_common.sh@10 -- # set +x 00:26:10.618 [2024-11-28 04:32:47.680242] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:10.618 04:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.618 04:32:47 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:10.618 04:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.618 04:32:47 -- common/autotest_common.sh@10 -- # set +x 00:26:10.618 null0 00:26:10.618 04:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.618 04:32:47 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:10.618 04:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.618 04:32:47 -- common/autotest_common.sh@10 -- # set +x 00:26:10.618 null1 00:26:10.618 04:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.618 04:32:47 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:10.618 04:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.618 04:32:47 -- common/autotest_common.sh@10 -- # set +x 00:26:10.618 04:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.618 04:32:47 -- host/discovery.sh@45 -- # hostpid=3999941 00:26:10.618 04:32:47 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:10.618 04:32:47 -- host/discovery.sh@46 -- # waitforlisten 3999941 /tmp/host.sock 00:26:10.618 04:32:47 -- common/autotest_common.sh@829 -- # '[' -z 3999941 ']' 00:26:10.618 04:32:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:10.618 04:32:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:10.618 04:32:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:10.618 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:10.618 04:32:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:10.618 04:32:47 -- common/autotest_common.sh@10 -- # set +x 00:26:10.618 [2024-11-28 04:32:47.749297] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:10.618 [2024-11-28 04:32:47.749362] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3999941 ] 00:26:10.618 EAL: No free 2048 kB hugepages reported on node 1 00:26:10.618 [2024-11-28 04:32:47.810421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:10.618 [2024-11-28 04:32:47.926266] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:10.618 [2024-11-28 04:32:47.926447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:11.553 04:32:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:11.553 04:32:48 -- common/autotest_common.sh@862 -- # return 0 00:26:11.553 04:32:48 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:11.553 04:32:48 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:11.553 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.553 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.553 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.553 04:32:48 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:11.553 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.553 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.553 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.553 04:32:48 -- host/discovery.sh@72 -- # notify_id=0 00:26:11.553 04:32:48 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:11.553 04:32:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.553 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.553 04:32:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.553 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.553 04:32:48 -- host/discovery.sh@59 -- # sort 00:26:11.553 04:32:48 -- host/discovery.sh@59 -- # xargs 00:26:11.553 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.553 04:32:48 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:11.553 04:32:48 -- host/discovery.sh@79 -- # get_bdev_list 00:26:11.553 04:32:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.553 04:32:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.553 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.553 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.553 04:32:48 -- host/discovery.sh@55 -- # sort 00:26:11.553 04:32:48 -- host/discovery.sh@55 -- # xargs 00:26:11.553 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:48 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:11.811 04:32:48 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:11.811 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:48 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.811 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # sort 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # xargs 00:26:11.811 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:48 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:11.811 04:32:48 -- host/discovery.sh@83 -- # get_bdev_list 00:26:11.811 04:32:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.811 04:32:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.811 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:48 -- host/discovery.sh@55 -- # sort 00:26:11.811 04:32:48 -- host/discovery.sh@55 -- # xargs 00:26:11.811 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:48 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:11.811 04:32:48 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:11.811 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:48 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.811 04:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # sort 00:26:11.811 04:32:48 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:48 -- host/discovery.sh@59 -- # xargs 00:26:11.811 04:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:49 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:11.811 04:32:49 -- host/discovery.sh@87 -- # get_bdev_list 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.811 04:32:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:49 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # sort 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # xargs 00:26:11.811 04:32:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:49 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:11.811 04:32:49 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:11.811 04:32:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:49 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 [2024-11-28 04:32:49.060023] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:11.811 04:32:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:49 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:11.811 04:32:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.811 04:32:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.811 04:32:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:49 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:49 -- host/discovery.sh@59 -- # sort 00:26:11.811 04:32:49 -- host/discovery.sh@59 -- # xargs 00:26:11.811 04:32:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.811 04:32:49 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:11.811 04:32:49 -- host/discovery.sh@93 -- # get_bdev_list 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.811 04:32:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # sort 00:26:11.811 04:32:49 -- common/autotest_common.sh@10 -- # set +x 00:26:11.811 04:32:49 -- host/discovery.sh@55 -- # xargs 00:26:11.811 04:32:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.113 04:32:49 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:12.113 04:32:49 -- host/discovery.sh@94 -- # get_notification_count 00:26:12.113 04:32:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:12.113 04:32:49 -- host/discovery.sh@74 -- # jq '. | length' 00:26:12.113 04:32:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.113 04:32:49 -- common/autotest_common.sh@10 -- # set +x 00:26:12.113 04:32:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.113 04:32:49 -- host/discovery.sh@74 -- # notification_count=0 00:26:12.113 04:32:49 -- host/discovery.sh@75 -- # notify_id=0 00:26:12.113 04:32:49 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:12.113 04:32:49 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:12.113 04:32:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.113 04:32:49 -- common/autotest_common.sh@10 -- # set +x 00:26:12.113 04:32:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.113 04:32:49 -- host/discovery.sh@100 -- # sleep 1 00:26:12.714 [2024-11-28 04:32:49.781529] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:12.714 [2024-11-28 04:32:49.781588] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:12.714 [2024-11-28 04:32:49.781619] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:12.714 [2024-11-28 04:32:49.867884] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:12.974 [2024-11-28 04:32:50.094299] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:12.974 [2024-11-28 04:32:50.094331] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:12.974 04:32:50 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:12.974 04:32:50 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:12.974 04:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.974 04:32:50 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:12.974 04:32:50 -- common/autotest_common.sh@10 -- # set +x 00:26:12.974 04:32:50 -- host/discovery.sh@59 -- # sort 00:26:12.974 04:32:50 -- host/discovery.sh@59 -- # xargs 00:26:12.974 04:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.974 04:32:50 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:12.974 04:32:50 -- host/discovery.sh@102 -- # get_bdev_list 00:26:12.974 04:32:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:12.974 04:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.974 04:32:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:12.974 04:32:50 -- common/autotest_common.sh@10 -- # set +x 00:26:12.974 04:32:50 -- host/discovery.sh@55 -- # sort 00:26:12.974 04:32:50 -- host/discovery.sh@55 -- # xargs 00:26:12.974 04:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.974 04:32:50 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:12.974 04:32:50 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:12.974 04:32:50 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:12.974 04:32:50 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:12.974 04:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.974 04:32:50 -- common/autotest_common.sh@10 -- # set +x 00:26:12.974 04:32:50 -- host/discovery.sh@63 -- # sort -n 00:26:12.974 04:32:50 -- host/discovery.sh@63 -- # xargs 00:26:13.233 04:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.233 04:32:50 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:13.233 04:32:50 -- host/discovery.sh@104 -- # get_notification_count 00:26:13.233 04:32:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:13.233 04:32:50 -- host/discovery.sh@74 -- # jq '. | length' 00:26:13.233 04:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.233 04:32:50 -- common/autotest_common.sh@10 -- # set +x 00:26:13.233 04:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.233 04:32:50 -- host/discovery.sh@74 -- # notification_count=1 00:26:13.233 04:32:50 -- host/discovery.sh@75 -- # notify_id=1 00:26:13.233 04:32:50 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:13.233 04:32:50 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:13.233 04:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.233 04:32:50 -- common/autotest_common.sh@10 -- # set +x 00:26:13.233 04:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.233 04:32:50 -- host/discovery.sh@109 -- # sleep 1 00:26:14.173 04:32:51 -- host/discovery.sh@110 -- # get_bdev_list 00:26:14.173 04:32:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.173 04:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.173 04:32:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:14.173 04:32:51 -- common/autotest_common.sh@10 -- # set +x 00:26:14.173 04:32:51 -- host/discovery.sh@55 -- # sort 00:26:14.173 04:32:51 -- host/discovery.sh@55 -- # xargs 00:26:14.173 04:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.173 04:32:51 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:14.173 04:32:51 -- host/discovery.sh@111 -- # get_notification_count 00:26:14.173 04:32:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:14.173 04:32:51 -- host/discovery.sh@74 -- # jq '. | length' 00:26:14.173 04:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.173 04:32:51 -- common/autotest_common.sh@10 -- # set +x 00:26:14.173 04:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.173 04:32:51 -- host/discovery.sh@74 -- # notification_count=1 00:26:14.173 04:32:51 -- host/discovery.sh@75 -- # notify_id=2 00:26:14.173 04:32:51 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:14.173 04:32:51 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:14.173 04:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.173 04:32:51 -- common/autotest_common.sh@10 -- # set +x 00:26:14.173 [2024-11-28 04:32:51.459544] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:14.174 [2024-11-28 04:32:51.460575] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:14.174 [2024-11-28 04:32:51.460642] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:14.174 04:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.174 04:32:51 -- host/discovery.sh@117 -- # sleep 1 00:26:14.434 [2024-11-28 04:32:51.588964] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:14.434 [2024-11-28 04:32:51.687646] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:14.434 [2024-11-28 04:32:51.687669] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:14.434 [2024-11-28 04:32:51.687678] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:15.373 04:32:52 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:15.373 04:32:52 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:15.373 04:32:52 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:15.373 04:32:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.373 04:32:52 -- host/discovery.sh@59 -- # sort 00:26:15.373 04:32:52 -- common/autotest_common.sh@10 -- # set +x 00:26:15.373 04:32:52 -- host/discovery.sh@59 -- # xargs 00:26:15.373 04:32:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@119 -- # get_bdev_list 00:26:15.373 04:32:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.373 04:32:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.373 04:32:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.373 04:32:52 -- common/autotest_common.sh@10 -- # set +x 00:26:15.373 04:32:52 -- host/discovery.sh@55 -- # sort 00:26:15.373 04:32:52 -- host/discovery.sh@55 -- # xargs 00:26:15.373 04:32:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:15.373 04:32:52 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:15.373 04:32:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.373 04:32:52 -- common/autotest_common.sh@10 -- # set +x 00:26:15.373 04:32:52 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:15.373 04:32:52 -- host/discovery.sh@63 -- # sort -n 00:26:15.373 04:32:52 -- host/discovery.sh@63 -- # xargs 00:26:15.373 04:32:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@121 -- # get_notification_count 00:26:15.373 04:32:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:15.373 04:32:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.373 04:32:52 -- host/discovery.sh@74 -- # jq '. | length' 00:26:15.373 04:32:52 -- common/autotest_common.sh@10 -- # set +x 00:26:15.373 04:32:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@74 -- # notification_count=0 00:26:15.373 04:32:52 -- host/discovery.sh@75 -- # notify_id=2 00:26:15.373 04:32:52 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:15.373 04:32:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.373 04:32:52 -- common/autotest_common.sh@10 -- # set +x 00:26:15.373 [2024-11-28 04:32:52.627586] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.373 [2024-11-28 04:32:52.627620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.373 [2024-11-28 04:32:52.627650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.373 [2024-11-28 04:32:52.627663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.373 [2024-11-28 04:32:52.627677] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.373 [2024-11-28 04:32:52.627691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.373 [2024-11-28 04:32:52.627705] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:15.373 [2024-11-28 04:32:52.627718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:15.373 [2024-11-28 04:32:52.627731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.373 [2024-11-28 04:32:52.628097] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:15.373 [2024-11-28 04:32:52.628126] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:15.373 04:32:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.373 04:32:52 -- host/discovery.sh@127 -- # sleep 1 00:26:15.373 [2024-11-28 04:32:52.637589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.373 [2024-11-28 04:32:52.647634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.373 [2024-11-28 04:32:52.647838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.647993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.648024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.373 [2024-11-28 04:32:52.648043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.373 [2024-11-28 04:32:52.648069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.373 [2024-11-28 04:32:52.648092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.373 [2024-11-28 04:32:52.648107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.373 [2024-11-28 04:32:52.648124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.373 [2024-11-28 04:32:52.648147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.373 [2024-11-28 04:32:52.657710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.373 [2024-11-28 04:32:52.657871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.658048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.658090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.373 [2024-11-28 04:32:52.658108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.373 [2024-11-28 04:32:52.658133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.373 [2024-11-28 04:32:52.658155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.373 [2024-11-28 04:32:52.658171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.373 [2024-11-28 04:32:52.658186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.373 [2024-11-28 04:32:52.658207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.373 [2024-11-28 04:32:52.667787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.373 [2024-11-28 04:32:52.668007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.668130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.668159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.373 [2024-11-28 04:32:52.668177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.373 [2024-11-28 04:32:52.668203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.373 [2024-11-28 04:32:52.668225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.373 [2024-11-28 04:32:52.668240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.373 [2024-11-28 04:32:52.668255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.373 [2024-11-28 04:32:52.668276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.373 [2024-11-28 04:32:52.677875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.373 [2024-11-28 04:32:52.678070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.678229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.373 [2024-11-28 04:32:52.678258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.373 [2024-11-28 04:32:52.678292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.373 [2024-11-28 04:32:52.678314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.373 [2024-11-28 04:32:52.678367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.374 [2024-11-28 04:32:52.678387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.374 [2024-11-28 04:32:52.678403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.374 [2024-11-28 04:32:52.678436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.632 [2024-11-28 04:32:52.687955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.632 [2024-11-28 04:32:52.688169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.632 [2024-11-28 04:32:52.688300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.688331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.633 [2024-11-28 04:32:52.688348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.633 [2024-11-28 04:32:52.688370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.633 [2024-11-28 04:32:52.688420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.633 [2024-11-28 04:32:52.688440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.633 [2024-11-28 04:32:52.688455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.633 [2024-11-28 04:32:52.688476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.633 [2024-11-28 04:32:52.698041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.633 [2024-11-28 04:32:52.698244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.698432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.698461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.633 [2024-11-28 04:32:52.698479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.633 [2024-11-28 04:32:52.698503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.633 [2024-11-28 04:32:52.698576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.633 [2024-11-28 04:32:52.698597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.633 [2024-11-28 04:32:52.698611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.633 [2024-11-28 04:32:52.698629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.633 [2024-11-28 04:32:52.708116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.633 [2024-11-28 04:32:52.708286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.708468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.708494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.633 [2024-11-28 04:32:52.708510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.633 [2024-11-28 04:32:52.708562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.633 [2024-11-28 04:32:52.708600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.633 [2024-11-28 04:32:52.708620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.633 [2024-11-28 04:32:52.708635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.633 [2024-11-28 04:32:52.708655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.633 [2024-11-28 04:32:52.718193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.633 [2024-11-28 04:32:52.718394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.718564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.718607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.633 [2024-11-28 04:32:52.718629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.633 [2024-11-28 04:32:52.718654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.633 [2024-11-28 04:32:52.718697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.633 [2024-11-28 04:32:52.718716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.633 [2024-11-28 04:32:52.718729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.633 [2024-11-28 04:32:52.718749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.633 [2024-11-28 04:32:52.728271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.633 [2024-11-28 04:32:52.728465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.728611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.728638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.633 [2024-11-28 04:32:52.728655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.633 [2024-11-28 04:32:52.728678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.633 [2024-11-28 04:32:52.728698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.633 [2024-11-28 04:32:52.728711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.633 [2024-11-28 04:32:52.728724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.633 [2024-11-28 04:32:52.728756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.633 [2024-11-28 04:32:52.738349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.633 [2024-11-28 04:32:52.738532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.738679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.738706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.633 [2024-11-28 04:32:52.738722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.633 [2024-11-28 04:32:52.738745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.633 [2024-11-28 04:32:52.738788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.633 [2024-11-28 04:32:52.738823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.633 [2024-11-28 04:32:52.738839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.633 [2024-11-28 04:32:52.738861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.633 [2024-11-28 04:32:52.748426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:15.633 [2024-11-28 04:32:52.748610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.748758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.633 [2024-11-28 04:32:52.748796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23df810 with addr=10.0.0.2, port=4420 00:26:15.633 [2024-11-28 04:32:52.748829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23df810 is same with the state(5) to be set 00:26:15.633 [2024-11-28 04:32:52.748870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23df810 (9): Bad file descriptor 00:26:15.633 [2024-11-28 04:32:52.748908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:15.633 [2024-11-28 04:32:52.748927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:15.633 [2024-11-28 04:32:52.748941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:15.633 [2024-11-28 04:32:52.748962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:15.633 [2024-11-28 04:32:52.754917] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:15.634 [2024-11-28 04:32:52.754949] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:16.572 04:32:53 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:16.572 04:32:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:16.572 04:32:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:16.572 04:32:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.572 04:32:53 -- common/autotest_common.sh@10 -- # set +x 00:26:16.572 04:32:53 -- host/discovery.sh@59 -- # sort 00:26:16.572 04:32:53 -- host/discovery.sh@59 -- # xargs 00:26:16.572 04:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@129 -- # get_bdev_list 00:26:16.572 04:32:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.572 04:32:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:16.572 04:32:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.572 04:32:53 -- host/discovery.sh@55 -- # sort 00:26:16.572 04:32:53 -- common/autotest_common.sh@10 -- # set +x 00:26:16.572 04:32:53 -- host/discovery.sh@55 -- # xargs 00:26:16.572 04:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:16.572 04:32:53 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:16.572 04:32:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.572 04:32:53 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:16.572 04:32:53 -- common/autotest_common.sh@10 -- # set +x 00:26:16.572 04:32:53 -- host/discovery.sh@63 -- # sort -n 00:26:16.572 04:32:53 -- host/discovery.sh@63 -- # xargs 00:26:16.572 04:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@131 -- # get_notification_count 00:26:16.572 04:32:53 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:16.572 04:32:53 -- host/discovery.sh@74 -- # jq '. | length' 00:26:16.572 04:32:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.572 04:32:53 -- common/autotest_common.sh@10 -- # set +x 00:26:16.572 04:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@74 -- # notification_count=0 00:26:16.572 04:32:53 -- host/discovery.sh@75 -- # notify_id=2 00:26:16.572 04:32:53 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:16.572 04:32:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.572 04:32:53 -- common/autotest_common.sh@10 -- # set +x 00:26:16.572 04:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.572 04:32:53 -- host/discovery.sh@135 -- # sleep 1 00:26:17.508 04:32:54 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:17.508 04:32:54 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:17.508 04:32:54 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:17.508 04:32:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.508 04:32:54 -- host/discovery.sh@59 -- # sort 00:26:17.508 04:32:54 -- common/autotest_common.sh@10 -- # set +x 00:26:17.508 04:32:54 -- host/discovery.sh@59 -- # xargs 00:26:17.767 04:32:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.767 04:32:54 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:17.767 04:32:54 -- host/discovery.sh@137 -- # get_bdev_list 00:26:17.767 04:32:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:17.767 04:32:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.767 04:32:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:17.767 04:32:54 -- common/autotest_common.sh@10 -- # set +x 00:26:17.767 04:32:54 -- host/discovery.sh@55 -- # sort 00:26:17.767 04:32:54 -- host/discovery.sh@55 -- # xargs 00:26:17.767 04:32:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.767 04:32:54 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:17.767 04:32:54 -- host/discovery.sh@138 -- # get_notification_count 00:26:17.767 04:32:54 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:17.767 04:32:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.767 04:32:54 -- common/autotest_common.sh@10 -- # set +x 00:26:17.767 04:32:54 -- host/discovery.sh@74 -- # jq '. | length' 00:26:17.767 04:32:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.767 04:32:54 -- host/discovery.sh@74 -- # notification_count=2 00:26:17.767 04:32:54 -- host/discovery.sh@75 -- # notify_id=4 00:26:17.767 04:32:54 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:17.767 04:32:54 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:17.767 04:32:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.767 04:32:54 -- common/autotest_common.sh@10 -- # set +x 00:26:18.705 [2024-11-28 04:32:55.988259] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:18.705 [2024-11-28 04:32:55.988289] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:18.705 [2024-11-28 04:32:55.988316] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:18.964 [2024-11-28 04:32:56.075591] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:18.964 [2024-11-28 04:32:56.181864] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:18.964 [2024-11-28 04:32:56.181903] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:18.964 04:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.964 04:32:56 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:18.964 04:32:56 -- common/autotest_common.sh@650 -- # local es=0 00:26:18.964 04:32:56 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:18.964 04:32:56 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:18.964 04:32:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:18.964 04:32:56 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:18.964 04:32:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:18.964 04:32:56 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:18.964 04:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.964 04:32:56 -- common/autotest_common.sh@10 -- # set +x 00:26:18.964 request: 00:26:18.964 { 00:26:18.964 "name": "nvme", 00:26:18.964 "trtype": "tcp", 00:26:18.964 "traddr": "10.0.0.2", 00:26:18.964 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:18.964 "adrfam": "ipv4", 00:26:18.964 "trsvcid": "8009", 00:26:18.964 "wait_for_attach": true, 00:26:18.964 "method": "bdev_nvme_start_discovery", 00:26:18.964 "req_id": 1 00:26:18.964 } 00:26:18.964 Got JSON-RPC error response 00:26:18.964 response: 00:26:18.964 { 00:26:18.964 "code": -17, 00:26:18.964 "message": "File exists" 00:26:18.964 } 00:26:18.964 04:32:56 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:18.964 04:32:56 -- common/autotest_common.sh@653 -- # es=1 00:26:18.964 04:32:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:18.964 04:32:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:18.964 04:32:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:18.964 04:32:56 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:18.964 04:32:56 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:18.964 04:32:56 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:18.964 04:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.964 04:32:56 -- common/autotest_common.sh@10 -- # set +x 00:26:18.964 04:32:56 -- host/discovery.sh@67 -- # sort 00:26:18.964 04:32:56 -- host/discovery.sh@67 -- # xargs 00:26:18.964 04:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.964 04:32:56 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:18.964 04:32:56 -- host/discovery.sh@147 -- # get_bdev_list 00:26:18.964 04:32:56 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.964 04:32:56 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.964 04:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.964 04:32:56 -- host/discovery.sh@55 -- # sort 00:26:18.964 04:32:56 -- common/autotest_common.sh@10 -- # set +x 00:26:18.964 04:32:56 -- host/discovery.sh@55 -- # xargs 00:26:18.964 04:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.964 04:32:56 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:18.964 04:32:56 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:18.964 04:32:56 -- common/autotest_common.sh@650 -- # local es=0 00:26:18.965 04:32:56 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:18.965 04:32:56 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:19.223 04:32:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:19.223 04:32:56 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:19.223 04:32:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:19.223 04:32:56 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:19.223 04:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.223 04:32:56 -- common/autotest_common.sh@10 -- # set +x 00:26:19.223 request: 00:26:19.223 { 00:26:19.223 "name": "nvme_second", 00:26:19.223 "trtype": "tcp", 00:26:19.223 "traddr": "10.0.0.2", 00:26:19.223 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:19.223 "adrfam": "ipv4", 00:26:19.223 "trsvcid": "8009", 00:26:19.223 "wait_for_attach": true, 00:26:19.223 "method": "bdev_nvme_start_discovery", 00:26:19.223 "req_id": 1 00:26:19.223 } 00:26:19.223 Got JSON-RPC error response 00:26:19.223 response: 00:26:19.223 { 00:26:19.223 "code": -17, 00:26:19.223 "message": "File exists" 00:26:19.223 } 00:26:19.223 04:32:56 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:19.223 04:32:56 -- common/autotest_common.sh@653 -- # es=1 00:26:19.223 04:32:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:19.223 04:32:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:19.223 04:32:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:19.223 04:32:56 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:19.223 04:32:56 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:19.223 04:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.223 04:32:56 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:19.223 04:32:56 -- common/autotest_common.sh@10 -- # set +x 00:26:19.223 04:32:56 -- host/discovery.sh@67 -- # sort 00:26:19.223 04:32:56 -- host/discovery.sh@67 -- # xargs 00:26:19.223 04:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.223 04:32:56 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:19.223 04:32:56 -- host/discovery.sh@153 -- # get_bdev_list 00:26:19.223 04:32:56 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.223 04:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.223 04:32:56 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.223 04:32:56 -- common/autotest_common.sh@10 -- # set +x 00:26:19.223 04:32:56 -- host/discovery.sh@55 -- # sort 00:26:19.223 04:32:56 -- host/discovery.sh@55 -- # xargs 00:26:19.223 04:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.223 04:32:56 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:19.223 04:32:56 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:19.223 04:32:56 -- common/autotest_common.sh@650 -- # local es=0 00:26:19.223 04:32:56 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:19.223 04:32:56 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:19.223 04:32:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:19.223 04:32:56 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:19.223 04:32:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:19.223 04:32:56 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:19.223 04:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.223 04:32:56 -- common/autotest_common.sh@10 -- # set +x 00:26:20.161 [2024-11-28 04:32:57.373256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.161 [2024-11-28 04:32:57.373402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.161 [2024-11-28 04:32:57.373439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23eb0a0 with addr=10.0.0.2, port=8010 00:26:20.161 [2024-11-28 04:32:57.373466] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:20.161 [2024-11-28 04:32:57.373482] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:20.161 [2024-11-28 04:32:57.373496] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:21.100 [2024-11-28 04:32:58.375709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.100 [2024-11-28 04:32:58.375884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.100 [2024-11-28 04:32:58.375914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23eb0a0 with addr=10.0.0.2, port=8010 00:26:21.100 [2024-11-28 04:32:58.375936] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:21.100 [2024-11-28 04:32:58.375951] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:21.100 [2024-11-28 04:32:58.375964] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:22.480 [2024-11-28 04:32:59.377950] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:22.480 request: 00:26:22.480 { 00:26:22.480 "name": "nvme_second", 00:26:22.480 "trtype": "tcp", 00:26:22.480 "traddr": "10.0.0.2", 00:26:22.480 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:22.480 "adrfam": "ipv4", 00:26:22.480 "trsvcid": "8010", 00:26:22.480 "attach_timeout_ms": 3000, 00:26:22.480 "method": "bdev_nvme_start_discovery", 00:26:22.480 "req_id": 1 00:26:22.480 } 00:26:22.480 Got JSON-RPC error response 00:26:22.480 response: 00:26:22.480 { 00:26:22.480 "code": -110, 00:26:22.480 "message": "Connection timed out" 00:26:22.480 } 00:26:22.480 04:32:59 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:22.480 04:32:59 -- common/autotest_common.sh@653 -- # es=1 00:26:22.480 04:32:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:22.480 04:32:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:22.480 04:32:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:22.480 04:32:59 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:22.480 04:32:59 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:22.480 04:32:59 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:22.480 04:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.480 04:32:59 -- common/autotest_common.sh@10 -- # set +x 00:26:22.480 04:32:59 -- host/discovery.sh@67 -- # sort 00:26:22.480 04:32:59 -- host/discovery.sh@67 -- # xargs 00:26:22.480 04:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.480 04:32:59 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:22.480 04:32:59 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:22.480 04:32:59 -- host/discovery.sh@162 -- # kill 3999941 00:26:22.480 04:32:59 -- host/discovery.sh@163 -- # nvmftestfini 00:26:22.480 04:32:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:22.480 04:32:59 -- nvmf/common.sh@116 -- # sync 00:26:22.480 04:32:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:22.480 04:32:59 -- nvmf/common.sh@119 -- # set +e 00:26:22.480 04:32:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:22.480 04:32:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:22.480 rmmod nvme_tcp 00:26:22.480 rmmod nvme_fabrics 00:26:22.480 rmmod nvme_keyring 00:26:22.480 04:32:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:22.480 04:32:59 -- nvmf/common.sh@123 -- # set -e 00:26:22.480 04:32:59 -- nvmf/common.sh@124 -- # return 0 00:26:22.480 04:32:59 -- nvmf/common.sh@477 -- # '[' -n 3999781 ']' 00:26:22.480 04:32:59 -- nvmf/common.sh@478 -- # killprocess 3999781 00:26:22.480 04:32:59 -- common/autotest_common.sh@936 -- # '[' -z 3999781 ']' 00:26:22.480 04:32:59 -- common/autotest_common.sh@940 -- # kill -0 3999781 00:26:22.480 04:32:59 -- common/autotest_common.sh@941 -- # uname 00:26:22.480 04:32:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:22.480 04:32:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3999781 00:26:22.480 04:32:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:22.480 04:32:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:22.480 04:32:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3999781' 00:26:22.480 killing process with pid 3999781 00:26:22.480 04:32:59 -- common/autotest_common.sh@955 -- # kill 3999781 00:26:22.480 04:32:59 -- common/autotest_common.sh@960 -- # wait 3999781 00:26:22.739 04:32:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:22.739 04:32:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:22.739 04:32:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:22.739 04:32:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:22.739 04:32:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:22.739 04:32:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:22.739 04:32:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:22.739 04:32:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:24.647 04:33:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:24.647 00:26:24.647 real 0m17.510s 00:26:24.647 user 0m27.297s 00:26:24.647 sys 0m2.843s 00:26:24.647 04:33:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:24.647 04:33:01 -- common/autotest_common.sh@10 -- # set +x 00:26:24.647 ************************************ 00:26:24.647 END TEST nvmf_discovery 00:26:24.647 ************************************ 00:26:24.647 04:33:01 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:24.647 04:33:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:24.647 04:33:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:24.647 04:33:01 -- common/autotest_common.sh@10 -- # set +x 00:26:24.647 ************************************ 00:26:24.647 START TEST nvmf_discovery_remove_ifc 00:26:24.647 ************************************ 00:26:24.647 04:33:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:24.647 * Looking for test storage... 00:26:24.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:24.647 04:33:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:24.647 04:33:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:24.647 04:33:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:24.906 04:33:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:24.906 04:33:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:24.906 04:33:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:24.906 04:33:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:24.906 04:33:01 -- scripts/common.sh@335 -- # IFS=.-: 00:26:24.906 04:33:01 -- scripts/common.sh@335 -- # read -ra ver1 00:26:24.906 04:33:01 -- scripts/common.sh@336 -- # IFS=.-: 00:26:24.906 04:33:01 -- scripts/common.sh@336 -- # read -ra ver2 00:26:24.906 04:33:01 -- scripts/common.sh@337 -- # local 'op=<' 00:26:24.906 04:33:01 -- scripts/common.sh@339 -- # ver1_l=2 00:26:24.906 04:33:01 -- scripts/common.sh@340 -- # ver2_l=1 00:26:24.906 04:33:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:24.906 04:33:01 -- scripts/common.sh@343 -- # case "$op" in 00:26:24.906 04:33:01 -- scripts/common.sh@344 -- # : 1 00:26:24.906 04:33:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:24.906 04:33:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:24.906 04:33:01 -- scripts/common.sh@364 -- # decimal 1 00:26:24.906 04:33:01 -- scripts/common.sh@352 -- # local d=1 00:26:24.906 04:33:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:24.906 04:33:01 -- scripts/common.sh@354 -- # echo 1 00:26:24.906 04:33:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:24.906 04:33:01 -- scripts/common.sh@365 -- # decimal 2 00:26:24.906 04:33:02 -- scripts/common.sh@352 -- # local d=2 00:26:24.906 04:33:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:24.906 04:33:02 -- scripts/common.sh@354 -- # echo 2 00:26:24.906 04:33:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:24.906 04:33:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:24.906 04:33:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:24.906 04:33:02 -- scripts/common.sh@367 -- # return 0 00:26:24.906 04:33:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:24.906 04:33:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:24.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.906 --rc genhtml_branch_coverage=1 00:26:24.906 --rc genhtml_function_coverage=1 00:26:24.906 --rc genhtml_legend=1 00:26:24.906 --rc geninfo_all_blocks=1 00:26:24.906 --rc geninfo_unexecuted_blocks=1 00:26:24.906 00:26:24.906 ' 00:26:24.906 04:33:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:24.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.906 --rc genhtml_branch_coverage=1 00:26:24.906 --rc genhtml_function_coverage=1 00:26:24.906 --rc genhtml_legend=1 00:26:24.906 --rc geninfo_all_blocks=1 00:26:24.906 --rc geninfo_unexecuted_blocks=1 00:26:24.906 00:26:24.906 ' 00:26:24.906 04:33:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:24.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.906 --rc genhtml_branch_coverage=1 00:26:24.906 --rc genhtml_function_coverage=1 00:26:24.906 --rc genhtml_legend=1 00:26:24.906 --rc geninfo_all_blocks=1 00:26:24.906 --rc geninfo_unexecuted_blocks=1 00:26:24.906 00:26:24.906 ' 00:26:24.906 04:33:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:24.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:24.906 --rc genhtml_branch_coverage=1 00:26:24.906 --rc genhtml_function_coverage=1 00:26:24.906 --rc genhtml_legend=1 00:26:24.906 --rc geninfo_all_blocks=1 00:26:24.906 --rc geninfo_unexecuted_blocks=1 00:26:24.906 00:26:24.906 ' 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:24.906 04:33:02 -- nvmf/common.sh@7 -- # uname -s 00:26:24.906 04:33:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:24.906 04:33:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:24.906 04:33:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:24.906 04:33:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:24.906 04:33:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:24.906 04:33:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:24.906 04:33:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:24.906 04:33:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:24.906 04:33:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:24.906 04:33:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:24.906 04:33:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:24.906 04:33:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:24.906 04:33:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:24.906 04:33:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:24.906 04:33:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:24.906 04:33:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:24.906 04:33:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:24.906 04:33:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:24.906 04:33:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:24.906 04:33:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.906 04:33:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.906 04:33:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.906 04:33:02 -- paths/export.sh@5 -- # export PATH 00:26:24.906 04:33:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.906 04:33:02 -- nvmf/common.sh@46 -- # : 0 00:26:24.906 04:33:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:24.906 04:33:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:24.906 04:33:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:24.906 04:33:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:24.906 04:33:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:24.906 04:33:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:24.906 04:33:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:24.906 04:33:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:24.906 04:33:02 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:24.906 04:33:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:24.906 04:33:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:24.906 04:33:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:24.906 04:33:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:24.906 04:33:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:24.906 04:33:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:24.906 04:33:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:24.906 04:33:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:24.906 04:33:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:24.906 04:33:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:24.906 04:33:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:24.906 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:26:26.812 04:33:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:26.812 04:33:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:26.812 04:33:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:26.812 04:33:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:26.812 04:33:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:26.812 04:33:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:26.812 04:33:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:26.812 04:33:03 -- nvmf/common.sh@294 -- # net_devs=() 00:26:26.812 04:33:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:26.812 04:33:03 -- nvmf/common.sh@295 -- # e810=() 00:26:26.812 04:33:03 -- nvmf/common.sh@295 -- # local -ga e810 00:26:26.812 04:33:03 -- nvmf/common.sh@296 -- # x722=() 00:26:26.812 04:33:03 -- nvmf/common.sh@296 -- # local -ga x722 00:26:26.812 04:33:03 -- nvmf/common.sh@297 -- # mlx=() 00:26:26.812 04:33:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:26.812 04:33:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:26.812 04:33:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:26.812 04:33:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:26.812 04:33:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:26.812 04:33:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:26.812 04:33:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:26.812 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:26.812 04:33:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:26.812 04:33:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:26.812 04:33:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:26.812 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:26.813 04:33:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:26.813 04:33:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:26.813 04:33:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:26.813 04:33:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:26.813 04:33:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:26.813 04:33:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:26.813 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:26.813 04:33:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:26.813 04:33:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:26.813 04:33:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:26.813 04:33:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:26.813 04:33:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:26.813 04:33:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:26.813 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:26.813 04:33:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:26.813 04:33:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:26.813 04:33:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:26.813 04:33:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:26.813 04:33:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:26.813 04:33:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:26.813 04:33:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:26.813 04:33:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:26.813 04:33:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:26.813 04:33:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:26.813 04:33:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:26.813 04:33:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:26.813 04:33:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:26.813 04:33:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:26.813 04:33:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:26.813 04:33:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:26.813 04:33:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:26.813 04:33:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:26.813 04:33:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:26.813 04:33:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:26.813 04:33:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:26.813 04:33:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:26.813 04:33:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:27.073 04:33:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:27.073 04:33:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:27.073 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:27.073 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:26:27.073 00:26:27.073 --- 10.0.0.2 ping statistics --- 00:26:27.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:27.073 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:26:27.073 04:33:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:27.073 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:27.073 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:26:27.073 00:26:27.073 --- 10.0.0.1 ping statistics --- 00:26:27.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:27.073 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:26:27.073 04:33:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:27.073 04:33:04 -- nvmf/common.sh@410 -- # return 0 00:26:27.073 04:33:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:27.073 04:33:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:27.073 04:33:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:27.073 04:33:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:27.073 04:33:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:27.073 04:33:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:27.073 04:33:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:27.073 04:33:04 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:27.073 04:33:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:27.073 04:33:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:27.073 04:33:04 -- common/autotest_common.sh@10 -- # set +x 00:26:27.073 04:33:04 -- nvmf/common.sh@469 -- # nvmfpid=4003649 00:26:27.073 04:33:04 -- nvmf/common.sh@470 -- # waitforlisten 4003649 00:26:27.073 04:33:04 -- common/autotest_common.sh@829 -- # '[' -z 4003649 ']' 00:26:27.073 04:33:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:27.073 04:33:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:27.073 04:33:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:27.073 04:33:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:27.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:27.073 04:33:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:27.073 04:33:04 -- common/autotest_common.sh@10 -- # set +x 00:26:27.073 [2024-11-28 04:33:04.209978] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:27.073 [2024-11-28 04:33:04.210057] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:27.073 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.073 [2024-11-28 04:33:04.282707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:27.332 [2024-11-28 04:33:04.392921] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:27.332 [2024-11-28 04:33:04.393078] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:27.332 [2024-11-28 04:33:04.393095] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:27.332 [2024-11-28 04:33:04.393109] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:27.332 [2024-11-28 04:33:04.393138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:27.925 04:33:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:27.925 04:33:05 -- common/autotest_common.sh@862 -- # return 0 00:26:27.925 04:33:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:27.925 04:33:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:27.925 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:26:27.925 04:33:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:27.925 04:33:05 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:27.925 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.925 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:26:28.182 [2024-11-28 04:33:05.245838] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:28.182 [2024-11-28 04:33:05.254013] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:28.182 null0 00:26:28.182 [2024-11-28 04:33:05.285979] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:28.182 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.182 04:33:05 -- host/discovery_remove_ifc.sh@59 -- # hostpid=4003808 00:26:28.182 04:33:05 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:28.182 04:33:05 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 4003808 /tmp/host.sock 00:26:28.182 04:33:05 -- common/autotest_common.sh@829 -- # '[' -z 4003808 ']' 00:26:28.182 04:33:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:28.182 04:33:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:28.182 04:33:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:28.182 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:28.182 04:33:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:28.182 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:26:28.182 [2024-11-28 04:33:05.344956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:28.182 [2024-11-28 04:33:05.345016] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4003808 ] 00:26:28.182 EAL: No free 2048 kB hugepages reported on node 1 00:26:28.182 [2024-11-28 04:33:05.405095] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:28.440 [2024-11-28 04:33:05.519554] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:28.440 [2024-11-28 04:33:05.519728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:28.440 04:33:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:28.440 04:33:05 -- common/autotest_common.sh@862 -- # return 0 00:26:28.440 04:33:05 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:28.440 04:33:05 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:28.440 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.440 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:26:28.440 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.440 04:33:05 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:28.440 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.440 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:26:28.440 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.440 04:33:05 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:28.440 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.440 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:26:29.817 [2024-11-28 04:33:06.693195] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:29.817 [2024-11-28 04:33:06.693229] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:29.817 [2024-11-28 04:33:06.693257] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:29.817 [2024-11-28 04:33:06.821691] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:29.817 [2024-11-28 04:33:06.884179] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:29.817 [2024-11-28 04:33:06.884233] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:29.817 [2024-11-28 04:33:06.884275] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:29.817 [2024-11-28 04:33:06.884301] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:29.817 [2024-11-28 04:33:06.884327] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:29.817 04:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:29.817 04:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.817 04:33:06 -- common/autotest_common.sh@10 -- # set +x 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:29.817 [2024-11-28 04:33:06.891863] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xaf0d40 was disconnected and freed. delete nvme_qpair. 00:26:29.817 04:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:29.817 04:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.817 04:33:06 -- common/autotest_common.sh@10 -- # set +x 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:29.817 04:33:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:29.817 04:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.817 04:33:07 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:29.817 04:33:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:30.757 04:33:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:30.757 04:33:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.757 04:33:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.757 04:33:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:30.757 04:33:08 -- common/autotest_common.sh@10 -- # set +x 00:26:30.757 04:33:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:30.757 04:33:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:30.757 04:33:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.757 04:33:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:30.757 04:33:08 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:32.135 04:33:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.135 04:33:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.135 04:33:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.135 04:33:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.135 04:33:09 -- common/autotest_common.sh@10 -- # set +x 00:26:32.135 04:33:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.135 04:33:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.135 04:33:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.135 04:33:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:32.135 04:33:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:33.076 04:33:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:33.076 04:33:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:33.076 04:33:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:33.076 04:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.076 04:33:10 -- common/autotest_common.sh@10 -- # set +x 00:26:33.076 04:33:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:33.076 04:33:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:33.076 04:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.076 04:33:10 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:33.076 04:33:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.015 04:33:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.015 04:33:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.015 04:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.015 04:33:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.015 04:33:11 -- common/autotest_common.sh@10 -- # set +x 00:26:34.015 04:33:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.015 04:33:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.015 04:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.015 04:33:11 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:34.015 04:33:11 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.956 04:33:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.956 04:33:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.956 04:33:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.956 04:33:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.956 04:33:12 -- common/autotest_common.sh@10 -- # set +x 00:26:34.956 04:33:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.956 04:33:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.957 04:33:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.957 04:33:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:34.957 04:33:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:35.215 [2024-11-28 04:33:12.325447] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:35.215 [2024-11-28 04:33:12.325516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:35.215 [2024-11-28 04:33:12.325549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:35.215 [2024-11-28 04:33:12.325595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:35.215 [2024-11-28 04:33:12.325608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:35.215 [2024-11-28 04:33:12.325621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:35.215 [2024-11-28 04:33:12.325638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:35.215 [2024-11-28 04:33:12.325651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:35.215 [2024-11-28 04:33:12.325663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:35.215 [2024-11-28 04:33:12.325676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:35.215 [2024-11-28 04:33:12.325688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:35.215 [2024-11-28 04:33:12.325700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab7430 is same with the state(5) to be set 00:26:35.215 [2024-11-28 04:33:12.335466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab7430 (9): Bad file descriptor 00:26:35.215 [2024-11-28 04:33:12.345520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:36.152 04:33:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:36.152 04:33:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:36.152 04:33:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.152 04:33:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:36.152 04:33:13 -- common/autotest_common.sh@10 -- # set +x 00:26:36.152 04:33:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:36.152 04:33:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:36.152 [2024-11-28 04:33:13.364555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:37.090 [2024-11-28 04:33:14.388596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:37.090 [2024-11-28 04:33:14.388645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xab7430 with addr=10.0.0.2, port=4420 00:26:37.090 [2024-11-28 04:33:14.388671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xab7430 is same with the state(5) to be set 00:26:37.090 [2024-11-28 04:33:14.388705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:37.090 [2024-11-28 04:33:14.388723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:37.090 [2024-11-28 04:33:14.388737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:37.090 [2024-11-28 04:33:14.388755] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:37.090 [2024-11-28 04:33:14.389184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab7430 (9): Bad file descriptor 00:26:37.090 [2024-11-28 04:33:14.389226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:37.090 [2024-11-28 04:33:14.389272] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:37.090 [2024-11-28 04:33:14.389312] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:37.090 [2024-11-28 04:33:14.389336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:37.090 [2024-11-28 04:33:14.389358] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:37.090 [2024-11-28 04:33:14.389373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:37.090 [2024-11-28 04:33:14.389389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:37.090 [2024-11-28 04:33:14.389404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:37.090 [2024-11-28 04:33:14.389420] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:37.090 [2024-11-28 04:33:14.389436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:37.090 [2024-11-28 04:33:14.389452] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:37.090 [2024-11-28 04:33:14.389467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:37.090 [2024-11-28 04:33:14.389483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:37.090 [2024-11-28 04:33:14.389730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab7840 (9): Bad file descriptor 00:26:37.090 [2024-11-28 04:33:14.390762] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:37.090 [2024-11-28 04:33:14.390784] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:37.090 04:33:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.349 04:33:14 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:37.349 04:33:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.285 04:33:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.285 04:33:15 -- common/autotest_common.sh@10 -- # set +x 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.285 04:33:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.285 04:33:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.285 04:33:15 -- common/autotest_common.sh@10 -- # set +x 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.285 04:33:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:38.285 04:33:15 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:39.222 [2024-11-28 04:33:16.408906] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:39.222 [2024-11-28 04:33:16.408934] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:39.222 [2024-11-28 04:33:16.408960] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:39.222 04:33:16 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.222 04:33:16 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.222 04:33:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.222 04:33:16 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.222 04:33:16 -- common/autotest_common.sh@10 -- # set +x 00:26:39.480 04:33:16 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.480 04:33:16 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.480 [2024-11-28 04:33:16.535386] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:39.480 04:33:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.480 04:33:16 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:39.480 04:33:16 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:39.480 [2024-11-28 04:33:16.631340] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:39.480 [2024-11-28 04:33:16.631393] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:39.480 [2024-11-28 04:33:16.631429] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:39.480 [2024-11-28 04:33:16.631454] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:39.480 [2024-11-28 04:33:16.631468] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:39.480 [2024-11-28 04:33:16.678215] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xad2130 was disconnected and freed. delete nvme_qpair. 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:40.490 04:33:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.490 04:33:17 -- common/autotest_common.sh@10 -- # set +x 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:40.490 04:33:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:40.490 04:33:17 -- host/discovery_remove_ifc.sh@90 -- # killprocess 4003808 00:26:40.490 04:33:17 -- common/autotest_common.sh@936 -- # '[' -z 4003808 ']' 00:26:40.490 04:33:17 -- common/autotest_common.sh@940 -- # kill -0 4003808 00:26:40.490 04:33:17 -- common/autotest_common.sh@941 -- # uname 00:26:40.490 04:33:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:40.490 04:33:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4003808 00:26:40.490 04:33:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:40.490 04:33:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:40.490 04:33:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4003808' 00:26:40.490 killing process with pid 4003808 00:26:40.490 04:33:17 -- common/autotest_common.sh@955 -- # kill 4003808 00:26:40.490 04:33:17 -- common/autotest_common.sh@960 -- # wait 4003808 00:26:40.750 04:33:17 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:40.750 04:33:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:40.750 04:33:17 -- nvmf/common.sh@116 -- # sync 00:26:40.750 04:33:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:40.750 04:33:17 -- nvmf/common.sh@119 -- # set +e 00:26:40.750 04:33:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:40.750 04:33:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:40.750 rmmod nvme_tcp 00:26:40.750 rmmod nvme_fabrics 00:26:40.750 rmmod nvme_keyring 00:26:40.750 04:33:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:40.750 04:33:17 -- nvmf/common.sh@123 -- # set -e 00:26:40.750 04:33:17 -- nvmf/common.sh@124 -- # return 0 00:26:40.750 04:33:17 -- nvmf/common.sh@477 -- # '[' -n 4003649 ']' 00:26:40.750 04:33:17 -- nvmf/common.sh@478 -- # killprocess 4003649 00:26:40.750 04:33:17 -- common/autotest_common.sh@936 -- # '[' -z 4003649 ']' 00:26:40.750 04:33:17 -- common/autotest_common.sh@940 -- # kill -0 4003649 00:26:40.750 04:33:17 -- common/autotest_common.sh@941 -- # uname 00:26:40.750 04:33:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:40.750 04:33:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4003649 00:26:40.750 04:33:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:40.750 04:33:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:40.750 04:33:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4003649' 00:26:40.750 killing process with pid 4003649 00:26:40.750 04:33:18 -- common/autotest_common.sh@955 -- # kill 4003649 00:26:40.750 04:33:18 -- common/autotest_common.sh@960 -- # wait 4003649 00:26:41.009 04:33:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:41.009 04:33:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:41.009 04:33:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:41.010 04:33:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:41.010 04:33:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:41.010 04:33:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:41.010 04:33:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:41.010 04:33:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:43.550 04:33:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:43.550 00:26:43.550 real 0m18.484s 00:26:43.550 user 0m25.754s 00:26:43.550 sys 0m2.877s 00:26:43.550 04:33:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:43.550 04:33:20 -- common/autotest_common.sh@10 -- # set +x 00:26:43.550 ************************************ 00:26:43.550 END TEST nvmf_discovery_remove_ifc 00:26:43.550 ************************************ 00:26:43.550 04:33:20 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:43.550 04:33:20 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:43.550 04:33:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:43.550 04:33:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:43.550 04:33:20 -- common/autotest_common.sh@10 -- # set +x 00:26:43.550 ************************************ 00:26:43.550 START TEST nvmf_digest 00:26:43.550 ************************************ 00:26:43.550 04:33:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:43.550 * Looking for test storage... 00:26:43.550 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:43.550 04:33:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:43.550 04:33:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:43.550 04:33:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:43.550 04:33:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:43.550 04:33:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:43.550 04:33:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:43.550 04:33:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:43.550 04:33:20 -- scripts/common.sh@335 -- # IFS=.-: 00:26:43.550 04:33:20 -- scripts/common.sh@335 -- # read -ra ver1 00:26:43.550 04:33:20 -- scripts/common.sh@336 -- # IFS=.-: 00:26:43.550 04:33:20 -- scripts/common.sh@336 -- # read -ra ver2 00:26:43.550 04:33:20 -- scripts/common.sh@337 -- # local 'op=<' 00:26:43.550 04:33:20 -- scripts/common.sh@339 -- # ver1_l=2 00:26:43.550 04:33:20 -- scripts/common.sh@340 -- # ver2_l=1 00:26:43.550 04:33:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:43.550 04:33:20 -- scripts/common.sh@343 -- # case "$op" in 00:26:43.550 04:33:20 -- scripts/common.sh@344 -- # : 1 00:26:43.550 04:33:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:43.550 04:33:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:43.550 04:33:20 -- scripts/common.sh@364 -- # decimal 1 00:26:43.550 04:33:20 -- scripts/common.sh@352 -- # local d=1 00:26:43.550 04:33:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:43.550 04:33:20 -- scripts/common.sh@354 -- # echo 1 00:26:43.550 04:33:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:43.550 04:33:20 -- scripts/common.sh@365 -- # decimal 2 00:26:43.550 04:33:20 -- scripts/common.sh@352 -- # local d=2 00:26:43.550 04:33:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:43.550 04:33:20 -- scripts/common.sh@354 -- # echo 2 00:26:43.550 04:33:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:43.550 04:33:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:43.550 04:33:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:43.550 04:33:20 -- scripts/common.sh@367 -- # return 0 00:26:43.550 04:33:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:43.550 04:33:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:43.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:43.550 --rc genhtml_branch_coverage=1 00:26:43.550 --rc genhtml_function_coverage=1 00:26:43.550 --rc genhtml_legend=1 00:26:43.550 --rc geninfo_all_blocks=1 00:26:43.550 --rc geninfo_unexecuted_blocks=1 00:26:43.550 00:26:43.550 ' 00:26:43.550 04:33:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:43.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:43.550 --rc genhtml_branch_coverage=1 00:26:43.550 --rc genhtml_function_coverage=1 00:26:43.550 --rc genhtml_legend=1 00:26:43.550 --rc geninfo_all_blocks=1 00:26:43.550 --rc geninfo_unexecuted_blocks=1 00:26:43.550 00:26:43.550 ' 00:26:43.550 04:33:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:43.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:43.550 --rc genhtml_branch_coverage=1 00:26:43.550 --rc genhtml_function_coverage=1 00:26:43.550 --rc genhtml_legend=1 00:26:43.550 --rc geninfo_all_blocks=1 00:26:43.550 --rc geninfo_unexecuted_blocks=1 00:26:43.550 00:26:43.550 ' 00:26:43.550 04:33:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:43.550 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:43.550 --rc genhtml_branch_coverage=1 00:26:43.550 --rc genhtml_function_coverage=1 00:26:43.550 --rc genhtml_legend=1 00:26:43.550 --rc geninfo_all_blocks=1 00:26:43.550 --rc geninfo_unexecuted_blocks=1 00:26:43.550 00:26:43.550 ' 00:26:43.550 04:33:20 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:43.550 04:33:20 -- nvmf/common.sh@7 -- # uname -s 00:26:43.550 04:33:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:43.550 04:33:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:43.550 04:33:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:43.550 04:33:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:43.550 04:33:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:43.550 04:33:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:43.550 04:33:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:43.550 04:33:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:43.550 04:33:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:43.550 04:33:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:43.550 04:33:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:43.550 04:33:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:43.550 04:33:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:43.550 04:33:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:43.550 04:33:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:43.550 04:33:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:43.550 04:33:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:43.550 04:33:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:43.550 04:33:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:43.550 04:33:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.550 04:33:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.550 04:33:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.550 04:33:20 -- paths/export.sh@5 -- # export PATH 00:26:43.550 04:33:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:43.550 04:33:20 -- nvmf/common.sh@46 -- # : 0 00:26:43.550 04:33:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:43.550 04:33:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:43.550 04:33:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:43.550 04:33:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:43.550 04:33:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:43.550 04:33:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:43.550 04:33:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:43.550 04:33:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:43.550 04:33:20 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:43.550 04:33:20 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:43.550 04:33:20 -- host/digest.sh@16 -- # runtime=2 00:26:43.550 04:33:20 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:43.550 04:33:20 -- host/digest.sh@132 -- # nvmftestinit 00:26:43.550 04:33:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:43.551 04:33:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:43.551 04:33:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:43.551 04:33:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:43.551 04:33:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:43.551 04:33:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:43.551 04:33:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:43.551 04:33:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:43.551 04:33:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:43.551 04:33:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:43.551 04:33:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:43.551 04:33:20 -- common/autotest_common.sh@10 -- # set +x 00:26:45.457 04:33:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:45.457 04:33:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:45.457 04:33:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:45.457 04:33:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:45.457 04:33:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:45.457 04:33:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:45.457 04:33:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:45.457 04:33:22 -- nvmf/common.sh@294 -- # net_devs=() 00:26:45.457 04:33:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:45.457 04:33:22 -- nvmf/common.sh@295 -- # e810=() 00:26:45.457 04:33:22 -- nvmf/common.sh@295 -- # local -ga e810 00:26:45.457 04:33:22 -- nvmf/common.sh@296 -- # x722=() 00:26:45.457 04:33:22 -- nvmf/common.sh@296 -- # local -ga x722 00:26:45.457 04:33:22 -- nvmf/common.sh@297 -- # mlx=() 00:26:45.457 04:33:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:45.457 04:33:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:45.457 04:33:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:45.457 04:33:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:45.457 04:33:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:45.457 04:33:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:45.457 04:33:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:45.457 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:45.457 04:33:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:45.457 04:33:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:45.457 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:45.457 04:33:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:45.457 04:33:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:45.457 04:33:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.457 04:33:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:45.457 04:33:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.457 04:33:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:45.457 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:45.457 04:33:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.457 04:33:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:45.457 04:33:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.457 04:33:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:45.457 04:33:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.457 04:33:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:45.457 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:45.457 04:33:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.457 04:33:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:45.457 04:33:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:45.457 04:33:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:45.457 04:33:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:45.457 04:33:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:45.457 04:33:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:45.457 04:33:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:45.457 04:33:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:45.457 04:33:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:45.457 04:33:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:45.457 04:33:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:45.457 04:33:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:45.457 04:33:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:45.457 04:33:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:45.457 04:33:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:45.457 04:33:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:45.457 04:33:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:45.457 04:33:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:45.457 04:33:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:45.457 04:33:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:45.457 04:33:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:45.458 04:33:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:45.458 04:33:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:45.458 04:33:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:45.458 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:45.458 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.354 ms 00:26:45.458 00:26:45.458 --- 10.0.0.2 ping statistics --- 00:26:45.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:45.458 rtt min/avg/max/mdev = 0.354/0.354/0.354/0.000 ms 00:26:45.458 04:33:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:45.458 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:45.458 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:26:45.458 00:26:45.458 --- 10.0.0.1 ping statistics --- 00:26:45.458 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:45.458 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:26:45.458 04:33:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:45.458 04:33:22 -- nvmf/common.sh@410 -- # return 0 00:26:45.458 04:33:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:45.458 04:33:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:45.458 04:33:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:45.458 04:33:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:45.458 04:33:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:45.458 04:33:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:45.458 04:33:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:45.716 04:33:22 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:45.717 04:33:22 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:45.717 04:33:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:45.717 04:33:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:45.717 04:33:22 -- common/autotest_common.sh@10 -- # set +x 00:26:45.717 ************************************ 00:26:45.717 START TEST nvmf_digest_clean 00:26:45.717 ************************************ 00:26:45.717 04:33:22 -- common/autotest_common.sh@1114 -- # run_digest 00:26:45.717 04:33:22 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:45.717 04:33:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:45.717 04:33:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:45.717 04:33:22 -- common/autotest_common.sh@10 -- # set +x 00:26:45.717 04:33:22 -- nvmf/common.sh@469 -- # nvmfpid=4007838 00:26:45.717 04:33:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:45.717 04:33:22 -- nvmf/common.sh@470 -- # waitforlisten 4007838 00:26:45.717 04:33:22 -- common/autotest_common.sh@829 -- # '[' -z 4007838 ']' 00:26:45.717 04:33:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:45.717 04:33:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:45.717 04:33:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:45.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:45.717 04:33:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:45.717 04:33:22 -- common/autotest_common.sh@10 -- # set +x 00:26:45.717 [2024-11-28 04:33:22.827107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:45.717 [2024-11-28 04:33:22.827182] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:45.717 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.717 [2024-11-28 04:33:22.892721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:45.717 [2024-11-28 04:33:23.002250] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:45.717 [2024-11-28 04:33:23.002390] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:45.717 [2024-11-28 04:33:23.002407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:45.717 [2024-11-28 04:33:23.002419] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:45.717 [2024-11-28 04:33:23.002446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:45.975 04:33:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:45.976 04:33:23 -- common/autotest_common.sh@862 -- # return 0 00:26:45.976 04:33:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:45.976 04:33:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:45.976 04:33:23 -- common/autotest_common.sh@10 -- # set +x 00:26:45.976 04:33:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:45.976 04:33:23 -- host/digest.sh@120 -- # common_target_config 00:26:45.976 04:33:23 -- host/digest.sh@43 -- # rpc_cmd 00:26:45.976 04:33:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.976 04:33:23 -- common/autotest_common.sh@10 -- # set +x 00:26:45.976 null0 00:26:45.976 [2024-11-28 04:33:23.195451] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:45.976 [2024-11-28 04:33:23.219676] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:45.976 04:33:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.976 04:33:23 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:45.976 04:33:23 -- host/digest.sh@77 -- # local rw bs qd 00:26:45.976 04:33:23 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:45.976 04:33:23 -- host/digest.sh@80 -- # rw=randread 00:26:45.976 04:33:23 -- host/digest.sh@80 -- # bs=4096 00:26:45.976 04:33:23 -- host/digest.sh@80 -- # qd=128 00:26:45.976 04:33:23 -- host/digest.sh@82 -- # bperfpid=4007973 00:26:45.976 04:33:23 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:45.976 04:33:23 -- host/digest.sh@83 -- # waitforlisten 4007973 /var/tmp/bperf.sock 00:26:45.976 04:33:23 -- common/autotest_common.sh@829 -- # '[' -z 4007973 ']' 00:26:45.976 04:33:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:45.976 04:33:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:45.976 04:33:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:45.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:45.976 04:33:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:45.976 04:33:23 -- common/autotest_common.sh@10 -- # set +x 00:26:45.976 [2024-11-28 04:33:23.263932] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:45.976 [2024-11-28 04:33:23.263992] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4007973 ] 00:26:46.234 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.234 [2024-11-28 04:33:23.325686] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:46.234 [2024-11-28 04:33:23.440253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:46.234 04:33:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:46.234 04:33:23 -- common/autotest_common.sh@862 -- # return 0 00:26:46.234 04:33:23 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:46.234 04:33:23 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:46.234 04:33:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:46.801 04:33:23 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.801 04:33:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:47.369 nvme0n1 00:26:47.369 04:33:24 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:47.369 04:33:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:47.369 Running I/O for 2 seconds... 00:26:49.278 00:26:49.278 Latency(us) 00:26:49.278 [2024-11-28T03:33:26.589Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.278 [2024-11-28T03:33:26.589Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:49.278 nvme0n1 : 2.00 16175.62 63.19 0.00 0.00 7907.18 2949.12 18155.90 00:26:49.278 [2024-11-28T03:33:26.589Z] =================================================================================================================== 00:26:49.278 [2024-11-28T03:33:26.589Z] Total : 16175.62 63.19 0.00 0.00 7907.18 2949.12 18155.90 00:26:49.278 0 00:26:49.278 04:33:26 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:49.278 04:33:26 -- host/digest.sh@92 -- # get_accel_stats 00:26:49.278 04:33:26 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:49.278 04:33:26 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:49.278 | select(.opcode=="crc32c") 00:26:49.278 | "\(.module_name) \(.executed)"' 00:26:49.279 04:33:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:49.537 04:33:26 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:49.537 04:33:26 -- host/digest.sh@93 -- # exp_module=software 00:26:49.537 04:33:26 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:49.537 04:33:26 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:49.537 04:33:26 -- host/digest.sh@97 -- # killprocess 4007973 00:26:49.537 04:33:26 -- common/autotest_common.sh@936 -- # '[' -z 4007973 ']' 00:26:49.537 04:33:26 -- common/autotest_common.sh@940 -- # kill -0 4007973 00:26:49.537 04:33:26 -- common/autotest_common.sh@941 -- # uname 00:26:49.797 04:33:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:49.797 04:33:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4007973 00:26:49.797 04:33:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:49.797 04:33:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:49.797 04:33:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4007973' 00:26:49.797 killing process with pid 4007973 00:26:49.797 04:33:26 -- common/autotest_common.sh@955 -- # kill 4007973 00:26:49.797 Received shutdown signal, test time was about 2.000000 seconds 00:26:49.797 00:26:49.797 Latency(us) 00:26:49.797 [2024-11-28T03:33:27.108Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.797 [2024-11-28T03:33:27.108Z] =================================================================================================================== 00:26:49.797 [2024-11-28T03:33:27.108Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:49.797 04:33:26 -- common/autotest_common.sh@960 -- # wait 4007973 00:26:50.056 04:33:27 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:50.056 04:33:27 -- host/digest.sh@77 -- # local rw bs qd 00:26:50.056 04:33:27 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:50.056 04:33:27 -- host/digest.sh@80 -- # rw=randread 00:26:50.056 04:33:27 -- host/digest.sh@80 -- # bs=131072 00:26:50.056 04:33:27 -- host/digest.sh@80 -- # qd=16 00:26:50.056 04:33:27 -- host/digest.sh@82 -- # bperfpid=4008424 00:26:50.056 04:33:27 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:50.056 04:33:27 -- host/digest.sh@83 -- # waitforlisten 4008424 /var/tmp/bperf.sock 00:26:50.056 04:33:27 -- common/autotest_common.sh@829 -- # '[' -z 4008424 ']' 00:26:50.056 04:33:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:50.056 04:33:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:50.056 04:33:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:50.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:50.056 04:33:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:50.056 04:33:27 -- common/autotest_common.sh@10 -- # set +x 00:26:50.056 [2024-11-28 04:33:27.203206] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:50.056 [2024-11-28 04:33:27.203296] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4008424 ] 00:26:50.056 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:50.056 Zero copy mechanism will not be used. 00:26:50.056 EAL: No free 2048 kB hugepages reported on node 1 00:26:50.056 [2024-11-28 04:33:27.264500] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:50.314 [2024-11-28 04:33:27.376408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:50.314 04:33:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:50.314 04:33:27 -- common/autotest_common.sh@862 -- # return 0 00:26:50.314 04:33:27 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:50.314 04:33:27 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:50.314 04:33:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:50.572 04:33:27 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:50.572 04:33:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:50.831 nvme0n1 00:26:50.831 04:33:28 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:50.831 04:33:28 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:51.091 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:51.091 Zero copy mechanism will not be used. 00:26:51.091 Running I/O for 2 seconds... 00:26:52.998 00:26:52.998 Latency(us) 00:26:52.998 [2024-11-28T03:33:30.309Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:52.998 [2024-11-28T03:33:30.309Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:52.998 nvme0n1 : 2.00 4745.42 593.18 0.00 0.00 3367.32 1037.65 12815.93 00:26:52.998 [2024-11-28T03:33:30.309Z] =================================================================================================================== 00:26:52.998 [2024-11-28T03:33:30.309Z] Total : 4745.42 593.18 0.00 0.00 3367.32 1037.65 12815.93 00:26:52.998 0 00:26:52.998 04:33:30 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:52.998 04:33:30 -- host/digest.sh@92 -- # get_accel_stats 00:26:52.998 04:33:30 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:52.998 04:33:30 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:52.998 | select(.opcode=="crc32c") 00:26:52.998 | "\(.module_name) \(.executed)"' 00:26:52.998 04:33:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:53.257 04:33:30 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:53.257 04:33:30 -- host/digest.sh@93 -- # exp_module=software 00:26:53.257 04:33:30 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:53.257 04:33:30 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:53.257 04:33:30 -- host/digest.sh@97 -- # killprocess 4008424 00:26:53.257 04:33:30 -- common/autotest_common.sh@936 -- # '[' -z 4008424 ']' 00:26:53.257 04:33:30 -- common/autotest_common.sh@940 -- # kill -0 4008424 00:26:53.257 04:33:30 -- common/autotest_common.sh@941 -- # uname 00:26:53.257 04:33:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:53.257 04:33:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4008424 00:26:53.257 04:33:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:53.257 04:33:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:53.257 04:33:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4008424' 00:26:53.257 killing process with pid 4008424 00:26:53.257 04:33:30 -- common/autotest_common.sh@955 -- # kill 4008424 00:26:53.257 Received shutdown signal, test time was about 2.000000 seconds 00:26:53.257 00:26:53.257 Latency(us) 00:26:53.257 [2024-11-28T03:33:30.568Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:53.257 [2024-11-28T03:33:30.568Z] =================================================================================================================== 00:26:53.257 [2024-11-28T03:33:30.568Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:53.257 04:33:30 -- common/autotest_common.sh@960 -- # wait 4008424 00:26:53.826 04:33:30 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:53.826 04:33:30 -- host/digest.sh@77 -- # local rw bs qd 00:26:53.826 04:33:30 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:53.826 04:33:30 -- host/digest.sh@80 -- # rw=randwrite 00:26:53.826 04:33:30 -- host/digest.sh@80 -- # bs=4096 00:26:53.826 04:33:30 -- host/digest.sh@80 -- # qd=128 00:26:53.826 04:33:30 -- host/digest.sh@82 -- # bperfpid=4008840 00:26:53.826 04:33:30 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:53.826 04:33:30 -- host/digest.sh@83 -- # waitforlisten 4008840 /var/tmp/bperf.sock 00:26:53.826 04:33:30 -- common/autotest_common.sh@829 -- # '[' -z 4008840 ']' 00:26:53.826 04:33:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:53.826 04:33:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:53.826 04:33:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:53.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:53.826 04:33:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:53.826 04:33:30 -- common/autotest_common.sh@10 -- # set +x 00:26:53.826 [2024-11-28 04:33:30.872685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:53.826 [2024-11-28 04:33:30.872777] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4008840 ] 00:26:53.826 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.826 [2024-11-28 04:33:30.933673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:53.826 [2024-11-28 04:33:31.045649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:53.826 04:33:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:53.826 04:33:31 -- common/autotest_common.sh@862 -- # return 0 00:26:53.826 04:33:31 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:53.826 04:33:31 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:53.826 04:33:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:54.397 04:33:31 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:54.397 04:33:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:54.657 nvme0n1 00:26:54.657 04:33:31 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:54.657 04:33:31 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:54.657 Running I/O for 2 seconds... 00:26:57.196 00:26:57.196 Latency(us) 00:26:57.196 [2024-11-28T03:33:34.507Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:57.196 [2024-11-28T03:33:34.507Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:57.196 nvme0n1 : 2.01 17929.33 70.04 0.00 0.00 7123.30 6043.88 13495.56 00:26:57.196 [2024-11-28T03:33:34.507Z] =================================================================================================================== 00:26:57.196 [2024-11-28T03:33:34.507Z] Total : 17929.33 70.04 0.00 0.00 7123.30 6043.88 13495.56 00:26:57.196 0 00:26:57.196 04:33:33 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:57.196 04:33:33 -- host/digest.sh@92 -- # get_accel_stats 00:26:57.196 04:33:33 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:57.196 04:33:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:57.196 04:33:33 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:57.196 | select(.opcode=="crc32c") 00:26:57.196 | "\(.module_name) \(.executed)"' 00:26:57.196 04:33:34 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:57.196 04:33:34 -- host/digest.sh@93 -- # exp_module=software 00:26:57.196 04:33:34 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:57.196 04:33:34 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:57.196 04:33:34 -- host/digest.sh@97 -- # killprocess 4008840 00:26:57.196 04:33:34 -- common/autotest_common.sh@936 -- # '[' -z 4008840 ']' 00:26:57.196 04:33:34 -- common/autotest_common.sh@940 -- # kill -0 4008840 00:26:57.196 04:33:34 -- common/autotest_common.sh@941 -- # uname 00:26:57.196 04:33:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:57.196 04:33:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4008840 00:26:57.196 04:33:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:57.196 04:33:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:57.196 04:33:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4008840' 00:26:57.196 killing process with pid 4008840 00:26:57.196 04:33:34 -- common/autotest_common.sh@955 -- # kill 4008840 00:26:57.196 Received shutdown signal, test time was about 2.000000 seconds 00:26:57.196 00:26:57.196 Latency(us) 00:26:57.196 [2024-11-28T03:33:34.507Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:57.196 [2024-11-28T03:33:34.507Z] =================================================================================================================== 00:26:57.196 [2024-11-28T03:33:34.507Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:57.196 04:33:34 -- common/autotest_common.sh@960 -- # wait 4008840 00:26:57.456 04:33:34 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:57.456 04:33:34 -- host/digest.sh@77 -- # local rw bs qd 00:26:57.456 04:33:34 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:57.456 04:33:34 -- host/digest.sh@80 -- # rw=randwrite 00:26:57.456 04:33:34 -- host/digest.sh@80 -- # bs=131072 00:26:57.456 04:33:34 -- host/digest.sh@80 -- # qd=16 00:26:57.456 04:33:34 -- host/digest.sh@82 -- # bperfpid=4009313 00:26:57.456 04:33:34 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:57.456 04:33:34 -- host/digest.sh@83 -- # waitforlisten 4009313 /var/tmp/bperf.sock 00:26:57.456 04:33:34 -- common/autotest_common.sh@829 -- # '[' -z 4009313 ']' 00:26:57.456 04:33:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:57.456 04:33:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.456 04:33:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:57.456 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:57.456 04:33:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.456 04:33:34 -- common/autotest_common.sh@10 -- # set +x 00:26:57.456 [2024-11-28 04:33:34.554439] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.456 [2024-11-28 04:33:34.554544] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4009313 ] 00:26:57.456 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:57.456 Zero copy mechanism will not be used. 00:26:57.456 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.456 [2024-11-28 04:33:34.616560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.456 [2024-11-28 04:33:34.729346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.715 04:33:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.715 04:33:34 -- common/autotest_common.sh@862 -- # return 0 00:26:57.715 04:33:34 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:57.715 04:33:34 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:57.715 04:33:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:57.974 04:33:35 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.974 04:33:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:58.542 nvme0n1 00:26:58.542 04:33:35 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:58.542 04:33:35 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:58.542 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:58.542 Zero copy mechanism will not be used. 00:26:58.542 Running I/O for 2 seconds... 00:27:01.082 00:27:01.082 Latency(us) 00:27:01.082 [2024-11-28T03:33:38.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.082 [2024-11-28T03:33:38.393Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:01.082 nvme0n1 : 2.00 6116.88 764.61 0.00 0.00 2608.18 1881.13 5776.88 00:27:01.082 [2024-11-28T03:33:38.393Z] =================================================================================================================== 00:27:01.082 [2024-11-28T03:33:38.393Z] Total : 6116.88 764.61 0.00 0.00 2608.18 1881.13 5776.88 00:27:01.082 0 00:27:01.082 04:33:37 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:01.082 04:33:37 -- host/digest.sh@92 -- # get_accel_stats 00:27:01.082 04:33:37 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:01.082 04:33:37 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:01.082 | select(.opcode=="crc32c") 00:27:01.082 | "\(.module_name) \(.executed)"' 00:27:01.082 04:33:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:01.082 04:33:38 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:01.082 04:33:38 -- host/digest.sh@93 -- # exp_module=software 00:27:01.082 04:33:38 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:01.082 04:33:38 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:01.082 04:33:38 -- host/digest.sh@97 -- # killprocess 4009313 00:27:01.082 04:33:38 -- common/autotest_common.sh@936 -- # '[' -z 4009313 ']' 00:27:01.082 04:33:38 -- common/autotest_common.sh@940 -- # kill -0 4009313 00:27:01.082 04:33:38 -- common/autotest_common.sh@941 -- # uname 00:27:01.082 04:33:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.082 04:33:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4009313 00:27:01.082 04:33:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:01.082 04:33:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:01.082 04:33:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4009313' 00:27:01.082 killing process with pid 4009313 00:27:01.082 04:33:38 -- common/autotest_common.sh@955 -- # kill 4009313 00:27:01.082 Received shutdown signal, test time was about 2.000000 seconds 00:27:01.082 00:27:01.082 Latency(us) 00:27:01.082 [2024-11-28T03:33:38.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.082 [2024-11-28T03:33:38.393Z] =================================================================================================================== 00:27:01.082 [2024-11-28T03:33:38.393Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:01.082 04:33:38 -- common/autotest_common.sh@960 -- # wait 4009313 00:27:01.082 04:33:38 -- host/digest.sh@126 -- # killprocess 4007838 00:27:01.082 04:33:38 -- common/autotest_common.sh@936 -- # '[' -z 4007838 ']' 00:27:01.082 04:33:38 -- common/autotest_common.sh@940 -- # kill -0 4007838 00:27:01.082 04:33:38 -- common/autotest_common.sh@941 -- # uname 00:27:01.082 04:33:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.082 04:33:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4007838 00:27:01.342 04:33:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:01.342 04:33:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:01.342 04:33:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4007838' 00:27:01.342 killing process with pid 4007838 00:27:01.342 04:33:38 -- common/autotest_common.sh@955 -- # kill 4007838 00:27:01.342 04:33:38 -- common/autotest_common.sh@960 -- # wait 4007838 00:27:01.601 00:27:01.601 real 0m15.933s 00:27:01.601 user 0m31.684s 00:27:01.601 sys 0m4.307s 00:27:01.601 04:33:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:01.601 04:33:38 -- common/autotest_common.sh@10 -- # set +x 00:27:01.601 ************************************ 00:27:01.601 END TEST nvmf_digest_clean 00:27:01.601 ************************************ 00:27:01.601 04:33:38 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:01.601 04:33:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:01.601 04:33:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:01.601 04:33:38 -- common/autotest_common.sh@10 -- # set +x 00:27:01.601 ************************************ 00:27:01.601 START TEST nvmf_digest_error 00:27:01.601 ************************************ 00:27:01.601 04:33:38 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:01.601 04:33:38 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:01.601 04:33:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:01.601 04:33:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:01.601 04:33:38 -- common/autotest_common.sh@10 -- # set +x 00:27:01.601 04:33:38 -- nvmf/common.sh@469 -- # nvmfpid=4009838 00:27:01.601 04:33:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:01.601 04:33:38 -- nvmf/common.sh@470 -- # waitforlisten 4009838 00:27:01.601 04:33:38 -- common/autotest_common.sh@829 -- # '[' -z 4009838 ']' 00:27:01.601 04:33:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:01.601 04:33:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:01.601 04:33:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:01.601 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:01.601 04:33:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:01.601 04:33:38 -- common/autotest_common.sh@10 -- # set +x 00:27:01.601 [2024-11-28 04:33:38.785658] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:01.601 [2024-11-28 04:33:38.785734] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:01.601 EAL: No free 2048 kB hugepages reported on node 1 00:27:01.601 [2024-11-28 04:33:38.853379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:01.859 [2024-11-28 04:33:38.969350] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:01.859 [2024-11-28 04:33:38.969511] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:01.859 [2024-11-28 04:33:38.969541] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:01.860 [2024-11-28 04:33:38.969558] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:01.860 [2024-11-28 04:33:38.969611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:01.860 04:33:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:01.860 04:33:39 -- common/autotest_common.sh@862 -- # return 0 00:27:01.860 04:33:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:01.860 04:33:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:01.860 04:33:39 -- common/autotest_common.sh@10 -- # set +x 00:27:01.860 04:33:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:01.860 04:33:39 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:01.860 04:33:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.860 04:33:39 -- common/autotest_common.sh@10 -- # set +x 00:27:01.860 [2024-11-28 04:33:39.058278] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:01.860 04:33:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.860 04:33:39 -- host/digest.sh@104 -- # common_target_config 00:27:01.860 04:33:39 -- host/digest.sh@43 -- # rpc_cmd 00:27:01.860 04:33:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.860 04:33:39 -- common/autotest_common.sh@10 -- # set +x 00:27:02.118 null0 00:27:02.118 [2024-11-28 04:33:39.175302] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:02.118 [2024-11-28 04:33:39.199523] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:02.118 04:33:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:02.118 04:33:39 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:02.118 04:33:39 -- host/digest.sh@54 -- # local rw bs qd 00:27:02.118 04:33:39 -- host/digest.sh@56 -- # rw=randread 00:27:02.118 04:33:39 -- host/digest.sh@56 -- # bs=4096 00:27:02.118 04:33:39 -- host/digest.sh@56 -- # qd=128 00:27:02.118 04:33:39 -- host/digest.sh@58 -- # bperfpid=4009987 00:27:02.118 04:33:39 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:02.118 04:33:39 -- host/digest.sh@60 -- # waitforlisten 4009987 /var/tmp/bperf.sock 00:27:02.118 04:33:39 -- common/autotest_common.sh@829 -- # '[' -z 4009987 ']' 00:27:02.118 04:33:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:02.118 04:33:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:02.118 04:33:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:02.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:02.118 04:33:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:02.118 04:33:39 -- common/autotest_common.sh@10 -- # set +x 00:27:02.118 [2024-11-28 04:33:39.243034] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:02.118 [2024-11-28 04:33:39.243091] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4009987 ] 00:27:02.118 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.118 [2024-11-28 04:33:39.303589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:02.118 [2024-11-28 04:33:39.417419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.055 04:33:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:03.055 04:33:40 -- common/autotest_common.sh@862 -- # return 0 00:27:03.055 04:33:40 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:03.055 04:33:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:03.313 04:33:40 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:03.313 04:33:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.313 04:33:40 -- common/autotest_common.sh@10 -- # set +x 00:27:03.313 04:33:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.313 04:33:40 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:03.313 04:33:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:03.880 nvme0n1 00:27:03.880 04:33:41 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:03.880 04:33:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.880 04:33:41 -- common/autotest_common.sh@10 -- # set +x 00:27:03.880 04:33:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.880 04:33:41 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:03.880 04:33:41 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:03.880 Running I/O for 2 seconds... 00:27:04.139 [2024-11-28 04:33:41.192351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.192410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24121 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.192432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.203376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.203409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.203425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.218117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.218150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:6418 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.218167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.233702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.233735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:1308 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.233752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.243353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.243383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:123 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.243399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.257693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.257724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:1025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.257741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.273684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.273716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.273733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.288793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.288824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6055 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.288855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.299139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.299178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:13408 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.299196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.313639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.313667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:16630 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.313682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.329161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.329193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:12906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.329210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.345022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.139 [2024-11-28 04:33:41.345053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22368 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.139 [2024-11-28 04:33:41.345069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.139 [2024-11-28 04:33:41.360255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.140 [2024-11-28 04:33:41.360285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:2040 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.140 [2024-11-28 04:33:41.360301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.140 [2024-11-28 04:33:41.375710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.140 [2024-11-28 04:33:41.375742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22993 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.140 [2024-11-28 04:33:41.375759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.140 [2024-11-28 04:33:41.391127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.140 [2024-11-28 04:33:41.391157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.140 [2024-11-28 04:33:41.391172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.140 [2024-11-28 04:33:41.406594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.140 [2024-11-28 04:33:41.406625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7844 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.140 [2024-11-28 04:33:41.406642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.140 [2024-11-28 04:33:41.421814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.140 [2024-11-28 04:33:41.421857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6010 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.140 [2024-11-28 04:33:41.421873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.140 [2024-11-28 04:33:41.437179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.140 [2024-11-28 04:33:41.437210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:3723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.140 [2024-11-28 04:33:41.437227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.400 [2024-11-28 04:33:41.454021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.400 [2024-11-28 04:33:41.454057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:14737 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.400 [2024-11-28 04:33:41.454076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.400 [2024-11-28 04:33:41.470963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.400 [2024-11-28 04:33:41.470999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.400 [2024-11-28 04:33:41.471019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.400 [2024-11-28 04:33:41.488237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.400 [2024-11-28 04:33:41.488272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:8020 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.400 [2024-11-28 04:33:41.488291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.400 [2024-11-28 04:33:41.505475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.400 [2024-11-28 04:33:41.505510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4300 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.400 [2024-11-28 04:33:41.505536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.400 [2024-11-28 04:33:41.522482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.400 [2024-11-28 04:33:41.522516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:16643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.400 [2024-11-28 04:33:41.522547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.400 [2024-11-28 04:33:41.539517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.400 [2024-11-28 04:33:41.539561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:194 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.400 [2024-11-28 04:33:41.539594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.556323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.556358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6690 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.556376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.573694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.573724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:19944 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.573746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.590642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.590671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.590687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.607624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.607653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14793 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.607668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.624451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.624485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:3757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.624504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.641425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.641459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:24810 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.641477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.658328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.658363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:609 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.658382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.675345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.675380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.675398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.692314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.692349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:17907 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.692367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.401 [2024-11-28 04:33:41.709277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.401 [2024-11-28 04:33:41.709312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10376 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.401 [2024-11-28 04:33:41.709331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.726405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.726446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:13765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.726466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.743432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.743466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:13159 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.743485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.760381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.760415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:12573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.760435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.777632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.777660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:3370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.777676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.794723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.794751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:18069 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.794767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.811622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.811650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:10317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.811667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.828869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.828904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:22409 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.828922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.845878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.845919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:16103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.845938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.862769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.862798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:1671 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.862828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.879915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.879950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6299 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.879968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.896958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.896993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24769 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.897012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.913889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.913924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:14215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.913942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.931048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.931081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:12924 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.931099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.948064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.948098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:1074 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.948116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.662 [2024-11-28 04:33:41.964967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.662 [2024-11-28 04:33:41.965001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:3714 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.662 [2024-11-28 04:33:41.965020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:41.982102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:41.982138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:23681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:41.982157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:41.998985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:41.999019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:9354 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:41.999038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.016239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.016274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.016300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.032954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.032990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:8884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.033009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.050342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.050376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:4349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.050394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.067352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.067387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:9714 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.067405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.084339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.084374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:18472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.084393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.101358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.101392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:4472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.101411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.118216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.118250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.118269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.135182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.135216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.135235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.152205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.152239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:7607 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.152258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.169215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.169249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:4884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.169268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.186218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.186252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:22920 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.186271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.203096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.203130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:24531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.203149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.921 [2024-11-28 04:33:42.220143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:04.921 [2024-11-28 04:33:42.220178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.921 [2024-11-28 04:33:42.220196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.236796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.236843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:4615 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.236863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.253782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.253810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.253827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.270929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.270964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23746 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.270983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.288320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.288355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:8981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.288374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.305149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.305183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.305209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.322161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.322196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20518 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.322215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.339058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.339092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:12795 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.339110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.356063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.356098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:12853 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.356117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.373116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.373150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:14540 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.373169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.390289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.390323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.390342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.407367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.407403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25263 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.407422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.424470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.424508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:6906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.424536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.441369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.441403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:3718 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.441423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.458006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.458047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:8912 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.458067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.180 [2024-11-28 04:33:42.474765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.180 [2024-11-28 04:33:42.474797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:19781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.180 [2024-11-28 04:33:42.474832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.492011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.492042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:2756 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.492066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.509072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.509106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.509131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.526132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.526166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:15851 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.526189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.543431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.543465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:18765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.543487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.560697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.560726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:21921 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.560742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.577457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.577491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:11472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.577517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.594389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.594423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3714 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.594450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.611463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.611497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.611516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.628371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.628405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:24659 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.628426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.645413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.645447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:2664 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.645466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.662398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.662432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23792 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.662451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.679438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.679472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:4600 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.679494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.696621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.696650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:21062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.696666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.713415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.713450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:17398 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.713475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.730426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.730460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11066 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.730479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.439 [2024-11-28 04:33:42.747186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.439 [2024-11-28 04:33:42.747215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:4528 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.439 [2024-11-28 04:33:42.747242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.763870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.763904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:5022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.763923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.781059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.781093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:17783 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.781112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.797675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.797702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:12057 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.797720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.814487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.814521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.814573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.831420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.831455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:7974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.831473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.848341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.848375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17173 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.848395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.864855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.864888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:18421 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.864907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.881539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.881585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:6027 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.881603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.897948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.897988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:5216 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.898008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.914898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.697 [2024-11-28 04:33:42.914932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:811 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.697 [2024-11-28 04:33:42.914951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.697 [2024-11-28 04:33:42.931660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.698 [2024-11-28 04:33:42.931689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:4322 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.698 [2024-11-28 04:33:42.931706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.698 [2024-11-28 04:33:42.948721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.698 [2024-11-28 04:33:42.948751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1507 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.698 [2024-11-28 04:33:42.948767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.698 [2024-11-28 04:33:42.965577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.698 [2024-11-28 04:33:42.965606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:21884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.698 [2024-11-28 04:33:42.965624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.698 [2024-11-28 04:33:42.982495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.698 [2024-11-28 04:33:42.982535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:13381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.698 [2024-11-28 04:33:42.982573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.698 [2024-11-28 04:33:42.999798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.698 [2024-11-28 04:33:42.999844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:3755 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.698 [2024-11-28 04:33:42.999863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.017177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.017212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:3064 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.956 [2024-11-28 04:33:43.017236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.033752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.033779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:13656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.956 [2024-11-28 04:33:43.033802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.045099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.045133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:6945 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.956 [2024-11-28 04:33:43.045152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.060693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.060723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:1478 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.956 [2024-11-28 04:33:43.060740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.077364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.077398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:7900 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.956 [2024-11-28 04:33:43.077418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.094157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.094192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:10628 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.956 [2024-11-28 04:33:43.094211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.110962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.110996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:19623 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.956 [2024-11-28 04:33:43.111015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.956 [2024-11-28 04:33:43.127924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.956 [2024-11-28 04:33:43.127958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:24666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.957 [2024-11-28 04:33:43.127977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.957 [2024-11-28 04:33:43.144767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.957 [2024-11-28 04:33:43.144809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:5843 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.957 [2024-11-28 04:33:43.144829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.957 [2024-11-28 04:33:43.161451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.957 [2024-11-28 04:33:43.161484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:14399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.957 [2024-11-28 04:33:43.161503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.957 [2024-11-28 04:33:43.178250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa6dbb0) 00:27:05.957 [2024-11-28 04:33:43.178284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:18420 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.957 [2024-11-28 04:33:43.178316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.957 00:27:05.957 Latency(us) 00:27:05.957 [2024-11-28T03:33:43.268Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.957 [2024-11-28T03:33:43.268Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:05.957 nvme0n1 : 2.04 15133.63 59.12 0.00 0.00 8283.26 3422.44 50098.63 00:27:05.957 [2024-11-28T03:33:43.268Z] =================================================================================================================== 00:27:05.957 [2024-11-28T03:33:43.268Z] Total : 15133.63 59.12 0.00 0.00 8283.26 3422.44 50098.63 00:27:05.957 0 00:27:05.957 04:33:43 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:05.957 04:33:43 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:05.957 04:33:43 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:05.957 | .driver_specific 00:27:05.957 | .nvme_error 00:27:05.957 | .status_code 00:27:05.957 | .command_transient_transport_error' 00:27:05.957 04:33:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:06.215 04:33:43 -- host/digest.sh@71 -- # (( 121 > 0 )) 00:27:06.215 04:33:43 -- host/digest.sh@73 -- # killprocess 4009987 00:27:06.215 04:33:43 -- common/autotest_common.sh@936 -- # '[' -z 4009987 ']' 00:27:06.215 04:33:43 -- common/autotest_common.sh@940 -- # kill -0 4009987 00:27:06.215 04:33:43 -- common/autotest_common.sh@941 -- # uname 00:27:06.215 04:33:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:06.215 04:33:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4009987 00:27:06.475 04:33:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:06.475 04:33:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:06.475 04:33:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4009987' 00:27:06.475 killing process with pid 4009987 00:27:06.475 04:33:43 -- common/autotest_common.sh@955 -- # kill 4009987 00:27:06.475 Received shutdown signal, test time was about 2.000000 seconds 00:27:06.475 00:27:06.475 Latency(us) 00:27:06.475 [2024-11-28T03:33:43.786Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:06.475 [2024-11-28T03:33:43.786Z] =================================================================================================================== 00:27:06.475 [2024-11-28T03:33:43.786Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:06.475 04:33:43 -- common/autotest_common.sh@960 -- # wait 4009987 00:27:06.736 04:33:43 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:06.736 04:33:43 -- host/digest.sh@54 -- # local rw bs qd 00:27:06.736 04:33:43 -- host/digest.sh@56 -- # rw=randread 00:27:06.736 04:33:43 -- host/digest.sh@56 -- # bs=131072 00:27:06.736 04:33:43 -- host/digest.sh@56 -- # qd=16 00:27:06.736 04:33:43 -- host/digest.sh@58 -- # bperfpid=4010539 00:27:06.736 04:33:43 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:06.736 04:33:43 -- host/digest.sh@60 -- # waitforlisten 4010539 /var/tmp/bperf.sock 00:27:06.736 04:33:43 -- common/autotest_common.sh@829 -- # '[' -z 4010539 ']' 00:27:06.736 04:33:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:06.736 04:33:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:06.736 04:33:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:06.736 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:06.736 04:33:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:06.736 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:27:06.736 [2024-11-28 04:33:43.834002] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:06.736 [2024-11-28 04:33:43.834095] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4010539 ] 00:27:06.736 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:06.736 Zero copy mechanism will not be used. 00:27:06.736 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.736 [2024-11-28 04:33:43.895000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:06.736 [2024-11-28 04:33:44.006231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:07.671 04:33:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:07.671 04:33:44 -- common/autotest_common.sh@862 -- # return 0 00:27:07.671 04:33:44 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.671 04:33:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.930 04:33:45 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:07.930 04:33:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.930 04:33:45 -- common/autotest_common.sh@10 -- # set +x 00:27:07.930 04:33:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.930 04:33:45 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.930 04:33:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:08.224 nvme0n1 00:27:08.484 04:33:45 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:08.484 04:33:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:08.484 04:33:45 -- common/autotest_common.sh@10 -- # set +x 00:27:08.484 04:33:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:08.484 04:33:45 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:08.484 04:33:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:08.484 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:08.484 Zero copy mechanism will not be used. 00:27:08.484 Running I/O for 2 seconds... 00:27:08.484 [2024-11-28 04:33:45.659990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.660049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.660074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.666818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.666870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.666891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.673405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.673442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.673463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.680035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.680071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.680092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.686155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.686191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.686211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.692108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.692143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.692163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.698811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.698855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.698872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.705597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.705630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.705647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.712217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.712252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.712272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.719779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.719809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.719826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.726353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.726388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.726408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.733022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.733057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.733077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.739104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.739150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.739174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.745191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.745221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.745238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.751265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.484 [2024-11-28 04:33:45.751296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.484 [2024-11-28 04:33:45.751314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.484 [2024-11-28 04:33:45.758014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.485 [2024-11-28 04:33:45.758049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.485 [2024-11-28 04:33:45.758069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.485 [2024-11-28 04:33:45.764735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.485 [2024-11-28 04:33:45.764766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.485 [2024-11-28 04:33:45.764783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.485 [2024-11-28 04:33:45.770758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.485 [2024-11-28 04:33:45.770790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.485 [2024-11-28 04:33:45.770808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.485 [2024-11-28 04:33:45.777051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.485 [2024-11-28 04:33:45.777087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.485 [2024-11-28 04:33:45.777107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.485 [2024-11-28 04:33:45.783551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.485 [2024-11-28 04:33:45.783601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.485 [2024-11-28 04:33:45.783620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.485 [2024-11-28 04:33:45.790285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.485 [2024-11-28 04:33:45.790321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.485 [2024-11-28 04:33:45.790341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.796954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.796995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.797016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.803319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.803355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.803374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.809934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.809969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.809989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.816182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.816218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.816237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.822888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.822925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.822945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.829383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.829419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.829439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.835547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.835580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.835597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.842087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.842123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.842143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.848561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.848614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.848632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.854550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.854597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.854615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.860243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.860279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.860299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.866347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.866383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.866421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.774 [2024-11-28 04:33:45.872000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.774 [2024-11-28 04:33:45.872036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.774 [2024-11-28 04:33:45.872056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.877457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.877492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.877513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.882828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.882879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.882898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.888760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.888804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.888822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.894121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.894156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.894176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.900200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.900236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.900261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.905369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.905405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.905426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.911017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.911052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.911072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.916448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.916485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.916505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.921784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.921832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.921853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.927377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.927412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.927433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.932865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.932902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.932922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.938512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.938559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.938597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.944119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.944151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.944169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.949686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.949729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.949748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.955295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.955340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.955360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.960921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.960956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.960976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.966520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.966565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.966602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.972049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.972085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.972105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.977571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.977623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.977642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.983457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.983493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.983514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.989375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.989411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.989431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:45.995727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:45.995784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:45.995801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:46.002437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:46.002472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:46.002492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:46.009124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:46.009159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:46.009179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:46.015532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:46.015581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:46.015598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:46.022001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:46.022035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:46.022056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:46.028457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.775 [2024-11-28 04:33:46.028493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.775 [2024-11-28 04:33:46.028512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:08.775 [2024-11-28 04:33:46.034978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.776 [2024-11-28 04:33:46.035015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.776 [2024-11-28 04:33:46.035035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.776 [2024-11-28 04:33:46.041563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.776 [2024-11-28 04:33:46.041612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.776 [2024-11-28 04:33:46.041629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.776 [2024-11-28 04:33:46.047858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.776 [2024-11-28 04:33:46.047894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.776 [2024-11-28 04:33:46.047914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.776 [2024-11-28 04:33:46.054386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:08.776 [2024-11-28 04:33:46.054697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.776 [2024-11-28 04:33:46.054716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.061272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.061308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.061328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.067702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.067749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.067766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.074397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.074434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.074454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.080826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.080872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.080893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.087128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.087163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.087183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.093562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.093611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.093628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.100287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.100324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.100344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.106868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.106915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.106935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.113063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.113099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.113119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.118927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.118962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.035 [2024-11-28 04:33:46.118982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.035 [2024-11-28 04:33:46.125430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.035 [2024-11-28 04:33:46.125466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.125486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.131817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.131867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.131886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.138394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.138429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.138448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.144891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.144927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.144946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.151401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.151436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.151455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.157652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.157682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.157699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.164148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.164183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.164208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.170360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.170395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.170415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.176916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.176952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.176972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.183537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.183571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.183604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.189869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.189906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.189925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.196329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.196365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.196384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.202572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.202619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.202636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.208892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.208927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.208947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.215180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.215216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.215236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.221710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.221760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.221777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.228194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.228230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.228249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.234698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.234733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.234751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.241112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.241147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.241166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.247576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.247606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.247623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.253712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.253742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.253773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.260188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.260224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.260244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.266371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.266406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.266426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.272512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.272557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.272592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.278958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.278995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.279014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.285346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.285381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.285401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.036 [2024-11-28 04:33:46.291603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.036 [2024-11-28 04:33:46.291634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.036 [2024-11-28 04:33:46.291651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.298089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.298124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.298143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.304116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.304150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.304170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.310288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.310322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.310341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.316862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.316897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.316916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.323227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.323263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.323284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.329535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.329569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.329608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.335931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.335967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.335986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.037 [2024-11-28 04:33:46.342134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.037 [2024-11-28 04:33:46.342169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.037 [2024-11-28 04:33:46.342189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.348421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.348457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.348477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.354855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.354891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.354910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.361165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.361201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.361220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.367487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.367521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.367552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.373834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.373863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.373894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.380068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.380103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.380123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.386323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.386357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.386376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.392893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.392928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.392948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.399254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.399290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.399310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.296 [2024-11-28 04:33:46.405624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.296 [2024-11-28 04:33:46.405668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.296 [2024-11-28 04:33:46.405684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.412112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.412148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.412168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.418643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.418675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.418707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.424992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.425029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.425048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.431467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.431503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.431522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.437805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.437855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.437896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.444480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.444515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.444550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.450755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.450784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.450800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.457270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.457304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.457324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.463565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.463612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.463629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.469794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.469842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.469860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.476228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.476263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.476283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.482660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.482691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.482708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.489057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.489092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.489113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.495388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.495429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.495450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.501608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.501637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.501653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.508334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.508369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.508389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.514262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.514297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.514316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.520563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.520591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.520607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.526801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.526831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.526866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.532810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.532859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.532879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.539192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.539227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.539247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.545484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.545518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.545547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.551921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.551957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.551976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.558206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.558242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.558261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.564507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.564551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.564572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.570866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.570901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.297 [2024-11-28 04:33:46.570920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.297 [2024-11-28 04:33:46.577195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.297 [2024-11-28 04:33:46.577229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.298 [2024-11-28 04:33:46.577248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.298 [2024-11-28 04:33:46.583847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.298 [2024-11-28 04:33:46.583876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.298 [2024-11-28 04:33:46.583909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.298 [2024-11-28 04:33:46.590357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.298 [2024-11-28 04:33:46.590393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.298 [2024-11-28 04:33:46.590413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.298 [2024-11-28 04:33:46.597058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.298 [2024-11-28 04:33:46.597093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.298 [2024-11-28 04:33:46.597113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.298 [2024-11-28 04:33:46.603406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.298 [2024-11-28 04:33:46.603441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.298 [2024-11-28 04:33:46.603468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.557 [2024-11-28 04:33:46.609726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.557 [2024-11-28 04:33:46.609770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.557 [2024-11-28 04:33:46.609786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.557 [2024-11-28 04:33:46.616276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.557 [2024-11-28 04:33:46.616310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.557 [2024-11-28 04:33:46.616330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.557 [2024-11-28 04:33:46.622285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.557 [2024-11-28 04:33:46.622319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.557 [2024-11-28 04:33:46.622339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.557 [2024-11-28 04:33:46.628611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.557 [2024-11-28 04:33:46.628655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.557 [2024-11-28 04:33:46.628672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.557 [2024-11-28 04:33:46.634680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.557 [2024-11-28 04:33:46.634710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.557 [2024-11-28 04:33:46.634726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.557 [2024-11-28 04:33:46.640875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.557 [2024-11-28 04:33:46.640922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.557 [2024-11-28 04:33:46.640942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.557 [2024-11-28 04:33:46.647142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.647176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.647196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.653606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.653641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.653661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.660249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.660291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.660312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.666509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.666572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.666591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.672779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.672808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.672838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.679167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.679203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.679223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.685718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.685747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.685764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.692045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.692076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.692092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.698618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.698648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.698665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.704991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.705026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.705046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.711453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.711488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.711507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.717913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.717949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.717969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.724595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.724626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.724643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.731011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.731047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.731067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.737319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.737354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.737373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.744080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.744112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.744129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.751761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.751793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.751850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.758741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.758772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.758790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.766034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.766070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.766089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.773930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.773965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.773991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.782885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.782922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.782942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.790398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.790435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.790455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.795990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.796025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.796045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.801423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.801458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.801478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.807023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.807059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.807078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.812562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.812611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.812628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.818562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.558 [2024-11-28 04:33:46.818611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.558 [2024-11-28 04:33:46.818629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.558 [2024-11-28 04:33:46.824149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.559 [2024-11-28 04:33:46.824184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.559 [2024-11-28 04:33:46.824204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.559 [2024-11-28 04:33:46.830514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.559 [2024-11-28 04:33:46.830558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.559 [2024-11-28 04:33:46.830593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.559 [2024-11-28 04:33:46.837029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.559 [2024-11-28 04:33:46.837064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.559 [2024-11-28 04:33:46.837083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.559 [2024-11-28 04:33:46.843417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.559 [2024-11-28 04:33:46.843452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.559 [2024-11-28 04:33:46.843472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.559 [2024-11-28 04:33:46.849783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.559 [2024-11-28 04:33:46.849814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.559 [2024-11-28 04:33:46.849847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.559 [2024-11-28 04:33:46.856301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.559 [2024-11-28 04:33:46.856336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.559 [2024-11-28 04:33:46.856356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.559 [2024-11-28 04:33:46.862683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.559 [2024-11-28 04:33:46.862716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.559 [2024-11-28 04:33:46.862734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.869128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.869164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.869183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.875377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.875412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.875432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.881757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.881787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.881809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.888229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.888264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.888284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.894791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.894838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.894855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.901397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.901432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.901452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.907743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.907774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.907805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.914288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.914324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.914343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.920700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.920745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.920761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.927114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.927149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.927169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.933390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.933426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.933445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.939728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.939766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.939799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.946065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.946102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.946123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.952490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.952538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.952562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.958824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.958861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.958881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.965326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.965362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.965392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.971815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.971877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.971905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.978108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.978144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.978163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.984656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.984723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.984748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.990303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.990339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.990358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:46.996057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:46.996093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:46.996112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:47.002487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:47.002522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:47.002572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:47.008931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.820 [2024-11-28 04:33:47.008967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.820 [2024-11-28 04:33:47.008986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.820 [2024-11-28 04:33:47.015274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.015310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.015330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.021863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.021911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.021931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.028461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.028497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.028517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.034940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.034975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.034996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.041263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.041309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.041328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.047839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.047886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.047914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.054299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.054334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.054354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.060689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.060721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.060739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.067062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.067097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.067117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.073456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.073492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.073511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.079645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.079691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.079708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.086100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.086136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.086156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.092788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.092821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.092839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.099194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.099231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.099250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.105494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.105544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.105567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.111920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.111955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.111975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.118426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.118462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.118482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.821 [2024-11-28 04:33:47.125016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:09.821 [2024-11-28 04:33:47.125051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:09.821 [2024-11-28 04:33:47.125071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.083 [2024-11-28 04:33:47.131251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.083 [2024-11-28 04:33:47.131286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.083 [2024-11-28 04:33:47.131306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.083 [2024-11-28 04:33:47.137433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.083 [2024-11-28 04:33:47.137468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.083 [2024-11-28 04:33:47.137488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.083 [2024-11-28 04:33:47.143663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.083 [2024-11-28 04:33:47.143694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.083 [2024-11-28 04:33:47.143726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.083 [2024-11-28 04:33:47.150025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.083 [2024-11-28 04:33:47.150061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.083 [2024-11-28 04:33:47.150081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.083 [2024-11-28 04:33:47.156492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.083 [2024-11-28 04:33:47.156535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.083 [2024-11-28 04:33:47.156558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.083 [2024-11-28 04:33:47.163028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.083 [2024-11-28 04:33:47.163063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.083 [2024-11-28 04:33:47.163084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.083 [2024-11-28 04:33:47.169622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.083 [2024-11-28 04:33:47.169668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.169686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.176000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.176035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.176054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.182595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.182641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.182659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.189203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.189239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.189258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.195655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.195700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.195716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.202114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.202150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.202170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.208722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.208755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.208792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.215104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.215139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.215165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.222414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.222449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.222469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.230033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.230068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.230088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.237795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.237846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.237866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.246304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.246341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.246361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.254613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.254658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.254675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.262098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.262134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.262153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.269731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.269778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.269797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.278144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.278183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.278203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.287184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.287220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.287240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.297110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.297159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.297176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.306459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.306495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.306515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.314362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.314409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.314431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.322063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.322099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.322119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.329625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.329661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.329681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.337613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.337662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.337682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.345775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.345808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.345826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.354616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.354648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.354673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.364306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.364341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.364362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.373006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.084 [2024-11-28 04:33:47.373042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.084 [2024-11-28 04:33:47.373062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.084 [2024-11-28 04:33:47.380045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.085 [2024-11-28 04:33:47.380082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.085 [2024-11-28 04:33:47.380102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.085 [2024-11-28 04:33:47.387293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.085 [2024-11-28 04:33:47.387329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.085 [2024-11-28 04:33:47.387349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.394162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.394199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.394219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.400727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.400760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.400777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.407062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.407121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.407158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.412949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.412985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.413004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.419186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.419227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.419247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.425684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.425717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.425735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.431924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.431960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.431979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.438262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.438297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.438317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.444669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.444702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.444720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.451199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.451234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.451254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.457592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.457640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.457658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.464103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.464140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.464159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.470367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.470402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.470422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.476892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.476928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.476948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.482858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.482908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.482944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.488535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.488587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.488607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.493987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.494022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.494041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.499599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.499630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.499648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.505200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.505235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.505254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.347 [2024-11-28 04:33:47.511520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.347 [2024-11-28 04:33:47.511564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.347 [2024-11-28 04:33:47.511584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.518111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.518148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.518167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.524590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.524622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.524660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.531104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.531140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.531159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.537487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.537523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.537554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.544007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.544039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.544056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.550053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.550103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.550124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.555713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.555764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.555781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.562289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.562325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.562345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.568675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.568707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.568740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.574976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.575011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.575030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.581385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.581427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.581447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.587983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.588020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.588039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.594292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.594327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.594347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.600160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.600204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.600227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.605933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.605982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.606019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.611624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.611670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.611687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.618284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.618320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.618339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.624672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.624705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.624757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.631808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.631859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.631894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.638330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.638366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.638386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.644940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.644976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.644996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.348 [2024-11-28 04:33:47.652779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.348 [2024-11-28 04:33:47.652812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.348 [2024-11-28 04:33:47.652830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:10.609 [2024-11-28 04:33:47.660593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1bebbb0) 00:27:10.609 [2024-11-28 04:33:47.660626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:10.609 [2024-11-28 04:33:47.660644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:10.609 00:27:10.609 Latency(us) 00:27:10.609 [2024-11-28T03:33:47.920Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.609 [2024-11-28T03:33:47.920Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:10.609 nvme0n1 : 2.00 4799.27 599.91 0.00 0.00 3327.89 1201.49 10000.31 00:27:10.609 [2024-11-28T03:33:47.920Z] =================================================================================================================== 00:27:10.609 [2024-11-28T03:33:47.920Z] Total : 4799.27 599.91 0.00 0.00 3327.89 1201.49 10000.31 00:27:10.609 0 00:27:10.609 04:33:47 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:10.609 04:33:47 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:10.609 04:33:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:10.609 04:33:47 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:10.609 | .driver_specific 00:27:10.609 | .nvme_error 00:27:10.609 | .status_code 00:27:10.609 | .command_transient_transport_error' 00:27:10.869 04:33:47 -- host/digest.sh@71 -- # (( 310 > 0 )) 00:27:10.869 04:33:47 -- host/digest.sh@73 -- # killprocess 4010539 00:27:10.869 04:33:47 -- common/autotest_common.sh@936 -- # '[' -z 4010539 ']' 00:27:10.869 04:33:47 -- common/autotest_common.sh@940 -- # kill -0 4010539 00:27:10.869 04:33:47 -- common/autotest_common.sh@941 -- # uname 00:27:10.869 04:33:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:10.869 04:33:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4010539 00:27:10.869 04:33:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:10.869 04:33:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:10.869 04:33:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4010539' 00:27:10.869 killing process with pid 4010539 00:27:10.869 04:33:47 -- common/autotest_common.sh@955 -- # kill 4010539 00:27:10.869 Received shutdown signal, test time was about 2.000000 seconds 00:27:10.869 00:27:10.869 Latency(us) 00:27:10.869 [2024-11-28T03:33:48.180Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.869 [2024-11-28T03:33:48.180Z] =================================================================================================================== 00:27:10.869 [2024-11-28T03:33:48.180Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:10.869 04:33:47 -- common/autotest_common.sh@960 -- # wait 4010539 00:27:11.128 04:33:48 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:11.128 04:33:48 -- host/digest.sh@54 -- # local rw bs qd 00:27:11.128 04:33:48 -- host/digest.sh@56 -- # rw=randwrite 00:27:11.128 04:33:48 -- host/digest.sh@56 -- # bs=4096 00:27:11.128 04:33:48 -- host/digest.sh@56 -- # qd=128 00:27:11.128 04:33:48 -- host/digest.sh@58 -- # bperfpid=4011090 00:27:11.128 04:33:48 -- host/digest.sh@60 -- # waitforlisten 4011090 /var/tmp/bperf.sock 00:27:11.128 04:33:48 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:11.128 04:33:48 -- common/autotest_common.sh@829 -- # '[' -z 4011090 ']' 00:27:11.128 04:33:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:11.128 04:33:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:11.128 04:33:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:11.128 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:11.128 04:33:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:11.128 04:33:48 -- common/autotest_common.sh@10 -- # set +x 00:27:11.128 [2024-11-28 04:33:48.268491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:11.128 [2024-11-28 04:33:48.268594] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4011090 ] 00:27:11.128 EAL: No free 2048 kB hugepages reported on node 1 00:27:11.128 [2024-11-28 04:33:48.332531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:11.386 [2024-11-28 04:33:48.447787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:11.956 04:33:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:11.956 04:33:49 -- common/autotest_common.sh@862 -- # return 0 00:27:11.956 04:33:49 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:11.956 04:33:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:12.214 04:33:49 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:12.215 04:33:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.215 04:33:49 -- common/autotest_common.sh@10 -- # set +x 00:27:12.215 04:33:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.215 04:33:49 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.215 04:33:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.784 nvme0n1 00:27:12.784 04:33:50 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:12.784 04:33:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.784 04:33:50 -- common/autotest_common.sh@10 -- # set +x 00:27:12.784 04:33:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.784 04:33:50 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:12.784 04:33:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:13.044 Running I/O for 2 seconds... 00:27:13.044 [2024-11-28 04:33:50.166858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.167212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.167254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.180809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.181152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:15653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.181193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.194794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.195128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:2519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.195162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.208644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.208997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.209030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.222463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.222829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:8951 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.222861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.236263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.236602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.236631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.250010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.250331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.250363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.263633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.263984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:10447 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.264016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.277164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.277491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:17414 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.277523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.290743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.291078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:17256 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.291116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.304403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.304745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:11704 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.304774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.317972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.318296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:22509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.318328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.331336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.331661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:13706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.331691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.044 [2024-11-28 04:33:50.344444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.044 [2024-11-28 04:33:50.344782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:2187 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.044 [2024-11-28 04:33:50.344811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.357793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.358118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.358150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.371160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.371492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:14896 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.371523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.384660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.384997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:17891 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.385030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.398112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.398433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10822 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.398465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.411710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.412057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:8872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.412085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.425153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.425499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.425542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.438553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.438861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.438889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.452017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.452366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:11479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.452394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.465502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.465820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:17308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.303 [2024-11-28 04:33:50.465848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.303 [2024-11-28 04:33:50.479058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.303 [2024-11-28 04:33:50.479443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:22950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.479474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.492693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.493007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:12880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.493035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.506319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.506712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:21995 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.506741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.520005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.520416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:23860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.520447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.533578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.533938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:6067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.533982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.547258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.547658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8918 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.547686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.560874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.561264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.561291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.574484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.574872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9176 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.574904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.588122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.588464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:16027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.588491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.304 [2024-11-28 04:33:50.601675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.304 [2024-11-28 04:33:50.602094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:18200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.304 [2024-11-28 04:33:50.602125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.615195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.615509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.615553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.628750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.629064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3301 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.629093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.642313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.642641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:11233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.642675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.655960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.656306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21801 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.656334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.669549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.669986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:20626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.670016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.683271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.683622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:13473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.683650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.696820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.697233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:6011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.697260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.710478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.710807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:20745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.710836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.724062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.724393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:1849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.724420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.737601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.738076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.738107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.751108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.751492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:15825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.751521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.764643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.764986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:22185 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.765013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.778266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.778606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:14424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.778634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.791925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.564 [2024-11-28 04:33:50.792315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:2051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.564 [2024-11-28 04:33:50.792359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.564 [2024-11-28 04:33:50.805522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.565 [2024-11-28 04:33:50.805974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.565 [2024-11-28 04:33:50.806005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.565 [2024-11-28 04:33:50.819220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.565 [2024-11-28 04:33:50.819627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25579 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.565 [2024-11-28 04:33:50.819655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.565 [2024-11-28 04:33:50.832924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.565 [2024-11-28 04:33:50.833258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:16443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.565 [2024-11-28 04:33:50.833286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.565 [2024-11-28 04:33:50.846538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.565 [2024-11-28 04:33:50.846879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:22762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.565 [2024-11-28 04:33:50.846906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.565 [2024-11-28 04:33:50.860069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.565 [2024-11-28 04:33:50.860386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:5741 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.565 [2024-11-28 04:33:50.860412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.565 [2024-11-28 04:33:50.873597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.873918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:3746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.873948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.887195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.887588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:3745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.887617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.900737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.901049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:14088 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.901076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.914301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.914693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:433 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.914730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.927907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.928251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.928279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.941409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.941785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.941813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.954895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.955275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:6999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.955303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.968505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.968855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.968882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.982136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.982538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:12129 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.982583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:50.995768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:50.996164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:50.996195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.009319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.009722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21951 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.009750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.022889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.023219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:9950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.023247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.036468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.036790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:19132 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.036818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.050035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.050375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:4048 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.050403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.063622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.063932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:1817 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.063960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.077138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.077532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:21090 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.077560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.090730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.091054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:11826 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.091082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.104281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.104727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:18530 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.104755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.117960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.118280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.118313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-28 04:33:51.131636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:13.826 [2024-11-28 04:33:51.132004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:20391 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:13.826 [2024-11-28 04:33:51.132050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.087 [2024-11-28 04:33:51.145204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.087 [2024-11-28 04:33:51.145606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:14658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.087 [2024-11-28 04:33:51.145635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.087 [2024-11-28 04:33:51.158820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.087 [2024-11-28 04:33:51.159208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:13243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.087 [2024-11-28 04:33:51.159236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.087 [2024-11-28 04:33:51.172346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.087 [2024-11-28 04:33:51.172728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:23231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.087 [2024-11-28 04:33:51.172759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.087 [2024-11-28 04:33:51.185833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.087 [2024-11-28 04:33:51.186162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.087 [2024-11-28 04:33:51.186189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.087 [2024-11-28 04:33:51.199375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.087 [2024-11-28 04:33:51.199782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10079 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.087 [2024-11-28 04:33:51.199810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.212920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.213304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:8246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.213332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.226488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.226877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:23916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.226921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.240085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.240437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.240464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.253635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.253953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:18923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.253981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.267214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.267607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:16800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.267635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.280816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.281165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:15314 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.281194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.294460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.294847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:1823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.294874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.308054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.308399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.308427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.321603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.321964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:7992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.322009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.335169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.335571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:8572 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.335599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.348762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.349094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:18620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.349122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.362417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.362736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:2948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.362763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.376037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.376380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.376407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.088 [2024-11-28 04:33:51.389656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.088 [2024-11-28 04:33:51.390023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.088 [2024-11-28 04:33:51.390068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.403287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.403629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:3062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.403657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.416882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.417267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20740 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.417294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.430425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.430813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:10521 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.430841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.444083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.444458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:2924 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.444485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.457748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.458114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:4321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.458142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.471301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.471692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:5080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.471725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.484907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.485220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:21260 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.485248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.498420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.498788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.498814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.512056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.512361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18434 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.512389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.525653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.526073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.526104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.539340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.539731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:4227 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.539759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.552883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.553282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:20040 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.553310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.566494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.566881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.566926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.580142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.580535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.580562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.593754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.594131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:14315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.594177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.607350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.607686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.348 [2024-11-28 04:33:51.607714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.348 [2024-11-28 04:33:51.620967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.348 [2024-11-28 04:33:51.621332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:8498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.349 [2024-11-28 04:33:51.621359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.349 [2024-11-28 04:33:51.634498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.349 [2024-11-28 04:33:51.634852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:20141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.349 [2024-11-28 04:33:51.634880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.349 [2024-11-28 04:33:51.648105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.349 [2024-11-28 04:33:51.648427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:14114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.349 [2024-11-28 04:33:51.648455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.661638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.661962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:15388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.661990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.675239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.675634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:7290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.675662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.688776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.689064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.689091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.702250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.702586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:10612 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.702614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.715709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.716102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.716130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.729209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.729537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:10351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.729565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.742774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.743106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:7458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.743135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.756083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.756405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.756435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.769544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.607 [2024-11-28 04:33:51.769872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.607 [2024-11-28 04:33:51.769903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.607 [2024-11-28 04:33:51.783064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.783384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:3526 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.783414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.796582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.796992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:19504 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.797022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.810107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.810423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:16340 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.810454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.823721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.824066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:20178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.824102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.837284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.837622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:5541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.837650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.850944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.851263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:9917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.851293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.864475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.864872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:23469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.864903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.878077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.878395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.878425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.891655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.892000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25507 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.892030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.608 [2024-11-28 04:33:51.905286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.608 [2024-11-28 04:33:51.905624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:5482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.608 [2024-11-28 04:33:51.905652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:51.918854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:51.919173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:12856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:51.919204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:51.932386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:51.932709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:13560 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:51.932736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:51.946013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:51.946334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5058 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:51.946365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:51.959581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:51.959899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:51.959930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:51.973123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:51.973442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:5106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:51.973473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:51.986738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:51.987073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:19686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:51.987103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.000254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.000597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.000624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.013938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.014255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:11099 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.014285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.027614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.027953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:2761 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.027984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.041218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.041548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:19297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.041578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.054739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.055068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:13489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.055099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.068285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.068633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25490 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.068661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.081809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.082140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:22556 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.082170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.867 [2024-11-28 04:33:52.095465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.867 [2024-11-28 04:33:52.095790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:23317 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.867 [2024-11-28 04:33:52.095834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.868 [2024-11-28 04:33:52.109065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.868 [2024-11-28 04:33:52.109390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:7611 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.868 [2024-11-28 04:33:52.109421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.868 [2024-11-28 04:33:52.122562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.868 [2024-11-28 04:33:52.122947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:7632 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.868 [2024-11-28 04:33:52.122977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.868 [2024-11-28 04:33:52.136182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.868 [2024-11-28 04:33:52.136500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.868 [2024-11-28 04:33:52.136539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.868 [2024-11-28 04:33:52.149724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbad0) with pdu=0x2000190fd208 00:27:14.868 [2024-11-28 04:33:52.150023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15256 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:14.868 [2024-11-28 04:33:52.150053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.868 00:27:14.868 Latency(us) 00:27:14.868 [2024-11-28T03:33:52.179Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.868 [2024-11-28T03:33:52.179Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:14.868 nvme0n1 : 2.01 18731.41 73.17 0.00 0.00 6818.89 6359.42 16893.72 00:27:14.868 [2024-11-28T03:33:52.179Z] =================================================================================================================== 00:27:14.868 [2024-11-28T03:33:52.179Z] Total : 18731.41 73.17 0.00 0.00 6818.89 6359.42 16893.72 00:27:14.868 0 00:27:14.868 04:33:52 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:14.868 04:33:52 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:14.868 04:33:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:14.868 04:33:52 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:14.868 | .driver_specific 00:27:14.868 | .nvme_error 00:27:14.868 | .status_code 00:27:14.868 | .command_transient_transport_error' 00:27:15.127 04:33:52 -- host/digest.sh@71 -- # (( 147 > 0 )) 00:27:15.127 04:33:52 -- host/digest.sh@73 -- # killprocess 4011090 00:27:15.127 04:33:52 -- common/autotest_common.sh@936 -- # '[' -z 4011090 ']' 00:27:15.127 04:33:52 -- common/autotest_common.sh@940 -- # kill -0 4011090 00:27:15.127 04:33:52 -- common/autotest_common.sh@941 -- # uname 00:27:15.127 04:33:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:15.127 04:33:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4011090 00:27:15.385 04:33:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:15.385 04:33:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:15.385 04:33:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4011090' 00:27:15.385 killing process with pid 4011090 00:27:15.385 04:33:52 -- common/autotest_common.sh@955 -- # kill 4011090 00:27:15.385 Received shutdown signal, test time was about 2.000000 seconds 00:27:15.385 00:27:15.385 Latency(us) 00:27:15.385 [2024-11-28T03:33:52.696Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:15.385 [2024-11-28T03:33:52.696Z] =================================================================================================================== 00:27:15.385 [2024-11-28T03:33:52.696Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:15.385 04:33:52 -- common/autotest_common.sh@960 -- # wait 4011090 00:27:15.644 04:33:52 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:15.644 04:33:52 -- host/digest.sh@54 -- # local rw bs qd 00:27:15.644 04:33:52 -- host/digest.sh@56 -- # rw=randwrite 00:27:15.644 04:33:52 -- host/digest.sh@56 -- # bs=131072 00:27:15.644 04:33:52 -- host/digest.sh@56 -- # qd=16 00:27:15.644 04:33:52 -- host/digest.sh@58 -- # bperfpid=4011644 00:27:15.644 04:33:52 -- host/digest.sh@60 -- # waitforlisten 4011644 /var/tmp/bperf.sock 00:27:15.644 04:33:52 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:15.644 04:33:52 -- common/autotest_common.sh@829 -- # '[' -z 4011644 ']' 00:27:15.644 04:33:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:15.644 04:33:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:15.644 04:33:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:15.644 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:15.644 04:33:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:15.644 04:33:52 -- common/autotest_common.sh@10 -- # set +x 00:27:15.644 [2024-11-28 04:33:52.773006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:15.644 [2024-11-28 04:33:52.773090] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4011644 ] 00:27:15.644 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:15.644 Zero copy mechanism will not be used. 00:27:15.644 EAL: No free 2048 kB hugepages reported on node 1 00:27:15.644 [2024-11-28 04:33:52.836576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:15.644 [2024-11-28 04:33:52.951128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:16.582 04:33:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:16.582 04:33:53 -- common/autotest_common.sh@862 -- # return 0 00:27:16.582 04:33:53 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:16.582 04:33:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:16.842 04:33:54 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:16.842 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:16.842 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:27:16.842 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:16.842 04:33:54 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:16.842 04:33:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:17.100 nvme0n1 00:27:17.100 04:33:54 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:17.100 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:17.100 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:27:17.100 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:17.100 04:33:54 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:17.100 04:33:54 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:17.360 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:17.360 Zero copy mechanism will not be used. 00:27:17.360 Running I/O for 2 seconds... 00:27:17.360 [2024-11-28 04:33:54.513437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.360 [2024-11-28 04:33:54.513772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.360 [2024-11-28 04:33:54.513821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.360 [2024-11-28 04:33:54.519955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.360 [2024-11-28 04:33:54.520062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.360 [2024-11-28 04:33:54.520095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.525988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.526093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.526126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.532027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.532128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.532160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.538074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.538174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.538206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.543847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.543942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.543971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.549848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.550017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.550049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.556004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.556281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.556313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.561885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.562128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.562159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.567928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.568060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.568092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.573880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.573975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.574006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.580206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.580305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.580337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.587664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.587779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.587807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.594915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.595075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.595106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.602226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.602509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.602550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.609595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.609912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.609943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.616813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.617136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.617168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.624513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.624801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.624829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.631896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.632064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.632095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.638948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.639118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.639149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.646362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.646520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.646573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.653685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.653868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.653898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.660146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.361 [2024-11-28 04:33:54.660348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.361 [2024-11-28 04:33:54.660380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.361 [2024-11-28 04:33:54.667542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.362 [2024-11-28 04:33:54.667921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.362 [2024-11-28 04:33:54.667959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.674748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.675081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.675112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.681170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.681360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.681391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.688106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.688277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.688307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.695384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.695538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.695570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.701970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.702154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.702185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.709156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.709369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.709400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.716612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.716771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.716799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.723863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.724157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.622 [2024-11-28 04:33:54.724188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.622 [2024-11-28 04:33:54.730676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.622 [2024-11-28 04:33:54.730892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.730923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.737898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.738145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.738175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.743971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.744139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.744167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.750094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.750324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.750355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.756670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.756759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.756787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.763727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.763954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.763984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.770669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.770852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.770898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.777737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.778005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.778036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.785432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.785687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.785715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.792215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.792416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.792447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.798157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.798312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.798343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.803221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.803402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.803433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.809153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.809246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.809277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.814100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.814262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.814292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.818712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.818882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.818914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.823504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.823783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.823811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.828519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.828710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.828738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.833156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.833324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.833360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.837733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.837919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.837950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.842225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.842381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.842412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.846802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.846925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.846953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.851452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.851650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.623 [2024-11-28 04:33:54.851679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.623 [2024-11-28 04:33:54.856035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.623 [2024-11-28 04:33:54.856202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.856232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.860659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.860900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.860931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.865125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.865287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.865317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.869648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.869806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.869850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.874079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.874233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.874261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.878546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.878697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.878724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.883049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.883160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.883189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.887477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.887670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.887698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.892167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.892324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.892354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.896692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.896933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.896963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.901188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.901367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.901396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.905572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.905727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.905755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.909891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.910047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.910076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.914163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.914301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.914330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.918457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.918570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.918596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.923425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.923583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.923611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.624 [2024-11-28 04:33:54.927835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.624 [2024-11-28 04:33:54.927989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.624 [2024-11-28 04:33:54.928017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.886 [2024-11-28 04:33:54.932189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.886 [2024-11-28 04:33:54.932391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.886 [2024-11-28 04:33:54.932420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.886 [2024-11-28 04:33:54.937065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.886 [2024-11-28 04:33:54.937241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.886 [2024-11-28 04:33:54.937268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.886 [2024-11-28 04:33:54.941352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.886 [2024-11-28 04:33:54.941493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.886 [2024-11-28 04:33:54.941522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.947011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.947128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.947156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.951624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.951746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.951780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.956011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.956101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.956128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.960561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.960711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.960739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.964995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.965124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.965153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.969522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.969762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.969791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.973846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.973993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.974022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.978250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.978394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.978422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.982767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.982911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.982939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.987178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.987306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.987334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.991539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.991631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.991658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:54.995997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:54.996198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:54.996226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.000330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.000477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.000505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.004745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.004962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.004991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.009137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.009272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.009301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.013508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.013639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.013667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.017778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.017932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.017959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.022039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.022158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.022185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.026384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.026505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.026547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.030782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.030929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.030956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.035322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.035470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.035498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.040249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.040479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.040507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.046444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.046673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.046701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.052480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.887 [2024-11-28 04:33:55.052747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.887 [2024-11-28 04:33:55.052775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.887 [2024-11-28 04:33:55.058160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.058321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.058349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.062698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.062834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.062863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.067454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.067668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.067695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.072744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.072954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.072982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.078494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.078668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.078696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.082949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.083169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.083198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.087323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.087446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.087474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.091619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.091789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.091818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.095892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.096053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.096082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.100220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.100355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.100382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.104545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.104670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.104698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.108917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.109063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.109091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.113237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.113411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.113439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.117651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.117846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.117874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.121961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.122106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.122133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.126567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.126666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.126693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.131364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.131506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.131544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.135846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.888 [2024-11-28 04:33:55.136088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.888 [2024-11-28 04:33:55.136116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.888 [2024-11-28 04:33:55.141089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.889 [2024-11-28 04:33:55.141213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.889 [2024-11-28 04:33:55.141240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.889 [2024-11-28 04:33:55.145713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.889 [2024-11-28 04:33:55.145864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.889 [2024-11-28 04:33:55.145891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.889 [2024-11-28 04:33:55.151137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.889 [2024-11-28 04:33:55.151277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.889 [2024-11-28 04:33:55.151312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.889 [2024-11-28 04:33:55.155768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.889 [2024-11-28 04:33:55.155980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.889 [2024-11-28 04:33:55.156008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.889 [2024-11-28 04:33:55.160157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.889 [2024-11-28 04:33:55.160299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.889 [2024-11-28 04:33:55.160328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.889 [2024-11-28 04:33:55.164465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.889 [2024-11-28 04:33:55.164610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.889 [2024-11-28 04:33:55.164638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.889 [2024-11-28 04:33:55.168922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.889 [2024-11-28 04:33:55.169070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.889 [2024-11-28 04:33:55.169097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.890 [2024-11-28 04:33:55.173368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.890 [2024-11-28 04:33:55.173511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.890 [2024-11-28 04:33:55.173547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.890 [2024-11-28 04:33:55.177767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.890 [2024-11-28 04:33:55.177906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.890 [2024-11-28 04:33:55.177934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:17.890 [2024-11-28 04:33:55.182089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.890 [2024-11-28 04:33:55.182238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.890 [2024-11-28 04:33:55.182266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:17.890 [2024-11-28 04:33:55.186385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.890 [2024-11-28 04:33:55.186544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.890 [2024-11-28 04:33:55.186572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:17.890 [2024-11-28 04:33:55.190703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:17.890 [2024-11-28 04:33:55.190896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:17.890 [2024-11-28 04:33:55.190924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.151 [2024-11-28 04:33:55.194957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.195155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.195184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.199352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.199481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.199509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.203674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.203874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.203902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.208003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.208148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.208176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.212626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.212728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.212756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.217013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.217202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.217229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.221282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.221424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.221453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.225638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.225865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.225894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.230055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.230199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.230228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.234349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.234490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.234519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.238763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.238920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.238947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.243071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.243206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.243234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.247587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.247711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.247739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.251963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.252140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.252183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.256393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.256557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.256585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.260814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.261038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.261066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.265189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.265342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.265375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.269591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.269748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.269776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.273909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.274054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.274083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.278142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.278260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.278287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.282465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.282558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.282584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.286935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.287084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.287111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.291315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.291451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.291479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.295816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.296044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.296072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.300111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.300248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.300275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.304549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.304706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.152 [2024-11-28 04:33:55.304734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.152 [2024-11-28 04:33:55.308999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.152 [2024-11-28 04:33:55.309128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.309155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.313395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.313498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.313534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.317830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.317936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.317963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.322215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.322378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.322405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.326535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.326785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.326812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.330967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.331164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.331193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.335369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.335485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.335512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.339652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.339787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.339814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.344137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.344286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.344314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.348468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.348598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.348625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.352827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.352910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.352937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.357289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.357433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.357460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.361738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.361879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.361908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.366335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.366521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.366556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.370653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.370802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.370830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.374967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.375120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.375148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.379375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.379561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.379590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.383764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.383910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.383937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.388607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.388737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.388764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.392955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.393098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.393126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.397381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.397589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.397618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.401878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.402124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.402152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.406272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.406400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.406427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.410523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.410729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.410757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.414935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.415110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.415138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.419292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.419415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.419456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.423813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.423982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.153 [2024-11-28 04:33:55.424009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.153 [2024-11-28 04:33:55.428355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.153 [2024-11-28 04:33:55.428500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.428535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.154 [2024-11-28 04:33:55.432807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.154 [2024-11-28 04:33:55.432957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.432985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.154 [2024-11-28 04:33:55.437192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.154 [2024-11-28 04:33:55.437389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.437431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.154 [2024-11-28 04:33:55.441556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.154 [2024-11-28 04:33:55.441681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.441709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.154 [2024-11-28 04:33:55.445857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.154 [2024-11-28 04:33:55.446024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.446052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.154 [2024-11-28 04:33:55.450233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.154 [2024-11-28 04:33:55.450374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.450401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.154 [2024-11-28 04:33:55.454599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.154 [2024-11-28 04:33:55.454731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.454764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.154 [2024-11-28 04:33:55.458804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.154 [2024-11-28 04:33:55.458921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.154 [2024-11-28 04:33:55.458947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.412 [2024-11-28 04:33:55.463196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.412 [2024-11-28 04:33:55.463354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.412 [2024-11-28 04:33:55.463381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.412 [2024-11-28 04:33:55.467630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.412 [2024-11-28 04:33:55.467780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.412 [2024-11-28 04:33:55.467807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.412 [2024-11-28 04:33:55.472049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.412 [2024-11-28 04:33:55.472266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.412 [2024-11-28 04:33:55.472294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.412 [2024-11-28 04:33:55.476483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.412 [2024-11-28 04:33:55.476660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.476688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.480813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.480983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.481011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.485027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.485168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.485196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.489250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.489376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.489403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.493574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.493685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.493712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.497965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.498113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.498140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.502335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.502498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.502534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.506766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.506985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.507012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.511108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.511244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.511271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.515438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.515592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.515620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.519754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.519906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.519933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.524023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.524142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.524170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.528401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.528502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.528537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.532788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.532980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.533024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.537323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.537479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.537506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.541707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.541864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.541892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.546074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.546253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.546280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.550512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.550676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.550704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.554795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.554952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.554979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.559227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.559405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.559433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.563630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.563755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.563782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.568056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.568230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.568263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.572432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.572597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.572626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.576911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.577123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.577151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.581336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.581481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.581509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.585607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.585728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.585755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.589984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.413 [2024-11-28 04:33:55.590102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.413 [2024-11-28 04:33:55.590130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.413 [2024-11-28 04:33:55.594275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.594394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.594420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.598621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.598703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.598731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.603025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.603170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.603198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.607424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.607599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.607627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.611822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.612006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.612034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.616294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.616452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.616479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.620691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.620832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.620859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.625110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.625253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.625281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.629449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.629615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.629643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.633803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.633945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.633972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.638237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.638410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.638436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.642613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.642764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.642792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.647058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.647255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.647283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.651395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.651552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.651579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.655694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.655845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.655873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.660169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.660314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.660342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.664568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.664712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.664740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.668934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.669039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.669066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.673297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.673454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.673482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.677665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.677816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.677844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.682124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.682358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.682406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.686555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.686721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.686748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.690931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.691094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.691122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.695181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.695321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.695349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.699495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.699646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.699674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.703882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.704002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.704029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.708379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.414 [2024-11-28 04:33:55.708542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.414 [2024-11-28 04:33:55.708570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.414 [2024-11-28 04:33:55.712851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.415 [2024-11-28 04:33:55.713036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.415 [2024-11-28 04:33:55.713064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.415 [2024-11-28 04:33:55.717250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.415 [2024-11-28 04:33:55.717471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.415 [2024-11-28 04:33:55.717500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.415 [2024-11-28 04:33:55.721662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.415 [2024-11-28 04:33:55.721819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.415 [2024-11-28 04:33:55.721846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.725978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.674 [2024-11-28 04:33:55.726119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.674 [2024-11-28 04:33:55.726146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.730295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.674 [2024-11-28 04:33:55.730432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.674 [2024-11-28 04:33:55.730474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.734679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.674 [2024-11-28 04:33:55.734790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.674 [2024-11-28 04:33:55.734818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.738974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.674 [2024-11-28 04:33:55.739108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.674 [2024-11-28 04:33:55.739133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.743489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.674 [2024-11-28 04:33:55.743684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.674 [2024-11-28 04:33:55.743711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.747891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.674 [2024-11-28 04:33:55.748022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.674 [2024-11-28 04:33:55.748049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.752415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.674 [2024-11-28 04:33:55.752630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.674 [2024-11-28 04:33:55.752660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.674 [2024-11-28 04:33:55.756826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.756933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.756966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.761093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.761226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.761254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.765463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.765677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.765706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.769840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.769973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.770000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.774143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.774258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.774285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.778388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.778543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.778571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.782785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.782938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.782966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.787156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.787342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.787369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.791638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.791797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.791825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.796045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.796193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.796221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.800433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.800604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.800633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.804738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.804876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.804904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.809222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.809372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.809400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.813606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.813765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.813793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.817979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.818134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.818163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.822351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.822586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.822614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.826723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.826882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.826910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.831161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.831312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.831340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.835394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.835575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.835603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.839696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.839866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.839893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.844006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.844156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.844183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.848369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.848522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.848558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.852736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.852884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.852911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.857151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.857390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.857418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.861466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.861655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.861683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.865734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.865885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.865913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.870569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.870762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.675 [2024-11-28 04:33:55.870795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.675 [2024-11-28 04:33:55.875210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.675 [2024-11-28 04:33:55.875321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.875349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.879556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.879708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.879735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.884057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.884219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.884246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.888361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.888500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.888535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.892628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.892767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.892795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.897204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.897355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.897382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.901398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.901563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.901591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.905790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.905950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.905978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.910142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.910257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.910285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.914444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.914593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.914622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.918966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.919136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.919163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.923255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.923458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.923486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.927682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.927883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.927910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.932048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.932197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.932225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.936458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.936614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.936643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.940826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.940967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.940995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.945187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.945304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.945331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.949585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.949702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.949729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.954031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.954200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.954228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.958429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.958583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.958612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.962834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.963043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.963071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.967157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.967295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.967323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.971469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.971614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.971642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.975809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.975927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.975955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.676 [2024-11-28 04:33:55.980203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.676 [2024-11-28 04:33:55.980296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.676 [2024-11-28 04:33:55.980338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.936 [2024-11-28 04:33:55.984556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.936 [2024-11-28 04:33:55.984667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.936 [2024-11-28 04:33:55.984700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.936 [2024-11-28 04:33:55.988942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.936 [2024-11-28 04:33:55.989088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.936 [2024-11-28 04:33:55.989116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.936 [2024-11-28 04:33:55.993345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:55.993483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:55.993510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:55.997801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:55.998001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:55.998029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.002199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.002368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.002396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.006596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.006769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.006797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.010930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.011089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.011117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.015385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.015516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.015553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.019719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.019829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.019855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.024093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.024298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.024326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.028405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.028549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.028576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.032978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.033208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.033236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.037392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.037541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.037569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.041784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.041937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.041964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.046219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.046365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.046393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.050559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.050692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.050720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.054797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.054898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.054925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.059156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.059326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.059355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.063478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.063680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.063709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.067932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.068153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.068181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.072246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.072375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.072403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.076551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.076694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.076722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.080920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.081088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.937 [2024-11-28 04:33:56.081116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.937 [2024-11-28 04:33:56.085221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.937 [2024-11-28 04:33:56.085374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.085401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.089610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.089694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.089721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.094040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.094185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.094212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.098327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.098480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.098508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.102725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.102930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.102961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.107138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.107281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.107309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.111562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.111707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.111734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.116110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.116269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.116297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.120457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.120596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.120624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.124971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.125069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.125096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.129309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.129476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.129504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.133746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.133926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.133954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.138294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.138516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.138556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.142519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.142687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.142716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.146836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.147010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.147038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.151351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.151498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.151534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.155757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.155871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.155898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.160109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.160207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.160235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.164592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.164750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.164777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.169058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.169263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.169296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.173538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.173766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.173800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.177936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.178070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.938 [2024-11-28 04:33:56.178098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.938 [2024-11-28 04:33:56.182382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.938 [2024-11-28 04:33:56.182552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.182587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.186752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.186911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.186940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.191159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.191278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.191305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.195599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.195682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.195710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.199982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.200128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.200156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.204382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.204555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.204604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.208881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.209108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.209136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.213335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.213472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.213499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.217712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.217864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.217892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.222091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.222239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.222267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.226434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.226550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.226578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.230747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.230839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.230866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.235234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.235381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.235409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.239575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.239678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.239705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:18.939 [2024-11-28 04:33:56.244100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:18.939 [2024-11-28 04:33:56.244283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:18.939 [2024-11-28 04:33:56.244310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.200 [2024-11-28 04:33:56.248421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.200 [2024-11-28 04:33:56.248538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.200 [2024-11-28 04:33:56.248566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.200 [2024-11-28 04:33:56.252752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.252922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.252950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.257163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.257295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.257338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.261609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.261726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.261753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.266015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.266136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.266163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.270446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.270600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.270628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.274805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.274977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.275005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.279209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.279424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.279452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.283486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.283603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.283631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.287811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.287933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.287965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.292160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.292346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.292374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.296566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.296672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.296700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.300894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.301005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.301030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.305238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.305410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.305438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.309737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.309888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.309916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.314243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.314430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.314457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.318523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.318687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.318716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.322795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.322955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.322983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.327390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.327578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.327607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.333072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.333293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.333320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.339751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.339899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.339927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.346796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.346945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.346972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.353748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.353902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.353929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.361046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.361341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.361370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.368183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.368423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.368451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.375367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.375495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.375535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.382535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.382780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.201 [2024-11-28 04:33:56.382808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.201 [2024-11-28 04:33:56.389954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.201 [2024-11-28 04:33:56.390099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.390130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.397197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.397323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.397354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.404758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.404986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.405016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.412304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.412616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.412644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.419939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.420142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.420173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.426806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.427086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.427118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.434289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.434451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.434482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.441690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.441903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.441933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.448918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.449143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.449180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.456309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.456509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.456551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.463645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.463827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.463854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.471091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.471319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.471349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.478447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.478718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.478747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.486025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.486221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.486251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.493202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.493455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.493485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.500550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.500710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.500738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.202 [2024-11-28 04:33:56.507716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x21bbfb0) with pdu=0x2000190fef90 00:27:19.202 [2024-11-28 04:33:56.507933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.202 [2024-11-28 04:33:56.507963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.463 00:27:19.463 Latency(us) 00:27:19.463 [2024-11-28T03:33:56.774Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:19.463 [2024-11-28T03:33:56.774Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:19.463 nvme0n1 : 2.00 6375.63 796.95 0.00 0.00 2501.38 1784.04 10485.76 00:27:19.463 [2024-11-28T03:33:56.774Z] =================================================================================================================== 00:27:19.463 [2024-11-28T03:33:56.774Z] Total : 6375.63 796.95 0.00 0.00 2501.38 1784.04 10485.76 00:27:19.463 0 00:27:19.463 04:33:56 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:19.463 04:33:56 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:19.463 04:33:56 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:19.463 | .driver_specific 00:27:19.463 | .nvme_error 00:27:19.463 | .status_code 00:27:19.463 | .command_transient_transport_error' 00:27:19.463 04:33:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:19.722 04:33:56 -- host/digest.sh@71 -- # (( 412 > 0 )) 00:27:19.722 04:33:56 -- host/digest.sh@73 -- # killprocess 4011644 00:27:19.722 04:33:56 -- common/autotest_common.sh@936 -- # '[' -z 4011644 ']' 00:27:19.722 04:33:56 -- common/autotest_common.sh@940 -- # kill -0 4011644 00:27:19.722 04:33:56 -- common/autotest_common.sh@941 -- # uname 00:27:19.722 04:33:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:19.722 04:33:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4011644 00:27:19.722 04:33:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:19.722 04:33:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:19.722 04:33:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4011644' 00:27:19.722 killing process with pid 4011644 00:27:19.722 04:33:56 -- common/autotest_common.sh@955 -- # kill 4011644 00:27:19.722 Received shutdown signal, test time was about 2.000000 seconds 00:27:19.722 00:27:19.722 Latency(us) 00:27:19.722 [2024-11-28T03:33:57.033Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:19.722 [2024-11-28T03:33:57.033Z] =================================================================================================================== 00:27:19.722 [2024-11-28T03:33:57.033Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:19.722 04:33:56 -- common/autotest_common.sh@960 -- # wait 4011644 00:27:19.980 04:33:57 -- host/digest.sh@115 -- # killprocess 4009838 00:27:19.980 04:33:57 -- common/autotest_common.sh@936 -- # '[' -z 4009838 ']' 00:27:19.980 04:33:57 -- common/autotest_common.sh@940 -- # kill -0 4009838 00:27:19.980 04:33:57 -- common/autotest_common.sh@941 -- # uname 00:27:19.980 04:33:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:19.980 04:33:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4009838 00:27:19.980 04:33:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:19.980 04:33:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:19.980 04:33:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4009838' 00:27:19.980 killing process with pid 4009838 00:27:19.980 04:33:57 -- common/autotest_common.sh@955 -- # kill 4009838 00:27:19.980 04:33:57 -- common/autotest_common.sh@960 -- # wait 4009838 00:27:20.239 00:27:20.239 real 0m18.645s 00:27:20.239 user 0m37.265s 00:27:20.239 sys 0m4.717s 00:27:20.239 04:33:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:20.239 04:33:57 -- common/autotest_common.sh@10 -- # set +x 00:27:20.239 ************************************ 00:27:20.239 END TEST nvmf_digest_error 00:27:20.239 ************************************ 00:27:20.239 04:33:57 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:20.239 04:33:57 -- host/digest.sh@139 -- # nvmftestfini 00:27:20.239 04:33:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:20.239 04:33:57 -- nvmf/common.sh@116 -- # sync 00:27:20.239 04:33:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:20.239 04:33:57 -- nvmf/common.sh@119 -- # set +e 00:27:20.239 04:33:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:20.239 04:33:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:20.239 rmmod nvme_tcp 00:27:20.239 rmmod nvme_fabrics 00:27:20.239 rmmod nvme_keyring 00:27:20.239 04:33:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:20.239 04:33:57 -- nvmf/common.sh@123 -- # set -e 00:27:20.239 04:33:57 -- nvmf/common.sh@124 -- # return 0 00:27:20.239 04:33:57 -- nvmf/common.sh@477 -- # '[' -n 4009838 ']' 00:27:20.239 04:33:57 -- nvmf/common.sh@478 -- # killprocess 4009838 00:27:20.239 04:33:57 -- common/autotest_common.sh@936 -- # '[' -z 4009838 ']' 00:27:20.239 04:33:57 -- common/autotest_common.sh@940 -- # kill -0 4009838 00:27:20.239 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4009838) - No such process 00:27:20.239 04:33:57 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4009838 is not found' 00:27:20.239 Process with pid 4009838 is not found 00:27:20.239 04:33:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:20.239 04:33:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:20.239 04:33:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:20.239 04:33:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:20.239 04:33:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:20.239 04:33:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:20.239 04:33:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:20.239 04:33:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:22.779 04:33:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:22.779 00:27:22.779 real 0m39.113s 00:27:22.779 user 1m9.815s 00:27:22.779 sys 0m10.574s 00:27:22.779 04:33:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:22.779 04:33:59 -- common/autotest_common.sh@10 -- # set +x 00:27:22.779 ************************************ 00:27:22.779 END TEST nvmf_digest 00:27:22.779 ************************************ 00:27:22.779 04:33:59 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:22.779 04:33:59 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:22.779 04:33:59 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:22.779 04:33:59 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:22.779 04:33:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:22.779 04:33:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:22.779 04:33:59 -- common/autotest_common.sh@10 -- # set +x 00:27:22.779 ************************************ 00:27:22.779 START TEST nvmf_bdevperf 00:27:22.779 ************************************ 00:27:22.779 04:33:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:22.779 * Looking for test storage... 00:27:22.779 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:22.779 04:33:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:22.779 04:33:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:22.779 04:33:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:22.779 04:33:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:22.779 04:33:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:22.779 04:33:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:22.779 04:33:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:22.779 04:33:59 -- scripts/common.sh@335 -- # IFS=.-: 00:27:22.779 04:33:59 -- scripts/common.sh@335 -- # read -ra ver1 00:27:22.779 04:33:59 -- scripts/common.sh@336 -- # IFS=.-: 00:27:22.779 04:33:59 -- scripts/common.sh@336 -- # read -ra ver2 00:27:22.779 04:33:59 -- scripts/common.sh@337 -- # local 'op=<' 00:27:22.779 04:33:59 -- scripts/common.sh@339 -- # ver1_l=2 00:27:22.779 04:33:59 -- scripts/common.sh@340 -- # ver2_l=1 00:27:22.779 04:33:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:22.779 04:33:59 -- scripts/common.sh@343 -- # case "$op" in 00:27:22.779 04:33:59 -- scripts/common.sh@344 -- # : 1 00:27:22.779 04:33:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:22.779 04:33:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:22.779 04:33:59 -- scripts/common.sh@364 -- # decimal 1 00:27:22.779 04:33:59 -- scripts/common.sh@352 -- # local d=1 00:27:22.779 04:33:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:22.779 04:33:59 -- scripts/common.sh@354 -- # echo 1 00:27:22.779 04:33:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:22.779 04:33:59 -- scripts/common.sh@365 -- # decimal 2 00:27:22.779 04:33:59 -- scripts/common.sh@352 -- # local d=2 00:27:22.779 04:33:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:22.779 04:33:59 -- scripts/common.sh@354 -- # echo 2 00:27:22.779 04:33:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:22.779 04:33:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:22.779 04:33:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:22.779 04:33:59 -- scripts/common.sh@367 -- # return 0 00:27:22.779 04:33:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:22.779 04:33:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:22.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.779 --rc genhtml_branch_coverage=1 00:27:22.779 --rc genhtml_function_coverage=1 00:27:22.779 --rc genhtml_legend=1 00:27:22.779 --rc geninfo_all_blocks=1 00:27:22.779 --rc geninfo_unexecuted_blocks=1 00:27:22.779 00:27:22.779 ' 00:27:22.779 04:33:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:22.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.779 --rc genhtml_branch_coverage=1 00:27:22.779 --rc genhtml_function_coverage=1 00:27:22.779 --rc genhtml_legend=1 00:27:22.779 --rc geninfo_all_blocks=1 00:27:22.779 --rc geninfo_unexecuted_blocks=1 00:27:22.779 00:27:22.779 ' 00:27:22.779 04:33:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:22.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.779 --rc genhtml_branch_coverage=1 00:27:22.779 --rc genhtml_function_coverage=1 00:27:22.779 --rc genhtml_legend=1 00:27:22.779 --rc geninfo_all_blocks=1 00:27:22.779 --rc geninfo_unexecuted_blocks=1 00:27:22.779 00:27:22.779 ' 00:27:22.779 04:33:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:22.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:22.779 --rc genhtml_branch_coverage=1 00:27:22.779 --rc genhtml_function_coverage=1 00:27:22.779 --rc genhtml_legend=1 00:27:22.779 --rc geninfo_all_blocks=1 00:27:22.779 --rc geninfo_unexecuted_blocks=1 00:27:22.779 00:27:22.779 ' 00:27:22.779 04:33:59 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:22.779 04:33:59 -- nvmf/common.sh@7 -- # uname -s 00:27:22.779 04:33:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:22.779 04:33:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:22.779 04:33:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:22.779 04:33:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:22.779 04:33:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:22.779 04:33:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:22.779 04:33:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:22.779 04:33:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:22.779 04:33:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:22.779 04:33:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:22.779 04:33:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:22.779 04:33:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:22.779 04:33:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:22.780 04:33:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:22.780 04:33:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:22.780 04:33:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:22.780 04:33:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:22.780 04:33:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:22.780 04:33:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:22.780 04:33:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.780 04:33:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.780 04:33:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.780 04:33:59 -- paths/export.sh@5 -- # export PATH 00:27:22.780 04:33:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:22.780 04:33:59 -- nvmf/common.sh@46 -- # : 0 00:27:22.780 04:33:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:22.780 04:33:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:22.780 04:33:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:22.780 04:33:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:22.780 04:33:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:22.780 04:33:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:22.780 04:33:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:22.780 04:33:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:22.780 04:33:59 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:22.780 04:33:59 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:22.780 04:33:59 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:22.780 04:33:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:22.780 04:33:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:22.780 04:33:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:22.780 04:33:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:22.780 04:33:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:22.780 04:33:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:22.780 04:33:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:22.780 04:33:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:22.780 04:33:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:22.780 04:33:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:22.780 04:33:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:22.780 04:33:59 -- common/autotest_common.sh@10 -- # set +x 00:27:24.680 04:34:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:24.680 04:34:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:24.680 04:34:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:24.680 04:34:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:24.680 04:34:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:24.680 04:34:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:24.680 04:34:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:24.680 04:34:01 -- nvmf/common.sh@294 -- # net_devs=() 00:27:24.680 04:34:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:24.680 04:34:01 -- nvmf/common.sh@295 -- # e810=() 00:27:24.680 04:34:01 -- nvmf/common.sh@295 -- # local -ga e810 00:27:24.680 04:34:01 -- nvmf/common.sh@296 -- # x722=() 00:27:24.680 04:34:01 -- nvmf/common.sh@296 -- # local -ga x722 00:27:24.680 04:34:01 -- nvmf/common.sh@297 -- # mlx=() 00:27:24.680 04:34:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:24.680 04:34:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:24.680 04:34:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:24.681 04:34:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:24.681 04:34:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:24.681 04:34:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:24.681 04:34:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:24.681 04:34:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:24.681 04:34:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:24.681 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:24.681 04:34:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:24.681 04:34:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:24.681 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:24.681 04:34:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:24.681 04:34:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:24.681 04:34:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:24.681 04:34:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:24.681 04:34:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:24.681 04:34:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:24.681 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:24.681 04:34:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:24.681 04:34:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:24.681 04:34:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:24.681 04:34:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:24.681 04:34:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:24.681 04:34:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:24.681 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:24.681 04:34:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:24.681 04:34:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:24.681 04:34:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:24.681 04:34:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:24.681 04:34:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:24.681 04:34:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:24.681 04:34:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:24.681 04:34:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:24.681 04:34:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:24.681 04:34:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:24.681 04:34:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:24.681 04:34:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:24.681 04:34:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:24.681 04:34:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:24.681 04:34:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:24.681 04:34:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:24.681 04:34:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:24.681 04:34:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:24.681 04:34:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:24.681 04:34:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:24.681 04:34:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:24.681 04:34:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:24.681 04:34:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:24.681 04:34:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:24.681 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:24.681 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:27:24.681 00:27:24.681 --- 10.0.0.2 ping statistics --- 00:27:24.681 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:24.681 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:27:24.681 04:34:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:24.681 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:24.681 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:27:24.681 00:27:24.681 --- 10.0.0.1 ping statistics --- 00:27:24.681 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:24.681 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:27:24.681 04:34:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:24.681 04:34:01 -- nvmf/common.sh@410 -- # return 0 00:27:24.681 04:34:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:24.681 04:34:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:24.681 04:34:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:24.681 04:34:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:24.681 04:34:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:24.681 04:34:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:24.681 04:34:01 -- host/bdevperf.sh@25 -- # tgt_init 00:27:24.681 04:34:01 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:24.681 04:34:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:24.681 04:34:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:24.681 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:27:24.681 04:34:01 -- nvmf/common.sh@469 -- # nvmfpid=4014124 00:27:24.681 04:34:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:24.681 04:34:01 -- nvmf/common.sh@470 -- # waitforlisten 4014124 00:27:24.681 04:34:01 -- common/autotest_common.sh@829 -- # '[' -z 4014124 ']' 00:27:24.681 04:34:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:24.681 04:34:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:24.681 04:34:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:24.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:24.681 04:34:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:24.681 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:27:24.681 [2024-11-28 04:34:01.894478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:24.681 [2024-11-28 04:34:01.894586] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:24.681 EAL: No free 2048 kB hugepages reported on node 1 00:27:24.681 [2024-11-28 04:34:01.967933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:24.941 [2024-11-28 04:34:02.084156] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:24.941 [2024-11-28 04:34:02.084320] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:24.941 [2024-11-28 04:34:02.084340] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:24.941 [2024-11-28 04:34:02.084354] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:24.941 [2024-11-28 04:34:02.084442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:24.942 [2024-11-28 04:34:02.084557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:24.942 [2024-11-28 04:34:02.084562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:25.877 04:34:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:25.877 04:34:02 -- common/autotest_common.sh@862 -- # return 0 00:27:25.877 04:34:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:25.877 04:34:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:25.877 04:34:02 -- common/autotest_common.sh@10 -- # set +x 00:27:25.877 04:34:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:25.877 04:34:02 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:25.877 04:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:25.877 04:34:02 -- common/autotest_common.sh@10 -- # set +x 00:27:25.877 [2024-11-28 04:34:02.870705] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:25.877 04:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:25.877 04:34:02 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:25.877 04:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:25.877 04:34:02 -- common/autotest_common.sh@10 -- # set +x 00:27:25.877 Malloc0 00:27:25.877 04:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:25.877 04:34:02 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:25.877 04:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:25.877 04:34:02 -- common/autotest_common.sh@10 -- # set +x 00:27:25.877 04:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:25.877 04:34:02 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:25.877 04:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:25.877 04:34:02 -- common/autotest_common.sh@10 -- # set +x 00:27:25.877 04:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:25.877 04:34:02 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:25.877 04:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:25.877 04:34:02 -- common/autotest_common.sh@10 -- # set +x 00:27:25.877 [2024-11-28 04:34:02.926901] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:25.877 04:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:25.877 04:34:02 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:25.877 04:34:02 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:25.877 04:34:02 -- nvmf/common.sh@520 -- # config=() 00:27:25.877 04:34:02 -- nvmf/common.sh@520 -- # local subsystem config 00:27:25.877 04:34:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:25.877 04:34:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:25.877 { 00:27:25.877 "params": { 00:27:25.877 "name": "Nvme$subsystem", 00:27:25.877 "trtype": "$TEST_TRANSPORT", 00:27:25.877 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:25.877 "adrfam": "ipv4", 00:27:25.877 "trsvcid": "$NVMF_PORT", 00:27:25.877 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:25.877 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:25.877 "hdgst": ${hdgst:-false}, 00:27:25.877 "ddgst": ${ddgst:-false} 00:27:25.877 }, 00:27:25.877 "method": "bdev_nvme_attach_controller" 00:27:25.877 } 00:27:25.877 EOF 00:27:25.877 )") 00:27:25.877 04:34:02 -- nvmf/common.sh@542 -- # cat 00:27:25.877 04:34:02 -- nvmf/common.sh@544 -- # jq . 00:27:25.877 04:34:02 -- nvmf/common.sh@545 -- # IFS=, 00:27:25.877 04:34:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:25.877 "params": { 00:27:25.877 "name": "Nvme1", 00:27:25.877 "trtype": "tcp", 00:27:25.877 "traddr": "10.0.0.2", 00:27:25.877 "adrfam": "ipv4", 00:27:25.877 "trsvcid": "4420", 00:27:25.877 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:25.877 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:25.877 "hdgst": false, 00:27:25.877 "ddgst": false 00:27:25.877 }, 00:27:25.877 "method": "bdev_nvme_attach_controller" 00:27:25.877 }' 00:27:25.877 [2024-11-28 04:34:02.969242] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:25.877 [2024-11-28 04:34:02.969313] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4014241 ] 00:27:25.877 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.878 [2024-11-28 04:34:03.031884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:25.878 [2024-11-28 04:34:03.139670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:26.137 Running I/O for 1 seconds... 00:27:27.072 00:27:27.072 Latency(us) 00:27:27.072 [2024-11-28T03:34:04.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:27.072 [2024-11-28T03:34:04.383Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:27.072 Verification LBA range: start 0x0 length 0x4000 00:27:27.072 Nvme1n1 : 1.01 12751.55 49.81 0.00 0.00 9991.41 1419.95 17282.09 00:27:27.072 [2024-11-28T03:34:04.383Z] =================================================================================================================== 00:27:27.072 [2024-11-28T03:34:04.383Z] Total : 12751.55 49.81 0.00 0.00 9991.41 1419.95 17282.09 00:27:27.329 04:34:04 -- host/bdevperf.sh@30 -- # bdevperfpid=4014471 00:27:27.329 04:34:04 -- host/bdevperf.sh@32 -- # sleep 3 00:27:27.329 04:34:04 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:27.329 04:34:04 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:27.329 04:34:04 -- nvmf/common.sh@520 -- # config=() 00:27:27.329 04:34:04 -- nvmf/common.sh@520 -- # local subsystem config 00:27:27.329 04:34:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:27.329 04:34:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:27.329 { 00:27:27.329 "params": { 00:27:27.329 "name": "Nvme$subsystem", 00:27:27.329 "trtype": "$TEST_TRANSPORT", 00:27:27.329 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:27.329 "adrfam": "ipv4", 00:27:27.329 "trsvcid": "$NVMF_PORT", 00:27:27.329 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:27.329 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:27.329 "hdgst": ${hdgst:-false}, 00:27:27.329 "ddgst": ${ddgst:-false} 00:27:27.329 }, 00:27:27.329 "method": "bdev_nvme_attach_controller" 00:27:27.329 } 00:27:27.329 EOF 00:27:27.329 )") 00:27:27.329 04:34:04 -- nvmf/common.sh@542 -- # cat 00:27:27.329 04:34:04 -- nvmf/common.sh@544 -- # jq . 00:27:27.329 04:34:04 -- nvmf/common.sh@545 -- # IFS=, 00:27:27.329 04:34:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:27.329 "params": { 00:27:27.329 "name": "Nvme1", 00:27:27.329 "trtype": "tcp", 00:27:27.329 "traddr": "10.0.0.2", 00:27:27.329 "adrfam": "ipv4", 00:27:27.329 "trsvcid": "4420", 00:27:27.329 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:27.329 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:27.329 "hdgst": false, 00:27:27.329 "ddgst": false 00:27:27.329 }, 00:27:27.329 "method": "bdev_nvme_attach_controller" 00:27:27.329 }' 00:27:27.329 [2024-11-28 04:34:04.604431] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:27.329 [2024-11-28 04:34:04.604534] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4014471 ] 00:27:27.329 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.587 [2024-11-28 04:34:04.666044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:27.587 [2024-11-28 04:34:04.771377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:27.846 Running I/O for 15 seconds... 00:27:30.380 04:34:07 -- host/bdevperf.sh@33 -- # kill -9 4014124 00:27:30.380 04:34:07 -- host/bdevperf.sh@35 -- # sleep 3 00:27:30.380 [2024-11-28 04:34:07.581212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:104024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:104048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:104064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:103368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:103376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:103384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:103392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:103400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:103408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:103416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:103424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:104120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:104176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.581724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:104184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:104192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.581789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:103432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:103448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:103456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:103464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:103472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.581969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.581985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:103480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:103488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:103520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:103528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:103536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:103544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:103560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:103568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:103576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:103584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:103592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:104200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:104208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:104216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:104224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:103616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:103640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:103680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:103688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:103696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:103720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:103728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:103744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:104232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:104240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:104248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:104256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.582882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:104264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:104272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:104280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.582977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.582993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:104288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.583008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.583025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:104296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.583041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.583058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:104304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.380 [2024-11-28 04:34:07.583073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.583090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:104312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.380 [2024-11-28 04:34:07.583105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.380 [2024-11-28 04:34:07.583122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:103768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:103784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:103792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:103800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:103808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:103816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:103864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:103872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:104320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:104328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.583425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:104336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:104344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:104352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:104360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:104368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:104376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:104384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:104392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:104400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:104408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.583765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:104416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:104424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.583839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:104432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:104440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.583905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:104448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.583937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:104456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.583968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.583985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:104464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:103888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:103904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:103960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:103968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:103984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:103992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:104000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:104008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:104472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:104480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:104488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:104496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:104504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:104512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:104520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:104016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:104032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:104040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:104056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:104072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:104080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:104088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:104096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:104528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:104536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:104544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:104552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.584911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:104560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:104568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.584976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.584993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:104576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.585009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:104584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.585042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:104592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:104600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.585107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:104608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:104616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:104624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.585207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:104632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:104640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.585272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:104648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:30.381 [2024-11-28 04:34:07.585309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:104104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:104112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:104128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:104136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:104144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:104152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:104160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:30.381 [2024-11-28 04:34:07.585545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c46740 is same with the state(5) to be set 00:27:30.381 [2024-11-28 04:34:07.585607] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:30.381 [2024-11-28 04:34:07.585619] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:30.381 [2024-11-28 04:34:07.585631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:104168 len:8 PRP1 0x0 PRP2 0x0 00:27:30.381 [2024-11-28 04:34:07.585644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585723] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c46740 was disconnected and freed. reset controller. 00:27:30.381 [2024-11-28 04:34:07.585805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:30.381 [2024-11-28 04:34:07.585842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:30.381 [2024-11-28 04:34:07.585893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:30.381 [2024-11-28 04:34:07.585926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585938] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:30.381 [2024-11-28 04:34:07.585968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:30.381 [2024-11-28 04:34:07.585983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.381 [2024-11-28 04:34:07.588422] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.381 [2024-11-28 04:34:07.588465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.381 [2024-11-28 04:34:07.589032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.381 [2024-11-28 04:34:07.589255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.381 [2024-11-28 04:34:07.589312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.381 [2024-11-28 04:34:07.589331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.381 [2024-11-28 04:34:07.589482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.381 [2024-11-28 04:34:07.589669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.381 [2024-11-28 04:34:07.589703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.381 [2024-11-28 04:34:07.589721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.381 [2024-11-28 04:34:07.592109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.381 [2024-11-28 04:34:07.601188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.381 [2024-11-28 04:34:07.601508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.381 [2024-11-28 04:34:07.601697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.381 [2024-11-28 04:34:07.601726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.381 [2024-11-28 04:34:07.601742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.381 [2024-11-28 04:34:07.601925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.381 [2024-11-28 04:34:07.602149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.381 [2024-11-28 04:34:07.602173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.381 [2024-11-28 04:34:07.602189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.381 [2024-11-28 04:34:07.604587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.381 [2024-11-28 04:34:07.613668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.381 [2024-11-28 04:34:07.614027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.381 [2024-11-28 04:34:07.614202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.381 [2024-11-28 04:34:07.614231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.382 [2024-11-28 04:34:07.614255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.382 [2024-11-28 04:34:07.614456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.382 [2024-11-28 04:34:07.614641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.382 [2024-11-28 04:34:07.614667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.382 [2024-11-28 04:34:07.614683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.382 [2024-11-28 04:34:07.617054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.382 [2024-11-28 04:34:07.626295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.382 [2024-11-28 04:34:07.626641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.626825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.626855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.382 [2024-11-28 04:34:07.626872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.382 [2024-11-28 04:34:07.626963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.382 [2024-11-28 04:34:07.627078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.382 [2024-11-28 04:34:07.627101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.382 [2024-11-28 04:34:07.627116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.382 [2024-11-28 04:34:07.629433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.382 [2024-11-28 04:34:07.638756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.382 [2024-11-28 04:34:07.639113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.639313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.639372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.382 [2024-11-28 04:34:07.639389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.382 [2024-11-28 04:34:07.639547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.382 [2024-11-28 04:34:07.639736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.382 [2024-11-28 04:34:07.639760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.382 [2024-11-28 04:34:07.639776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.382 [2024-11-28 04:34:07.642070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.382 [2024-11-28 04:34:07.651336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.382 [2024-11-28 04:34:07.651648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.651801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.651830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.382 [2024-11-28 04:34:07.651847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.382 [2024-11-28 04:34:07.652018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.382 [2024-11-28 04:34:07.652170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.382 [2024-11-28 04:34:07.652194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.382 [2024-11-28 04:34:07.652210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.382 [2024-11-28 04:34:07.654664] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.382 [2024-11-28 04:34:07.663755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.382 [2024-11-28 04:34:07.664023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.664190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.664219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.382 [2024-11-28 04:34:07.664236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.382 [2024-11-28 04:34:07.664401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.382 [2024-11-28 04:34:07.664580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.382 [2024-11-28 04:34:07.664606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.382 [2024-11-28 04:34:07.664622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.382 [2024-11-28 04:34:07.667153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.382 [2024-11-28 04:34:07.676388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.382 [2024-11-28 04:34:07.676722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.676869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.382 [2024-11-28 04:34:07.676899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.382 [2024-11-28 04:34:07.676916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.382 [2024-11-28 04:34:07.677099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.382 [2024-11-28 04:34:07.677269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.382 [2024-11-28 04:34:07.677292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.382 [2024-11-28 04:34:07.677309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.382 [2024-11-28 04:34:07.679481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.688860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.689130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.689302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.689331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.689348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.689513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.689683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.642 [2024-11-28 04:34:07.689708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.642 [2024-11-28 04:34:07.689724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.642 [2024-11-28 04:34:07.692126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.701586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.701914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.702064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.702093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.702110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.702274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.702444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.642 [2024-11-28 04:34:07.702468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.642 [2024-11-28 04:34:07.702484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.642 [2024-11-28 04:34:07.704811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.714171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.714588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.714738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.714767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.714785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.714951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.715066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.642 [2024-11-28 04:34:07.715091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.642 [2024-11-28 04:34:07.715107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.642 [2024-11-28 04:34:07.717370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.726719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.727022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.727182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.727208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.727224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.727385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.727629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.642 [2024-11-28 04:34:07.727655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.642 [2024-11-28 04:34:07.727669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.642 [2024-11-28 04:34:07.729994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.739146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.739380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.739490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.739518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.739548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.739715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.739867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.642 [2024-11-28 04:34:07.739891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.642 [2024-11-28 04:34:07.739907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.642 [2024-11-28 04:34:07.742435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.751554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.751884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.752037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.752066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.752083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.752266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.752453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.642 [2024-11-28 04:34:07.752477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.642 [2024-11-28 04:34:07.752493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.642 [2024-11-28 04:34:07.754890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.763974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.764321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.764493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.764518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.764542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.764725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.764907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.642 [2024-11-28 04:34:07.764930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.642 [2024-11-28 04:34:07.764952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.642 [2024-11-28 04:34:07.767139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.642 [2024-11-28 04:34:07.776619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.642 [2024-11-28 04:34:07.776974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.777146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.642 [2024-11-28 04:34:07.777171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.642 [2024-11-28 04:34:07.777187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.642 [2024-11-28 04:34:07.777335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.642 [2024-11-28 04:34:07.777548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.777573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.777589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.779724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.789265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.789539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.789769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.789799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.789816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.790036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.790187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.790211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.790227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.792488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.801890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.802291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.802495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.802531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.802551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.802680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.802868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.802891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.802907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.805246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.814412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.814692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.814851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.814877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.814893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.815056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.815238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.815262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.815277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.817481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.826990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.827353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.827539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.827586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.827602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.827798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.827961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.827985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.828000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.830648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.839647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.840031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.840230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.840259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.840276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.840441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.840643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.840669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.840684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.843144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.852183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.852514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.852650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.852676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.852692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.852824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.852975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.852996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.853009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.855532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.864612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.864959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.865113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.865138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.865153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.865318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.865484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.865505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.865518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.867605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.877322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.877611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.877731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.877759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.877776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.877994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.878128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.878151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.878167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.643 [2024-11-28 04:34:07.880411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.643 [2024-11-28 04:34:07.890186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.643 [2024-11-28 04:34:07.890635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.890767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.643 [2024-11-28 04:34:07.890796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.643 [2024-11-28 04:34:07.890813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.643 [2024-11-28 04:34:07.890997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.643 [2024-11-28 04:34:07.891184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.643 [2024-11-28 04:34:07.891208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.643 [2024-11-28 04:34:07.891224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.644 [2024-11-28 04:34:07.893585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.644 [2024-11-28 04:34:07.902781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.644 [2024-11-28 04:34:07.903130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.903281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.903306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.644 [2024-11-28 04:34:07.903321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.644 [2024-11-28 04:34:07.903433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.644 [2024-11-28 04:34:07.903640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.644 [2024-11-28 04:34:07.903665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.644 [2024-11-28 04:34:07.903681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.644 [2024-11-28 04:34:07.905980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.644 [2024-11-28 04:34:07.915365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.644 [2024-11-28 04:34:07.915681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.915822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.915850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.644 [2024-11-28 04:34:07.915867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.644 [2024-11-28 04:34:07.916014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.644 [2024-11-28 04:34:07.916184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.644 [2024-11-28 04:34:07.916207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.644 [2024-11-28 04:34:07.916223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.644 [2024-11-28 04:34:07.918431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.644 [2024-11-28 04:34:07.927762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.644 [2024-11-28 04:34:07.928088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.928278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.928312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.644 [2024-11-28 04:34:07.928328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.644 [2024-11-28 04:34:07.928508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.644 [2024-11-28 04:34:07.928704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.644 [2024-11-28 04:34:07.928728] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.644 [2024-11-28 04:34:07.928744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.644 [2024-11-28 04:34:07.931073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.644 [2024-11-28 04:34:07.940359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.644 [2024-11-28 04:34:07.940703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.940818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.644 [2024-11-28 04:34:07.940845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.644 [2024-11-28 04:34:07.940862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.644 [2024-11-28 04:34:07.941009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.644 [2024-11-28 04:34:07.941143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.644 [2024-11-28 04:34:07.941167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.644 [2024-11-28 04:34:07.941182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.644 [2024-11-28 04:34:07.943615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.904 [2024-11-28 04:34:07.953070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.904 [2024-11-28 04:34:07.953375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.904 [2024-11-28 04:34:07.953558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.904 [2024-11-28 04:34:07.953588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.904 [2024-11-28 04:34:07.953605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.904 [2024-11-28 04:34:07.953771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.904 [2024-11-28 04:34:07.953941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.904 [2024-11-28 04:34:07.953965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.904 [2024-11-28 04:34:07.953980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.904 [2024-11-28 04:34:07.956223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.904 [2024-11-28 04:34:07.965641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.904 [2024-11-28 04:34:07.966027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.904 [2024-11-28 04:34:07.966147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.904 [2024-11-28 04:34:07.966176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.904 [2024-11-28 04:34:07.966199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.904 [2024-11-28 04:34:07.966348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.904 [2024-11-28 04:34:07.966499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.904 [2024-11-28 04:34:07.966523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:07.966552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:07.968812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:07.978220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:07.978593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:07.978699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:07.978725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:07.978741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:07.978932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:07.979113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:07.979138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:07.979154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:07.981588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:07.990936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:07.991242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:07.991379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:07.991404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:07.991420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:07.991608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:07.991833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:07.991857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:07.991873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:07.994018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.003511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.003927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.004026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.004050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.004065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.004311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.004427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.004450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.004466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.006916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.016229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.016540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.016684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.016714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.016732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.016861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.017031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.017054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.017070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.019349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.028654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.028923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.029093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.029119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.029134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.029299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.029500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.029536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.029556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.031943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.041217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.041539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.041713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.041741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.041758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.041977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.042117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.042141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.042157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.044419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.053743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.054074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.054207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.054236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.054253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.054417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.054599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.054624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.054640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.057044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.066350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.066775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.066947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.066975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.066993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.067103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.067290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.067314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.067330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.069542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.078981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.079321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.079464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.079493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.079510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.079722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.079857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.079886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.079903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.082308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.091460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.091758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.091907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.091936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.091954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.092083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.092216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.092240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.092256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.094428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.104113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.104430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.104582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.104612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.104629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.104794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.104928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.104952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.104968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.107247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.116589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.116949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.117131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.117157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.117173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.117352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.117549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.117574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.117595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.119945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.129199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.129535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.129705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.129733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.129750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.129896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.130066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.130090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.130106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.132558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.141719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.142031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.142175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.142204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.142221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.142421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.142566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.142592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.142608] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.144830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.154366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.154677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.154852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.154880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.154898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.155062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.155195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.155219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.155235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.157638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.167050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.167304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.167448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.167490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.167506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.167681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.167848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.167872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.167887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.170092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.179692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.180040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.180181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.180210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.180227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.180374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.180556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.180580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.180597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.182909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.192264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.192606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.192765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.192791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.192806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.192963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.193169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.193192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.193208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.195657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.905 [2024-11-28 04:34:08.204814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.905 [2024-11-28 04:34:08.205159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.205289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.905 [2024-11-28 04:34:08.205318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:30.905 [2024-11-28 04:34:08.205335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:30.905 [2024-11-28 04:34:08.205483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:30.905 [2024-11-28 04:34:08.205651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.905 [2024-11-28 04:34:08.205677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.905 [2024-11-28 04:34:08.205693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.905 [2024-11-28 04:34:08.207936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.166 [2024-11-28 04:34:08.217231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.166 [2024-11-28 04:34:08.217604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.217751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.217780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.166 [2024-11-28 04:34:08.217798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.166 [2024-11-28 04:34:08.217963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.166 [2024-11-28 04:34:08.218115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.166 [2024-11-28 04:34:08.218140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.166 [2024-11-28 04:34:08.218155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.166 [2024-11-28 04:34:08.220452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.166 [2024-11-28 04:34:08.229912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.166 [2024-11-28 04:34:08.230232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.230374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.230403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.166 [2024-11-28 04:34:08.230421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.166 [2024-11-28 04:34:08.230578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.166 [2024-11-28 04:34:08.230785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.166 [2024-11-28 04:34:08.230809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.166 [2024-11-28 04:34:08.230825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.166 [2024-11-28 04:34:08.233231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.166 [2024-11-28 04:34:08.242415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.166 [2024-11-28 04:34:08.242708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.242856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.242897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.166 [2024-11-28 04:34:08.242913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.166 [2024-11-28 04:34:08.243038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.166 [2024-11-28 04:34:08.243220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.166 [2024-11-28 04:34:08.243244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.166 [2024-11-28 04:34:08.243260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.166 [2024-11-28 04:34:08.245484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.166 [2024-11-28 04:34:08.255105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.166 [2024-11-28 04:34:08.255413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.255585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.255615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.166 [2024-11-28 04:34:08.255633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.166 [2024-11-28 04:34:08.255815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.166 [2024-11-28 04:34:08.255930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.166 [2024-11-28 04:34:08.255954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.166 [2024-11-28 04:34:08.255970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.166 [2024-11-28 04:34:08.258335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.166 [2024-11-28 04:34:08.267836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.166 [2024-11-28 04:34:08.268200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.268340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.268369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.166 [2024-11-28 04:34:08.268387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.166 [2024-11-28 04:34:08.268598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.166 [2024-11-28 04:34:08.268788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.166 [2024-11-28 04:34:08.268812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.166 [2024-11-28 04:34:08.268827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.166 [2024-11-28 04:34:08.271246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.166 [2024-11-28 04:34:08.280300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.166 [2024-11-28 04:34:08.280574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.280747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.166 [2024-11-28 04:34:08.280782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.166 [2024-11-28 04:34:08.280800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.166 [2024-11-28 04:34:08.280929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.166 [2024-11-28 04:34:08.281116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.167 [2024-11-28 04:34:08.281140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.167 [2024-11-28 04:34:08.281156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.167 [2024-11-28 04:34:08.283324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.167 [2024-11-28 04:34:08.292689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.167 [2024-11-28 04:34:08.293140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.293323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.293352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.167 [2024-11-28 04:34:08.293369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.167 [2024-11-28 04:34:08.293515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.167 [2024-11-28 04:34:08.293661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.167 [2024-11-28 04:34:08.293685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.167 [2024-11-28 04:34:08.293701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.167 [2024-11-28 04:34:08.296013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.167 [2024-11-28 04:34:08.305399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.167 [2024-11-28 04:34:08.305693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.305846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.305875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.167 [2024-11-28 04:34:08.305892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.167 [2024-11-28 04:34:08.306057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.167 [2024-11-28 04:34:08.306226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.167 [2024-11-28 04:34:08.306250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.167 [2024-11-28 04:34:08.306266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.167 [2024-11-28 04:34:08.308805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.167 [2024-11-28 04:34:08.317996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.167 [2024-11-28 04:34:08.318322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.318467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.318496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.167 [2024-11-28 04:34:08.318519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.167 [2024-11-28 04:34:08.318697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.167 [2024-11-28 04:34:08.318849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.167 [2024-11-28 04:34:08.318872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.167 [2024-11-28 04:34:08.318888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.167 [2024-11-28 04:34:08.321490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.167 [2024-11-28 04:34:08.330577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.167 [2024-11-28 04:34:08.330869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.331021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.331050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.167 [2024-11-28 04:34:08.331067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.167 [2024-11-28 04:34:08.331286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.167 [2024-11-28 04:34:08.331456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.167 [2024-11-28 04:34:08.331480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.167 [2024-11-28 04:34:08.331495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.167 [2024-11-28 04:34:08.333872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.167 [2024-11-28 04:34:08.343218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.167 [2024-11-28 04:34:08.343627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.343743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.343772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.167 [2024-11-28 04:34:08.343790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.167 [2024-11-28 04:34:08.343973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.167 [2024-11-28 04:34:08.344125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.167 [2024-11-28 04:34:08.344149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.167 [2024-11-28 04:34:08.344164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.167 [2024-11-28 04:34:08.346559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.167 [2024-11-28 04:34:08.355747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.167 [2024-11-28 04:34:08.356083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.356205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.356230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.167 [2024-11-28 04:34:08.356245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.167 [2024-11-28 04:34:08.356412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.167 [2024-11-28 04:34:08.356573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.167 [2024-11-28 04:34:08.356598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.167 [2024-11-28 04:34:08.356613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.167 [2024-11-28 04:34:08.359159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.167 [2024-11-28 04:34:08.368168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.167 [2024-11-28 04:34:08.368486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.368641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.167 [2024-11-28 04:34:08.368668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.167 [2024-11-28 04:34:08.368683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.167 [2024-11-28 04:34:08.368847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.369064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.369088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.369104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.168 [2024-11-28 04:34:08.371459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.168 [2024-11-28 04:34:08.380658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.168 [2024-11-28 04:34:08.380947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.381089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.381118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.168 [2024-11-28 04:34:08.381136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.168 [2024-11-28 04:34:08.381264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.381451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.381475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.381490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.168 [2024-11-28 04:34:08.383922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.168 [2024-11-28 04:34:08.393241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.168 [2024-11-28 04:34:08.393594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.393770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.393796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.168 [2024-11-28 04:34:08.393812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.168 [2024-11-28 04:34:08.393943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.394165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.394190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.394205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.168 [2024-11-28 04:34:08.396565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.168 [2024-11-28 04:34:08.405933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.168 [2024-11-28 04:34:08.406234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.406393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.406422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.168 [2024-11-28 04:34:08.406440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.168 [2024-11-28 04:34:08.406616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.406750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.406773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.406789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.168 [2024-11-28 04:34:08.409212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.168 [2024-11-28 04:34:08.418413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.168 [2024-11-28 04:34:08.418816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.419049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.419078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.168 [2024-11-28 04:34:08.419096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.168 [2024-11-28 04:34:08.419261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.419412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.419435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.419451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.168 [2024-11-28 04:34:08.421665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.168 [2024-11-28 04:34:08.430883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.168 [2024-11-28 04:34:08.431187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.431335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.431366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.168 [2024-11-28 04:34:08.431384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.168 [2024-11-28 04:34:08.431561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.431695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.431724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.431741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.168 [2024-11-28 04:34:08.434127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.168 [2024-11-28 04:34:08.443358] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.168 [2024-11-28 04:34:08.443669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.443814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.443842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.168 [2024-11-28 04:34:08.443859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.168 [2024-11-28 04:34:08.444024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.444212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.444235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.444251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.168 [2024-11-28 04:34:08.446682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.168 [2024-11-28 04:34:08.456022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.168 [2024-11-28 04:34:08.456289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.456457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.168 [2024-11-28 04:34:08.456486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.168 [2024-11-28 04:34:08.456503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.168 [2024-11-28 04:34:08.456733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.168 [2024-11-28 04:34:08.456941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.168 [2024-11-28 04:34:08.456964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.168 [2024-11-28 04:34:08.456980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.169 [2024-11-28 04:34:08.459386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.169 [2024-11-28 04:34:08.468496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.169 [2024-11-28 04:34:08.468838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.169 [2024-11-28 04:34:08.468976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.169 [2024-11-28 04:34:08.469003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.169 [2024-11-28 04:34:08.469019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.169 [2024-11-28 04:34:08.469199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.169 [2024-11-28 04:34:08.469387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.169 [2024-11-28 04:34:08.469411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.169 [2024-11-28 04:34:08.469432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.169 [2024-11-28 04:34:08.471795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.429 [2024-11-28 04:34:08.480947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.429 [2024-11-28 04:34:08.481256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.429 [2024-11-28 04:34:08.481367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.429 [2024-11-28 04:34:08.481410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.429 [2024-11-28 04:34:08.481426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.429 [2024-11-28 04:34:08.481600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.429 [2024-11-28 04:34:08.481770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.429 [2024-11-28 04:34:08.481794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.429 [2024-11-28 04:34:08.481809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.429 [2024-11-28 04:34:08.484088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.429 [2024-11-28 04:34:08.493616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.429 [2024-11-28 04:34:08.493953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.429 [2024-11-28 04:34:08.494098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.429 [2024-11-28 04:34:08.494127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.429 [2024-11-28 04:34:08.494144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.429 [2024-11-28 04:34:08.494309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.429 [2024-11-28 04:34:08.494497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.429 [2024-11-28 04:34:08.494521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.429 [2024-11-28 04:34:08.494548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.429 [2024-11-28 04:34:08.496792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.506347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.506617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.506765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.506794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.506812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.506995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.507129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.507153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.507168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.509384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.518930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.519200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.519370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.519399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.519416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.519611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.519781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.519804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.519820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.522059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.531622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.531941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.532094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.532120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.532136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.532284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.532539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.532564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.532579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.534910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.544199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.544494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.544656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.544685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.544703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.544886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.545055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.545079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.545094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.547428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.556678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.557008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.557150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.557180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.557197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.557380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.557542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.557567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.557582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.559823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.569345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.569687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.569864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.569891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.569907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.570067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.570272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.570296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.570311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.572599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.581930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.582272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.582441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.582470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.582488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.582686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.582858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.582893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.582910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.585306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.430 [2024-11-28 04:34:08.594775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.430 [2024-11-28 04:34:08.595135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.595277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.430 [2024-11-28 04:34:08.595304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.430 [2024-11-28 04:34:08.595320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.430 [2024-11-28 04:34:08.595468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.430 [2024-11-28 04:34:08.595598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.430 [2024-11-28 04:34:08.595621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.430 [2024-11-28 04:34:08.595635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.430 [2024-11-28 04:34:08.597898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.607356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.607669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.607797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.607823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.431 [2024-11-28 04:34:08.607838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.431 [2024-11-28 04:34:08.608035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.431 [2024-11-28 04:34:08.608241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.431 [2024-11-28 04:34:08.608264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.431 [2024-11-28 04:34:08.608281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.431 [2024-11-28 04:34:08.610589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.619892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.620187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.620370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.620396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.431 [2024-11-28 04:34:08.620412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.431 [2024-11-28 04:34:08.620581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.431 [2024-11-28 04:34:08.620770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.431 [2024-11-28 04:34:08.620794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.431 [2024-11-28 04:34:08.620810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.431 [2024-11-28 04:34:08.623080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.632349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.632615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.632764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.632794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.431 [2024-11-28 04:34:08.632811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.431 [2024-11-28 04:34:08.633013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.431 [2024-11-28 04:34:08.633183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.431 [2024-11-28 04:34:08.633207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.431 [2024-11-28 04:34:08.633222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.431 [2024-11-28 04:34:08.635589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.644952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.645308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.645488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.645517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.431 [2024-11-28 04:34:08.645543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.431 [2024-11-28 04:34:08.645674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.431 [2024-11-28 04:34:08.645879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.431 [2024-11-28 04:34:08.645904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.431 [2024-11-28 04:34:08.645919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.431 [2024-11-28 04:34:08.648232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.657550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.657838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.658034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.658082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.431 [2024-11-28 04:34:08.658099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.431 [2024-11-28 04:34:08.658264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.431 [2024-11-28 04:34:08.658451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.431 [2024-11-28 04:34:08.658474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.431 [2024-11-28 04:34:08.658489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.431 [2024-11-28 04:34:08.660932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.670186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.670539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.670676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.670705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.431 [2024-11-28 04:34:08.670728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.431 [2024-11-28 04:34:08.670882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.431 [2024-11-28 04:34:08.671050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.431 [2024-11-28 04:34:08.671074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.431 [2024-11-28 04:34:08.671089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.431 [2024-11-28 04:34:08.673520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.682890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.683172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.683342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.431 [2024-11-28 04:34:08.683382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.431 [2024-11-28 04:34:08.683399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.431 [2024-11-28 04:34:08.683592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.431 [2024-11-28 04:34:08.683762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.431 [2024-11-28 04:34:08.683787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.431 [2024-11-28 04:34:08.683802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.431 [2024-11-28 04:34:08.686053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.431 [2024-11-28 04:34:08.695578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.431 [2024-11-28 04:34:08.695940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.696083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.696114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.432 [2024-11-28 04:34:08.696132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.432 [2024-11-28 04:34:08.696297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.432 [2024-11-28 04:34:08.696466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.432 [2024-11-28 04:34:08.696490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.432 [2024-11-28 04:34:08.696506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.432 [2024-11-28 04:34:08.698730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.432 [2024-11-28 04:34:08.708190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.432 [2024-11-28 04:34:08.708500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.708667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.708696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.432 [2024-11-28 04:34:08.708714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.432 [2024-11-28 04:34:08.708884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.432 [2024-11-28 04:34:08.709054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.432 [2024-11-28 04:34:08.709078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.432 [2024-11-28 04:34:08.709093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.432 [2024-11-28 04:34:08.711298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.432 [2024-11-28 04:34:08.720619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.432 [2024-11-28 04:34:08.721037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.721241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.721271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.432 [2024-11-28 04:34:08.721288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.432 [2024-11-28 04:34:08.721452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.432 [2024-11-28 04:34:08.721632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.432 [2024-11-28 04:34:08.721657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.432 [2024-11-28 04:34:08.721673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.432 [2024-11-28 04:34:08.724083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.432 [2024-11-28 04:34:08.733212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.432 [2024-11-28 04:34:08.733583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.733756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.432 [2024-11-28 04:34:08.733785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.432 [2024-11-28 04:34:08.733803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.432 [2024-11-28 04:34:08.733961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.432 [2024-11-28 04:34:08.734076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.432 [2024-11-28 04:34:08.734100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.432 [2024-11-28 04:34:08.734116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.432 [2024-11-28 04:34:08.736443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.696 [2024-11-28 04:34:08.745963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.696 [2024-11-28 04:34:08.746296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.696 [2024-11-28 04:34:08.746452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.696 [2024-11-28 04:34:08.746481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.696 [2024-11-28 04:34:08.746499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.696 [2024-11-28 04:34:08.746675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.696 [2024-11-28 04:34:08.746888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.696 [2024-11-28 04:34:08.746912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.696 [2024-11-28 04:34:08.746927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.696 [2024-11-28 04:34:08.749116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.696 [2024-11-28 04:34:08.758541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.696 [2024-11-28 04:34:08.758891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.696 [2024-11-28 04:34:08.759036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.696 [2024-11-28 04:34:08.759065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.696 [2024-11-28 04:34:08.759082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.696 [2024-11-28 04:34:08.759283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.696 [2024-11-28 04:34:08.759434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.696 [2024-11-28 04:34:08.759458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.696 [2024-11-28 04:34:08.759474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.696 [2024-11-28 04:34:08.761634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.771042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.697 [2024-11-28 04:34:08.771388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.771540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.771584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.697 [2024-11-28 04:34:08.771601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.697 [2024-11-28 04:34:08.771765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.697 [2024-11-28 04:34:08.771932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.697 [2024-11-28 04:34:08.771955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.697 [2024-11-28 04:34:08.771971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.697 [2024-11-28 04:34:08.774324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.783698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.697 [2024-11-28 04:34:08.784111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.784250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.784277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.697 [2024-11-28 04:34:08.784294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.697 [2024-11-28 04:34:08.784459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.697 [2024-11-28 04:34:08.784622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.697 [2024-11-28 04:34:08.784653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.697 [2024-11-28 04:34:08.784670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.697 [2024-11-28 04:34:08.787001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.796268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.697 [2024-11-28 04:34:08.796612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.796785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.796814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.697 [2024-11-28 04:34:08.796831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.697 [2024-11-28 04:34:08.797014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.697 [2024-11-28 04:34:08.797183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.697 [2024-11-28 04:34:08.797207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.697 [2024-11-28 04:34:08.797223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.697 [2024-11-28 04:34:08.799503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.808795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.697 [2024-11-28 04:34:08.809144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.809275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.809301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.697 [2024-11-28 04:34:08.809317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.697 [2024-11-28 04:34:08.809489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.697 [2024-11-28 04:34:08.809659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.697 [2024-11-28 04:34:08.809684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.697 [2024-11-28 04:34:08.809700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.697 [2024-11-28 04:34:08.812019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.821295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.697 [2024-11-28 04:34:08.821641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.821786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.821815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.697 [2024-11-28 04:34:08.821833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.697 [2024-11-28 04:34:08.821962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.697 [2024-11-28 04:34:08.822167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.697 [2024-11-28 04:34:08.822191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.697 [2024-11-28 04:34:08.822212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.697 [2024-11-28 04:34:08.824423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.833960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.697 [2024-11-28 04:34:08.834248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.834418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.834446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.697 [2024-11-28 04:34:08.834463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.697 [2024-11-28 04:34:08.834586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.697 [2024-11-28 04:34:08.834755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.697 [2024-11-28 04:34:08.834779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.697 [2024-11-28 04:34:08.834794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.697 [2024-11-28 04:34:08.837200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.846651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.697 [2024-11-28 04:34:08.846969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.847110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.697 [2024-11-28 04:34:08.847137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.697 [2024-11-28 04:34:08.847154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.697 [2024-11-28 04:34:08.847355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.697 [2024-11-28 04:34:08.847536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.697 [2024-11-28 04:34:08.847561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.697 [2024-11-28 04:34:08.847577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.697 [2024-11-28 04:34:08.850090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.697 [2024-11-28 04:34:08.859262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.698 [2024-11-28 04:34:08.859557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.859687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.859715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.698 [2024-11-28 04:34:08.859731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.698 [2024-11-28 04:34:08.859878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.698 [2024-11-28 04:34:08.860012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.698 [2024-11-28 04:34:08.860036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.698 [2024-11-28 04:34:08.860052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.698 [2024-11-28 04:34:08.862212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.698 [2024-11-28 04:34:08.871710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.698 [2024-11-28 04:34:08.872102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.872251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.872280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.698 [2024-11-28 04:34:08.872298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.698 [2024-11-28 04:34:08.872480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.698 [2024-11-28 04:34:08.872678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.698 [2024-11-28 04:34:08.872704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.698 [2024-11-28 04:34:08.872720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.698 [2024-11-28 04:34:08.875002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.698 [2024-11-28 04:34:08.884325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.698 [2024-11-28 04:34:08.884677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.884820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.884849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.698 [2024-11-28 04:34:08.884866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.698 [2024-11-28 04:34:08.885013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.698 [2024-11-28 04:34:08.885200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.698 [2024-11-28 04:34:08.885224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.698 [2024-11-28 04:34:08.885240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.698 [2024-11-28 04:34:08.887468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.698 [2024-11-28 04:34:08.896867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.698 [2024-11-28 04:34:08.897227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.897358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.897384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.698 [2024-11-28 04:34:08.897399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.698 [2024-11-28 04:34:08.897594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.698 [2024-11-28 04:34:08.897748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.698 [2024-11-28 04:34:08.897771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.698 [2024-11-28 04:34:08.897787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.698 [2024-11-28 04:34:08.900069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.698 [2024-11-28 04:34:08.909424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.698 [2024-11-28 04:34:08.909749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.909900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.909927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.698 [2024-11-28 04:34:08.909945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.698 [2024-11-28 04:34:08.910055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.698 [2024-11-28 04:34:08.910261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.698 [2024-11-28 04:34:08.910285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.698 [2024-11-28 04:34:08.910301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.698 [2024-11-28 04:34:08.912810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.698 [2024-11-28 04:34:08.922070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.698 [2024-11-28 04:34:08.922410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.922553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.922583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.698 [2024-11-28 04:34:08.922600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.698 [2024-11-28 04:34:08.922765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.698 [2024-11-28 04:34:08.922898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.698 [2024-11-28 04:34:08.922922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.698 [2024-11-28 04:34:08.922937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.698 [2024-11-28 04:34:08.925127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.698 [2024-11-28 04:34:08.934783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.698 [2024-11-28 04:34:08.935228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.935429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.698 [2024-11-28 04:34:08.935455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.698 [2024-11-28 04:34:08.935470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.698 [2024-11-28 04:34:08.935655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.698 [2024-11-28 04:34:08.935817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.698 [2024-11-28 04:34:08.935840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.698 [2024-11-28 04:34:08.935856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.698 [2024-11-28 04:34:08.938314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.699 [2024-11-28 04:34:08.947220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.699 [2024-11-28 04:34:08.947567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.947718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.947748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.699 [2024-11-28 04:34:08.947765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.699 [2024-11-28 04:34:08.947929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.699 [2024-11-28 04:34:08.948081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.699 [2024-11-28 04:34:08.948105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.699 [2024-11-28 04:34:08.948120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.699 [2024-11-28 04:34:08.950587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.699 [2024-11-28 04:34:08.959831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.699 [2024-11-28 04:34:08.960196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.960339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.960383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.699 [2024-11-28 04:34:08.960401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.699 [2024-11-28 04:34:08.960557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.699 [2024-11-28 04:34:08.960747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.699 [2024-11-28 04:34:08.960771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.699 [2024-11-28 04:34:08.960786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.699 [2024-11-28 04:34:08.963041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.699 [2024-11-28 04:34:08.972435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.699 [2024-11-28 04:34:08.972807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.972964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.972990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.699 [2024-11-28 04:34:08.973005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.699 [2024-11-28 04:34:08.973168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.699 [2024-11-28 04:34:08.973330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.699 [2024-11-28 04:34:08.973354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.699 [2024-11-28 04:34:08.973370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.699 [2024-11-28 04:34:08.975889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.699 [2024-11-28 04:34:08.984896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.699 [2024-11-28 04:34:08.985229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.985408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.985434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.699 [2024-11-28 04:34:08.985450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.699 [2024-11-28 04:34:08.985656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.699 [2024-11-28 04:34:08.985827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.699 [2024-11-28 04:34:08.985851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.699 [2024-11-28 04:34:08.985866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.699 [2024-11-28 04:34:08.988434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:31.699 [2024-11-28 04:34:08.997538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:31.699 [2024-11-28 04:34:08.997850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.998006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:31.699 [2024-11-28 04:34:08.998032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:31.699 [2024-11-28 04:34:08.998047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:31.699 [2024-11-28 04:34:08.998179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:31.699 [2024-11-28 04:34:08.998355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:31.699 [2024-11-28 04:34:08.998378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:31.699 [2024-11-28 04:34:08.998394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:31.699 [2024-11-28 04:34:09.000794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.009885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.010341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.010575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.010612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.010640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.010862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.011087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.011122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.011150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.014304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.022460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.022897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.023132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.023192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.023233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.023434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.023651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.023686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.023713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.027138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.035122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.035469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.035623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.035654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.035672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.035856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.036044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.036068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.036084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.038345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.047552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.047890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.048072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.048102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.048120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.048303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.048490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.048514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.048541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.050766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.060200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.060537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.060700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.060741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.060759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.060931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.061100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.061125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.061140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.063611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.072797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.073100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.073214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.073240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.073255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.073456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.073654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.073678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.073694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.076006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.085540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.085924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.086059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.086101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.086119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.086319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.086470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.086495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.086510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.088916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.098325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.098614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.098738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.098766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.098783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.098895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.099075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.099100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.022 [2024-11-28 04:34:09.099116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.022 [2024-11-28 04:34:09.101338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.022 [2024-11-28 04:34:09.110819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.022 [2024-11-28 04:34:09.111160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.111345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.022 [2024-11-28 04:34:09.111374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.022 [2024-11-28 04:34:09.111392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.022 [2024-11-28 04:34:09.111521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.022 [2024-11-28 04:34:09.111726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.022 [2024-11-28 04:34:09.111750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.111765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.114132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.123306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.123612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.123763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.123792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.123810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.124011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.124182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.124206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.124221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.126564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.136028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.136369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.136540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.136567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.136583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.136725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.136912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.136942] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.136958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.139275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.148733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.149081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.149204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.149232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.149250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.149415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.149615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.149640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.149656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.151935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.161356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.161605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.161780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.161806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.161822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.161965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.162149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.162173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.162188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.164378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.173958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.174283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.174430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.174458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.174475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.174652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.174805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.174828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.174850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.177255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.186245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.186547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.186732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.186760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.186777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.186960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.187148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.187172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.187188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.189656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.198681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.198971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.199115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.199143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.199161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.199325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.199476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.199500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.199516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.201841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.211098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.211428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.211550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.211579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.211596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.211762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.211932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.211956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.211972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.214516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.223745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.224172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.224354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.023 [2024-11-28 04:34:09.224384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.023 [2024-11-28 04:34:09.224401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.023 [2024-11-28 04:34:09.224561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.023 [2024-11-28 04:34:09.224713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.023 [2024-11-28 04:34:09.224738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.023 [2024-11-28 04:34:09.224753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.023 [2024-11-28 04:34:09.227159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.023 [2024-11-28 04:34:09.236255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.023 [2024-11-28 04:34:09.236574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.236752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.236778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.236794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.236924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.237070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.237094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.237110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.239478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.024 [2024-11-28 04:34:09.248808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.024 [2024-11-28 04:34:09.249128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.249253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.249282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.249299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.249446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.249629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.249654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.249669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.252000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.024 [2024-11-28 04:34:09.261414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.024 [2024-11-28 04:34:09.261763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.261929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.261956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.261971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.262151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.262303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.262326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.262342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.264496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.024 [2024-11-28 04:34:09.274116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.024 [2024-11-28 04:34:09.274562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.274683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.274712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.274730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.274912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.275064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.275088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.275104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.277363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.024 [2024-11-28 04:34:09.286820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.024 [2024-11-28 04:34:09.287157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.287308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.287333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.287349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.287538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.287709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.287733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.287748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.290170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.024 [2024-11-28 04:34:09.299375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.024 [2024-11-28 04:34:09.299670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.299905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.299955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.299973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.300155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.300379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.300403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.300418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.302742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.024 [2024-11-28 04:34:09.312805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.024 [2024-11-28 04:34:09.313187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.313354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.313394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.313424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.313736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.313990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.314024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.314052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.316591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.024 [2024-11-28 04:34:09.325268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.024 [2024-11-28 04:34:09.325643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.325758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.024 [2024-11-28 04:34:09.325788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.024 [2024-11-28 04:34:09.325807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.024 [2024-11-28 04:34:09.325991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.024 [2024-11-28 04:34:09.326178] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.024 [2024-11-28 04:34:09.326202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.024 [2024-11-28 04:34:09.326218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.024 [2024-11-28 04:34:09.328534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.337966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.338413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.338593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.338623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.285 [2024-11-28 04:34:09.338640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.285 [2024-11-28 04:34:09.338787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.285 [2024-11-28 04:34:09.338938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.285 [2024-11-28 04:34:09.338963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.285 [2024-11-28 04:34:09.338979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.285 [2024-11-28 04:34:09.341220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.350392] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.350650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.350771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.350799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.285 [2024-11-28 04:34:09.350817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.285 [2024-11-28 04:34:09.351018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.285 [2024-11-28 04:34:09.351151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.285 [2024-11-28 04:34:09.351174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.285 [2024-11-28 04:34:09.351190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.285 [2024-11-28 04:34:09.353506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.363198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.363541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.363686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.363715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.285 [2024-11-28 04:34:09.363733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.285 [2024-11-28 04:34:09.363916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.285 [2024-11-28 04:34:09.364066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.285 [2024-11-28 04:34:09.364090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.285 [2024-11-28 04:34:09.364106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.285 [2024-11-28 04:34:09.366441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.375493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.375786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.375954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.375982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.285 [2024-11-28 04:34:09.376004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.285 [2024-11-28 04:34:09.376134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.285 [2024-11-28 04:34:09.376322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.285 [2024-11-28 04:34:09.376345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.285 [2024-11-28 04:34:09.376361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.285 [2024-11-28 04:34:09.378722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.387967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.388303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.388488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.388514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.285 [2024-11-28 04:34:09.388539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.285 [2024-11-28 04:34:09.388706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.285 [2024-11-28 04:34:09.388868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.285 [2024-11-28 04:34:09.388892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.285 [2024-11-28 04:34:09.388908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.285 [2024-11-28 04:34:09.391149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.400520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.400843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.401046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.401104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.285 [2024-11-28 04:34:09.401121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.285 [2024-11-28 04:34:09.401287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.285 [2024-11-28 04:34:09.401456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.285 [2024-11-28 04:34:09.401480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.285 [2024-11-28 04:34:09.401495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.285 [2024-11-28 04:34:09.403873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.413013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.413373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.413547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.413577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.285 [2024-11-28 04:34:09.413594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.285 [2024-11-28 04:34:09.413765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.285 [2024-11-28 04:34:09.413970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.285 [2024-11-28 04:34:09.413994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.285 [2024-11-28 04:34:09.414010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.285 [2024-11-28 04:34:09.416344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.285 [2024-11-28 04:34:09.425640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.285 [2024-11-28 04:34:09.426017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.426151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.285 [2024-11-28 04:34:09.426178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.426194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.426336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.426470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.426493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.426508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.428960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.438303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.438613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.438881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.438907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.438923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.439085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.439267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.439291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.439306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.441576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.450797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.451094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.451250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.451279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.451296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.451504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.451685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.451710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.451726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.453896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.463435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.463785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.463959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.463988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.464006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.464224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.464376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.464399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.464415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.466777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.476069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.476373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.476517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.476555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.476572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.476756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.476890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.476914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.476929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.479207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.488670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.489023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.489165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.489206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.489221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.489399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.489587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.489611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.489627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.491944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.501373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.501710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.501814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.501839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.501854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.501986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.502174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.502197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.502214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.504455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.513964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.514280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.514416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.514442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.514457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.514649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.514783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.514806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.514822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.517173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.526419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.526792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.526946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.526975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.527018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.527195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.527420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.286 [2024-11-28 04:34:09.527454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.286 [2024-11-28 04:34:09.527489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.286 [2024-11-28 04:34:09.530361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.286 [2024-11-28 04:34:09.538768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.286 [2024-11-28 04:34:09.539139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.539283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.286 [2024-11-28 04:34:09.539309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.286 [2024-11-28 04:34:09.539325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.286 [2024-11-28 04:34:09.539503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.286 [2024-11-28 04:34:09.539725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.287 [2024-11-28 04:34:09.539750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.287 [2024-11-28 04:34:09.539766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.287 [2024-11-28 04:34:09.542132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.287 [2024-11-28 04:34:09.551555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.287 [2024-11-28 04:34:09.551916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.552125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.552169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.287 [2024-11-28 04:34:09.552186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.287 [2024-11-28 04:34:09.552350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.287 [2024-11-28 04:34:09.552519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.287 [2024-11-28 04:34:09.552555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.287 [2024-11-28 04:34:09.552571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.287 [2024-11-28 04:34:09.554776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.287 [2024-11-28 04:34:09.564435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.287 [2024-11-28 04:34:09.564766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.565025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.565079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.287 [2024-11-28 04:34:09.565097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.287 [2024-11-28 04:34:09.565261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.287 [2024-11-28 04:34:09.565430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.287 [2024-11-28 04:34:09.565454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.287 [2024-11-28 04:34:09.565477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.287 [2024-11-28 04:34:09.567948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.287 [2024-11-28 04:34:09.576820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.287 [2024-11-28 04:34:09.577174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.577319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.577348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.287 [2024-11-28 04:34:09.577365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.287 [2024-11-28 04:34:09.577541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.287 [2024-11-28 04:34:09.577676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.287 [2024-11-28 04:34:09.577700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.287 [2024-11-28 04:34:09.577715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.287 [2024-11-28 04:34:09.579944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.287 [2024-11-28 04:34:09.589648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.287 [2024-11-28 04:34:09.590085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.590278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.287 [2024-11-28 04:34:09.590307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.287 [2024-11-28 04:34:09.590324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.287 [2024-11-28 04:34:09.590472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.287 [2024-11-28 04:34:09.590666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.287 [2024-11-28 04:34:09.590689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.287 [2024-11-28 04:34:09.590703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.547 [2024-11-28 04:34:09.593089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.547 [2024-11-28 04:34:09.602206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.547 [2024-11-28 04:34:09.602601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.547 [2024-11-28 04:34:09.602732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.547 [2024-11-28 04:34:09.602760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.547 [2024-11-28 04:34:09.602778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.547 [2024-11-28 04:34:09.602925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.547 [2024-11-28 04:34:09.603113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.547 [2024-11-28 04:34:09.603138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.547 [2024-11-28 04:34:09.603154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.547 [2024-11-28 04:34:09.605360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.547 [2024-11-28 04:34:09.614855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.547 [2024-11-28 04:34:09.615221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.547 [2024-11-28 04:34:09.615366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.547 [2024-11-28 04:34:09.615395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.547 [2024-11-28 04:34:09.615412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.547 [2024-11-28 04:34:09.615588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.547 [2024-11-28 04:34:09.615758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.547 [2024-11-28 04:34:09.615782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.547 [2024-11-28 04:34:09.615798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.547 [2024-11-28 04:34:09.618005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.547 [2024-11-28 04:34:09.627428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.547 [2024-11-28 04:34:09.627756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.627971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.628029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.628046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.628211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.628379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.628403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.628419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.630817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.640096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.640395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.640547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.640578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.640596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.640726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.640931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.640954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.640970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.643364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.652867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.653204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.653386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.653411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.653427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.653649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.653777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.653801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.653816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.656094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.665536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.665880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.666069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.666095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.666111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.666243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.666421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.666445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.666460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.668695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.678225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.678556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.678766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.678795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.678813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.678978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.679092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.679116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.679131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.681341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.690916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.691243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.691365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.691394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.691411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.691570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.691740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.691764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.691779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.693947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.703464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.703767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.703911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.703940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.703957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.704122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.704309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.704333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.704349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.706618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.716070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.716392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.716543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.716573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.716590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.716755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.716943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.716967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.716982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.719224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.728443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.728777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.728909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.728935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.728957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.548 [2024-11-28 04:34:09.729089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.548 [2024-11-28 04:34:09.729289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.548 [2024-11-28 04:34:09.729313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.548 [2024-11-28 04:34:09.729329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.548 [2024-11-28 04:34:09.731558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.548 [2024-11-28 04:34:09.741105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.548 [2024-11-28 04:34:09.741405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.741517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.548 [2024-11-28 04:34:09.741555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.548 [2024-11-28 04:34:09.741573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.741702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.741853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.741876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.741891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.744274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.753830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.754196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.754341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.754370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.754387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.754497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.754714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.754739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.754754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.757248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.766625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.766921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.767066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.767094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.767117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.767283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.767434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.767458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.767473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.769759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.779109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.779437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.779616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.779644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.779659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.779824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.780016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.780040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.780056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.782384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.791813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.792174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.792376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.792402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.792417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.792590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.792781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.792805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.792821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.795134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.804255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.804606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.804783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.804812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.804829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.805035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.805168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.805192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.805207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.807585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.816880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.817160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.817308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.817337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.817356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.817549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.817729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.817753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.817770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.820155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.829570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.829871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.830024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.830052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.830069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.830233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.830403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.830426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.830443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.832676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.842293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.842631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.842915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.842944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.842961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.843145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.843320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.843344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.549 [2024-11-28 04:34:09.843360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.549 [2024-11-28 04:34:09.845719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.549 [2024-11-28 04:34:09.854724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.549 [2024-11-28 04:34:09.855049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.855193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.549 [2024-11-28 04:34:09.855220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.549 [2024-11-28 04:34:09.855237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.549 [2024-11-28 04:34:09.855420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.549 [2024-11-28 04:34:09.855618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.549 [2024-11-28 04:34:09.855643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.550 [2024-11-28 04:34:09.855659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.810 [2024-11-28 04:34:09.858004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.810 [2024-11-28 04:34:09.867345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.810 [2024-11-28 04:34:09.867692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.867864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.867892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.810 [2024-11-28 04:34:09.867909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.810 [2024-11-28 04:34:09.868039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.810 [2024-11-28 04:34:09.868190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.810 [2024-11-28 04:34:09.868213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.810 [2024-11-28 04:34:09.868229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.810 [2024-11-28 04:34:09.870532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.810 [2024-11-28 04:34:09.880132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.810 [2024-11-28 04:34:09.880498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.880627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.880658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.810 [2024-11-28 04:34:09.880676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.810 [2024-11-28 04:34:09.880877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.810 [2024-11-28 04:34:09.881083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.810 [2024-11-28 04:34:09.881112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.810 [2024-11-28 04:34:09.881129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.810 [2024-11-28 04:34:09.883484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.810 [2024-11-28 04:34:09.892862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.810 [2024-11-28 04:34:09.893225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.893344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.893387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.810 [2024-11-28 04:34:09.893403] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.810 [2024-11-28 04:34:09.893576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.810 [2024-11-28 04:34:09.893790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.810 [2024-11-28 04:34:09.893815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.810 [2024-11-28 04:34:09.893830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.810 [2024-11-28 04:34:09.896235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.810 [2024-11-28 04:34:09.905402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.810 [2024-11-28 04:34:09.905785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.905967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.906015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.810 [2024-11-28 04:34:09.906033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.810 [2024-11-28 04:34:09.906197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.810 [2024-11-28 04:34:09.906384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.810 [2024-11-28 04:34:09.906408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.810 [2024-11-28 04:34:09.906424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.810 [2024-11-28 04:34:09.908785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.810 [2024-11-28 04:34:09.918236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.810 [2024-11-28 04:34:09.918530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.918694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.810 [2024-11-28 04:34:09.918719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.810 [2024-11-28 04:34:09.918735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.810 [2024-11-28 04:34:09.918931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.810 [2024-11-28 04:34:09.919118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.810 [2024-11-28 04:34:09.919142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.810 [2024-11-28 04:34:09.919163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:09.921442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:09.930731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:09.931110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.931265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.931294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:09.931311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:09.931540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:09.931747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:09.931770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:09.931786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:09.934079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:09.943347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:09.943729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.943891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.943921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:09.943938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:09.944158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:09.944326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:09.944350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:09.944366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:09.946691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:09.955995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:09.956289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.956474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.956500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:09.956516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:09.956706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:09.956941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:09.956965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:09.956982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:09.959512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:09.968508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:09.968855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.969025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.969050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:09.969066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:09.969163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:09.969364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:09.969387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:09.969403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:09.971849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:09.981176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:09.981530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.981673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.981702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:09.981719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:09.981885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:09.982036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:09.982059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:09.982074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:09.984572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:09.993540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:09.993866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.994035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:09.994064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:09.994081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:09.994264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:09.994468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:09.994493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:09.994508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:09.996813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:10.006050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:10.006378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:10.006563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:10.006592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:10.006608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:10.006758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:10.006976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:10.007008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:10.007035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:10.009801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:10.018722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:10.019137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:10.019277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:10.019307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:10.019325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:10.019492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:10.019702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:10.019725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:10.019740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:10.022074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:10.031423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:10.031757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:10.031976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:10.032034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.811 [2024-11-28 04:34:10.032052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.811 [2024-11-28 04:34:10.032218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.811 [2024-11-28 04:34:10.032460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.811 [2024-11-28 04:34:10.032485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.811 [2024-11-28 04:34:10.032501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.811 [2024-11-28 04:34:10.034937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.811 [2024-11-28 04:34:10.044130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.811 [2024-11-28 04:34:10.044461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.811 [2024-11-28 04:34:10.044625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.044653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.812 [2024-11-28 04:34:10.044669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.812 [2024-11-28 04:34:10.044834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.812 [2024-11-28 04:34:10.045028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.812 [2024-11-28 04:34:10.045049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.812 [2024-11-28 04:34:10.045062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.812 [2024-11-28 04:34:10.047370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.812 [2024-11-28 04:34:10.056755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.812 [2024-11-28 04:34:10.057057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.057205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.057231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.812 [2024-11-28 04:34:10.057248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.812 [2024-11-28 04:34:10.057397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.812 [2024-11-28 04:34:10.057602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.812 [2024-11-28 04:34:10.057626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.812 [2024-11-28 04:34:10.057640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.812 [2024-11-28 04:34:10.060049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.812 [2024-11-28 04:34:10.069391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.812 [2024-11-28 04:34:10.069712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.069858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.069885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.812 [2024-11-28 04:34:10.069901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.812 [2024-11-28 04:34:10.070066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.812 [2024-11-28 04:34:10.070230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.812 [2024-11-28 04:34:10.070250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.812 [2024-11-28 04:34:10.070263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.812 [2024-11-28 04:34:10.072438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.812 [2024-11-28 04:34:10.082089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.812 [2024-11-28 04:34:10.082386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.082539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.082572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.812 [2024-11-28 04:34:10.082589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.812 [2024-11-28 04:34:10.082721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.812 [2024-11-28 04:34:10.082940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.812 [2024-11-28 04:34:10.082958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.812 [2024-11-28 04:34:10.082971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.812 [2024-11-28 04:34:10.084887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.812 [2024-11-28 04:34:10.094746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.812 [2024-11-28 04:34:10.095088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.095201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.095226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.812 [2024-11-28 04:34:10.095242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.812 [2024-11-28 04:34:10.095389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.812 [2024-11-28 04:34:10.095558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.812 [2024-11-28 04:34:10.095577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.812 [2024-11-28 04:34:10.095604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.812 [2024-11-28 04:34:10.097877] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:32.812 [2024-11-28 04:34:10.107231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:32.812 [2024-11-28 04:34:10.107554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.107679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:32.812 [2024-11-28 04:34:10.107707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:32.812 [2024-11-28 04:34:10.107723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:32.812 [2024-11-28 04:34:10.107937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:32.812 [2024-11-28 04:34:10.108094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:32.812 [2024-11-28 04:34:10.108114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:32.812 [2024-11-28 04:34:10.108127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:32.812 [2024-11-28 04:34:10.110124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.072 [2024-11-28 04:34:10.119768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.072 [2024-11-28 04:34:10.120166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.120341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.120367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.072 [2024-11-28 04:34:10.120388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.072 [2024-11-28 04:34:10.120547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.072 [2024-11-28 04:34:10.120700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.072 [2024-11-28 04:34:10.120722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.072 [2024-11-28 04:34:10.120736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.072 [2024-11-28 04:34:10.123028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.072 [2024-11-28 04:34:10.132564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.072 [2024-11-28 04:34:10.132879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.133036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.133062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.072 [2024-11-28 04:34:10.133078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.072 [2024-11-28 04:34:10.133194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.072 [2024-11-28 04:34:10.133357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.072 [2024-11-28 04:34:10.133376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.072 [2024-11-28 04:34:10.133389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.072 [2024-11-28 04:34:10.135723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.072 [2024-11-28 04:34:10.145129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.072 [2024-11-28 04:34:10.145488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.145624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.145651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.072 [2024-11-28 04:34:10.145666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.072 [2024-11-28 04:34:10.145815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.072 [2024-11-28 04:34:10.146018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.072 [2024-11-28 04:34:10.146037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.072 [2024-11-28 04:34:10.146049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.072 [2024-11-28 04:34:10.148101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.072 [2024-11-28 04:34:10.157513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.072 [2024-11-28 04:34:10.157893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.158026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.158052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.072 [2024-11-28 04:34:10.158068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.072 [2024-11-28 04:34:10.158221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.072 [2024-11-28 04:34:10.158378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.072 [2024-11-28 04:34:10.158398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.072 [2024-11-28 04:34:10.158410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.072 [2024-11-28 04:34:10.160770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.072 [2024-11-28 04:34:10.169827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.072 [2024-11-28 04:34:10.170179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.170348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.170374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.072 [2024-11-28 04:34:10.170390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.072 [2024-11-28 04:34:10.170550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.072 [2024-11-28 04:34:10.170739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.072 [2024-11-28 04:34:10.170759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.072 [2024-11-28 04:34:10.170772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.072 [2024-11-28 04:34:10.173119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.072 [2024-11-28 04:34:10.182324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.072 [2024-11-28 04:34:10.182695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.182855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.072 [2024-11-28 04:34:10.182881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.072 [2024-11-28 04:34:10.182897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.072 [2024-11-28 04:34:10.183078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.072 [2024-11-28 04:34:10.183245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.072 [2024-11-28 04:34:10.183264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.072 [2024-11-28 04:34:10.183276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.185588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.194881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.195251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.195418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.195443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.195458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.195616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.195805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.195841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.195854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.198147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.207540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.207960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.208119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.208146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.208161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.208278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.208450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.208469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.208481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.210889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.220139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.220459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.220651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.220677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.220693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.220874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.221086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.221106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.221119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.223250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.232625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.232954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.233113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.233139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.233155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.233300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.233484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.233507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.233520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.235813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.245096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.245418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.245606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.245633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.245649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.245765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.245960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.245979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.245992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.248248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.257602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.258006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.258201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.258228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.258243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.258392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.258600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.258637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.258660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.261044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.270042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.270370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.270536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.270564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.270579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.270711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.270917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.270937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.270956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.273228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.282684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.283016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.283155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.283182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.283198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.283338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.283490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.283509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.283522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.286043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.294944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.295341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.295506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.295540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.073 [2024-11-28 04:34:10.295558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.073 [2024-11-28 04:34:10.295707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.073 [2024-11-28 04:34:10.295870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.073 [2024-11-28 04:34:10.295889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.073 [2024-11-28 04:34:10.295901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.073 [2024-11-28 04:34:10.298217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.073 [2024-11-28 04:34:10.307587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.073 [2024-11-28 04:34:10.307909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.073 [2024-11-28 04:34:10.308016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.308042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.074 [2024-11-28 04:34:10.308057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.074 [2024-11-28 04:34:10.308204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.074 [2024-11-28 04:34:10.308390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.074 [2024-11-28 04:34:10.308410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.074 [2024-11-28 04:34:10.308423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.074 [2024-11-28 04:34:10.310840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.074 [2024-11-28 04:34:10.320086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.074 [2024-11-28 04:34:10.320403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.320575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.320602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.074 [2024-11-28 04:34:10.320618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.074 [2024-11-28 04:34:10.320814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.074 [2024-11-28 04:34:10.320981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.074 [2024-11-28 04:34:10.321000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.074 [2024-11-28 04:34:10.321012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.074 [2024-11-28 04:34:10.323188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.074 [2024-11-28 04:34:10.332685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.074 [2024-11-28 04:34:10.333053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.333215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.333241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.074 [2024-11-28 04:34:10.333257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.074 [2024-11-28 04:34:10.333405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.074 [2024-11-28 04:34:10.333590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.074 [2024-11-28 04:34:10.333612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.074 [2024-11-28 04:34:10.333626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.074 [2024-11-28 04:34:10.335874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.074 [2024-11-28 04:34:10.345285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.074 [2024-11-28 04:34:10.345642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.345752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.345778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.074 [2024-11-28 04:34:10.345794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.074 [2024-11-28 04:34:10.345941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.074 [2024-11-28 04:34:10.346113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.074 [2024-11-28 04:34:10.346147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.074 [2024-11-28 04:34:10.346160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.074 [2024-11-28 04:34:10.348376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.074 [2024-11-28 04:34:10.357763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.074 [2024-11-28 04:34:10.358120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.358260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.358286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.074 [2024-11-28 04:34:10.358302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.074 [2024-11-28 04:34:10.358450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.074 [2024-11-28 04:34:10.358611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.074 [2024-11-28 04:34:10.358633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.074 [2024-11-28 04:34:10.358647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.074 [2024-11-28 04:34:10.360733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.074 [2024-11-28 04:34:10.370369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.074 [2024-11-28 04:34:10.370703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.370837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.074 [2024-11-28 04:34:10.370862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.074 [2024-11-28 04:34:10.370878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.074 [2024-11-28 04:34:10.371010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.074 [2024-11-28 04:34:10.371216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.074 [2024-11-28 04:34:10.371236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.074 [2024-11-28 04:34:10.371248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.074 [2024-11-28 04:34:10.373542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.334 [2024-11-28 04:34:10.382824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.334 [2024-11-28 04:34:10.383163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.383333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.383358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.334 [2024-11-28 04:34:10.383373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.334 [2024-11-28 04:34:10.383521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.334 [2024-11-28 04:34:10.383695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.334 [2024-11-28 04:34:10.383715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.334 [2024-11-28 04:34:10.383728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.334 [2024-11-28 04:34:10.386040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.334 [2024-11-28 04:34:10.395354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.334 [2024-11-28 04:34:10.395721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.395891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.395917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.334 [2024-11-28 04:34:10.395933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.334 [2024-11-28 04:34:10.396065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.334 [2024-11-28 04:34:10.396257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.334 [2024-11-28 04:34:10.396276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.334 [2024-11-28 04:34:10.396289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.334 [2024-11-28 04:34:10.398654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.334 [2024-11-28 04:34:10.408016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.334 [2024-11-28 04:34:10.408395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.408541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.408568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.334 [2024-11-28 04:34:10.408584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.334 [2024-11-28 04:34:10.408700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.334 [2024-11-28 04:34:10.408833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.334 [2024-11-28 04:34:10.408852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.334 [2024-11-28 04:34:10.408866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.334 [2024-11-28 04:34:10.411072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.334 [2024-11-28 04:34:10.420504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.334 [2024-11-28 04:34:10.420958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.421111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.421136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.334 [2024-11-28 04:34:10.421152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.334 [2024-11-28 04:34:10.421298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.334 [2024-11-28 04:34:10.421470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.334 [2024-11-28 04:34:10.421489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.334 [2024-11-28 04:34:10.421502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.334 [2024-11-28 04:34:10.423896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.334 [2024-11-28 04:34:10.432898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.334 [2024-11-28 04:34:10.433255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.433389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.334 [2024-11-28 04:34:10.433419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.334 [2024-11-28 04:34:10.433436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.334 [2024-11-28 04:34:10.433575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.334 [2024-11-28 04:34:10.433779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.334 [2024-11-28 04:34:10.433799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.334 [2024-11-28 04:34:10.433813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.334 [2024-11-28 04:34:10.436196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.334 [2024-11-28 04:34:10.445401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.445709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.445830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.445855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.445871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.446003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.446206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.446225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.446238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.448673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.458019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.458340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.458476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.458502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.458518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.458652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.458804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.458839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.458853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.461201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.470756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.471088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.471252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.471278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.471299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.471432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.471622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.471644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.471658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.473919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.483293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.483727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.483857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.483883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.483899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.484032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.484178] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.484196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.484209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.486482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.496005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.496379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.496562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.496597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.496618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.496838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.496988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.497007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.497019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.499227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.508469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.508783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.508970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.508995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.509011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.509189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.509361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.509381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.509394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.511866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.520862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.521199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.521337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.521363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.521379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.521509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.521648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.521669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.521682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.524170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.533523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.533871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.534013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.534039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.534054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.534203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.534374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.534393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.534405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.536548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.545931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.546269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.546454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.546480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.546509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.546698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.546897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.546917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.546929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.549184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.558661] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.558955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.559087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.559113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.559129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.335 [2024-11-28 04:34:10.559323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.335 [2024-11-28 04:34:10.559518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.335 [2024-11-28 04:34:10.559548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.335 [2024-11-28 04:34:10.559562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.335 [2024-11-28 04:34:10.561905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.335 [2024-11-28 04:34:10.571139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.335 [2024-11-28 04:34:10.571481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.571640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.335 [2024-11-28 04:34:10.571667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.335 [2024-11-28 04:34:10.571682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.336 [2024-11-28 04:34:10.571782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.336 [2024-11-28 04:34:10.571976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.336 [2024-11-28 04:34:10.571995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.336 [2024-11-28 04:34:10.572008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.336 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 4014124 Killed "${NVMF_APP[@]}" "$@" 00:27:33.336 [2024-11-28 04:34:10.574283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.336 04:34:10 -- host/bdevperf.sh@36 -- # tgt_init 00:27:33.336 04:34:10 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:33.336 04:34:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:33.336 04:34:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:33.336 04:34:10 -- common/autotest_common.sh@10 -- # set +x 00:27:33.336 04:34:10 -- nvmf/common.sh@469 -- # nvmfpid=4015154 00:27:33.336 04:34:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:33.336 04:34:10 -- nvmf/common.sh@470 -- # waitforlisten 4015154 00:27:33.336 04:34:10 -- common/autotest_common.sh@829 -- # '[' -z 4015154 ']' 00:27:33.336 04:34:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:33.336 04:34:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:33.336 04:34:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:33.336 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:33.336 04:34:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:33.336 04:34:10 -- common/autotest_common.sh@10 -- # set +x 00:27:33.336 [2024-11-28 04:34:10.583840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.336 [2024-11-28 04:34:10.584233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.584401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.584427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.336 [2024-11-28 04:34:10.584443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.336 [2024-11-28 04:34:10.584588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.336 [2024-11-28 04:34:10.584724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.336 [2024-11-28 04:34:10.584746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.336 [2024-11-28 04:34:10.584759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.336 [2024-11-28 04:34:10.587283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.336 [2024-11-28 04:34:10.596321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.336 [2024-11-28 04:34:10.596645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.596750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.596777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.336 [2024-11-28 04:34:10.596793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.336 [2024-11-28 04:34:10.596925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.336 [2024-11-28 04:34:10.597122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.336 [2024-11-28 04:34:10.597143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.336 [2024-11-28 04:34:10.597157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.336 [2024-11-28 04:34:10.599519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.336 [2024-11-28 04:34:10.608629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.336 [2024-11-28 04:34:10.608998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.609136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.609163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.336 [2024-11-28 04:34:10.609179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.336 [2024-11-28 04:34:10.609343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.336 [2024-11-28 04:34:10.609535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.336 [2024-11-28 04:34:10.609558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.336 [2024-11-28 04:34:10.609572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.336 [2024-11-28 04:34:10.611858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.336 [2024-11-28 04:34:10.620897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.336 [2024-11-28 04:34:10.621224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.621359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.621385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.336 [2024-11-28 04:34:10.621401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.336 [2024-11-28 04:34:10.621558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.336 [2024-11-28 04:34:10.621771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.336 [2024-11-28 04:34:10.621793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.336 [2024-11-28 04:34:10.621822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.336 [2024-11-28 04:34:10.623160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:33.336 [2024-11-28 04:34:10.623228] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:33.336 [2024-11-28 04:34:10.623951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.336 [2024-11-28 04:34:10.633037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.336 [2024-11-28 04:34:10.633399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.633535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.336 [2024-11-28 04:34:10.633562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.336 [2024-11-28 04:34:10.633578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.336 [2024-11-28 04:34:10.633727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.336 [2024-11-28 04:34:10.633887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.336 [2024-11-28 04:34:10.633907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.336 [2024-11-28 04:34:10.633919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.336 [2024-11-28 04:34:10.635958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.645461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.645768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.645903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.645929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.645945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.646109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.646261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.646286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.646300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 [2024-11-28 04:34:10.648603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.657689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.658110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.658241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.658267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.658283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.658398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.658602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.658624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.658637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 EAL: No free 2048 kB hugepages reported on node 1 00:27:33.597 [2024-11-28 04:34:10.660820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.670604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.671002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.671162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.671188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.671204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.671353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.671539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.671561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.671575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 [2024-11-28 04:34:10.674092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.683133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.683488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.683653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.683680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.683695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.683843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.684035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.684054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.684072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 [2024-11-28 04:34:10.686147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.694603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:33.597 [2024-11-28 04:34:10.695596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.695917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.696027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.696052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.696067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.696276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.696403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.696423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.696437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 [2024-11-28 04:34:10.698667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.708268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.708788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.708946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.708974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.708993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.709166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.709371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.709392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.709409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 [2024-11-28 04:34:10.711601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.720552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.720907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.721127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.721154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.721170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.721334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.721507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.721560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.721585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 [2024-11-28 04:34:10.723878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.733203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.733537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.733704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.733731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.597 [2024-11-28 04:34:10.733747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.597 [2024-11-28 04:34:10.733864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.597 [2024-11-28 04:34:10.734062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.597 [2024-11-28 04:34:10.734082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.597 [2024-11-28 04:34:10.734095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.597 [2024-11-28 04:34:10.736451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.597 [2024-11-28 04:34:10.745827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.597 [2024-11-28 04:34:10.746190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.597 [2024-11-28 04:34:10.746330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.746357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.746373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.746564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.746682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.746702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.746716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.748782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.758264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.758770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.758956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.758983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.759001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.759169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.759358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.759378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.759393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.761709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.770882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.771294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.771472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.771499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.771517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.771680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.771893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.771914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.771929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.774225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.783489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.783813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.783952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.783978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.783995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.784178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.784404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.784428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.784444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.786843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.795904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.796271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.796420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.796446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.796462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.796637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.796789] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.796825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.796838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.799216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.808614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.808971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.809151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.809177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.809193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.809325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.809515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.809559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.809574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.810893] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:33.598 [2024-11-28 04:34:10.811004] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:33.598 [2024-11-28 04:34:10.811022] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:33.598 [2024-11-28 04:34:10.811035] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:33.598 [2024-11-28 04:34:10.811147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:33.598 [2024-11-28 04:34:10.811206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:33.598 [2024-11-28 04:34:10.811209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:33.598 [2024-11-28 04:34:10.811705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.821172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.821602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.821766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.821794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.821813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.821987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.822142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.822171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.822188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.824357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.833742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.834204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.834360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.834386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.834406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.834558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.834769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.834791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.834809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.598 [2024-11-28 04:34:10.836955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.598 [2024-11-28 04:34:10.846149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.598 [2024-11-28 04:34:10.846592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.846749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.598 [2024-11-28 04:34:10.846776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.598 [2024-11-28 04:34:10.846796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.598 [2024-11-28 04:34:10.846904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.598 [2024-11-28 04:34:10.847124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.598 [2024-11-28 04:34:10.847146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.598 [2024-11-28 04:34:10.847165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.599 [2024-11-28 04:34:10.849380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.599 [2024-11-28 04:34:10.858578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.599 [2024-11-28 04:34:10.859042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.859170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.859196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.599 [2024-11-28 04:34:10.859215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.599 [2024-11-28 04:34:10.859390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.599 [2024-11-28 04:34:10.859556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.599 [2024-11-28 04:34:10.859579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.599 [2024-11-28 04:34:10.859599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.599 [2024-11-28 04:34:10.861661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.599 [2024-11-28 04:34:10.870781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.599 [2024-11-28 04:34:10.871137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.871256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.871282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.599 [2024-11-28 04:34:10.871301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.599 [2024-11-28 04:34:10.871459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.599 [2024-11-28 04:34:10.871607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.599 [2024-11-28 04:34:10.871642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.599 [2024-11-28 04:34:10.871659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.599 [2024-11-28 04:34:10.873905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.599 [2024-11-28 04:34:10.883077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.599 [2024-11-28 04:34:10.883504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.883694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.883721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.599 [2024-11-28 04:34:10.883741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.599 [2024-11-28 04:34:10.883918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.599 [2024-11-28 04:34:10.884088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.599 [2024-11-28 04:34:10.884110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.599 [2024-11-28 04:34:10.884128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.599 [2024-11-28 04:34:10.886457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.599 [2024-11-28 04:34:10.895555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.599 [2024-11-28 04:34:10.895856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.895972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.599 [2024-11-28 04:34:10.895999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.599 [2024-11-28 04:34:10.896017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.599 [2024-11-28 04:34:10.896154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.599 [2024-11-28 04:34:10.896277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.599 [2024-11-28 04:34:10.896299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.599 [2024-11-28 04:34:10.896315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.599 [2024-11-28 04:34:10.898449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.859 [2024-11-28 04:34:10.907856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.859 [2024-11-28 04:34:10.908138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.908261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.908287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.859 [2024-11-28 04:34:10.908303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.859 [2024-11-28 04:34:10.908435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.859 [2024-11-28 04:34:10.908564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.859 [2024-11-28 04:34:10.908587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.859 [2024-11-28 04:34:10.908609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.859 [2024-11-28 04:34:10.910838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.859 [2024-11-28 04:34:10.920368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.859 [2024-11-28 04:34:10.920613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.920755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.920781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.859 [2024-11-28 04:34:10.920797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.859 [2024-11-28 04:34:10.920978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.859 [2024-11-28 04:34:10.921158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.859 [2024-11-28 04:34:10.921179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.859 [2024-11-28 04:34:10.921192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.859 [2024-11-28 04:34:10.923353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.859 [2024-11-28 04:34:10.932771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.859 [2024-11-28 04:34:10.933079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.933196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.933223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.859 [2024-11-28 04:34:10.933238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.859 [2024-11-28 04:34:10.933386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.859 [2024-11-28 04:34:10.933581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.859 [2024-11-28 04:34:10.933603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.859 [2024-11-28 04:34:10.933618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.859 [2024-11-28 04:34:10.935692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.859 [2024-11-28 04:34:10.945147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.859 [2024-11-28 04:34:10.945458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.945597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.859 [2024-11-28 04:34:10.945623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.859 [2024-11-28 04:34:10.945639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.859 [2024-11-28 04:34:10.945788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:10.945922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:10.945943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:10.945956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:10.948070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:10.957495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:10.957787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.957900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.957926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:10.957941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:10.958074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:10.958210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:10.958231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:10.958245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:10.960496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:10.969813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:10.970130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.970249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.970275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:10.970292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:10.970440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:10.970634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:10.970656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:10.970670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:10.972758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:10.982094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:10.982387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.982505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.982541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:10.982559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:10.982691] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:10.982858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:10.982879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:10.982893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:10.984899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:10.994380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:10.994717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.994856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:10.994881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:10.994896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:10.995060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:10.995209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:10.995230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:10.995244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:10.997298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:11.006728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:11.007090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.007227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.007253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:11.007269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:11.007417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:11.007626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:11.007656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:11.007670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:11.009761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:11.019183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:11.019457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.019615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.019642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:11.019658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:11.019839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:11.020020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:11.020041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:11.020054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:11.022098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:11.031411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:11.031738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.031900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.031926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:11.031942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:11.032090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:11.032240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:11.032261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:11.032275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:11.034340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:11.043787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:11.044140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.044249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.044276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:11.044292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:11.044457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:11.044632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:11.044655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:11.044669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.860 [2024-11-28 04:34:11.046686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.860 [2024-11-28 04:34:11.056080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.860 [2024-11-28 04:34:11.056396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.056509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.860 [2024-11-28 04:34:11.056544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.860 [2024-11-28 04:34:11.056562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.860 [2024-11-28 04:34:11.056728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.860 [2024-11-28 04:34:11.056879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.860 [2024-11-28 04:34:11.056900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.860 [2024-11-28 04:34:11.056914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.059001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.068371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.068618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.068727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.068758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.068775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.068907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.069089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.069109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.069123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.071148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.080739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.081047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.081164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.081191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.081207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.081404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.081563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.081586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.081600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.083553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.092995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.093287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.093443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.093469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.093486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.093611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.093765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.093787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.093816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.095927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.105317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.105627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.105741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.105768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.105789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.105955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.106137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.106158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.106172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.108140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.117762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.118030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.118150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.118175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.118191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.118355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.118475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.118497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.118511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.120550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.130157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.130466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.130581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.130607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.130623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.130788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.130957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.130978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.130993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.133091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.142469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.142726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.142864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.142890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.142905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.143059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.143180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.143217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.143231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.145330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.154774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.155097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.155204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.155230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.155245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.155410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.155588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.155611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.155626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.861 [2024-11-28 04:34:11.157635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.861 [2024-11-28 04:34:11.167173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.861 [2024-11-28 04:34:11.167509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.167657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.861 [2024-11-28 04:34:11.167684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:33.861 [2024-11-28 04:34:11.167699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:33.861 [2024-11-28 04:34:11.167864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:33.861 [2024-11-28 04:34:11.167984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.861 [2024-11-28 04:34:11.168005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.861 [2024-11-28 04:34:11.168020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.121 [2024-11-28 04:34:11.170188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.121 [2024-11-28 04:34:11.179567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.121 [2024-11-28 04:34:11.179819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.121 [2024-11-28 04:34:11.179978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.121 [2024-11-28 04:34:11.180003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.121 [2024-11-28 04:34:11.180018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.121 [2024-11-28 04:34:11.180167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.121 [2024-11-28 04:34:11.180371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.121 [2024-11-28 04:34:11.180392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.121 [2024-11-28 04:34:11.180406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.121 [2024-11-28 04:34:11.182379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.121 [2024-11-28 04:34:11.191888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.121 [2024-11-28 04:34:11.192216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.121 [2024-11-28 04:34:11.192351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.121 [2024-11-28 04:34:11.192376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.121 [2024-11-28 04:34:11.192391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.121 [2024-11-28 04:34:11.192549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.121 [2024-11-28 04:34:11.192710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.192732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.192746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.194940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.204164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.204480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.204591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.204617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.204633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.204765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.204902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.204923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.204937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.206986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.216443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.216762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.216869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.216894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.216909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.217106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.217275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.217301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.217316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.219477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.228764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.229062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.229223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.229248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.229263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.229395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.229557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.229580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.229594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.231806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.240996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.241254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.241388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.241415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.241430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.241605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.241758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.241780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.241794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.243876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.253509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.253757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.253896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.253921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.253936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.254084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.254252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.254273] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.254292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.256556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.265802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.266121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.266260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.266286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.266301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.266465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.266660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.266682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.266696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.268626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.278182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.278440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.278568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.278594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.278610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.278726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.278927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.278948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.278962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.281031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.290301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.290604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.290707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.290732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.290747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.290912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.291063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.291085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.291098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.293296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.302493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.302811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.302918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.122 [2024-11-28 04:34:11.302944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.122 [2024-11-28 04:34:11.302960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.122 [2024-11-28 04:34:11.303174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.122 [2024-11-28 04:34:11.303276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.122 [2024-11-28 04:34:11.303296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.122 [2024-11-28 04:34:11.303310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.122 [2024-11-28 04:34:11.305360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.122 [2024-11-28 04:34:11.314919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.122 [2024-11-28 04:34:11.315260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.315392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.315417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.315433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.315574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.315727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.315749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.315762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.317867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.327283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.327596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.327712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.327739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.327755] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.327888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.327992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.328013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.328027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.330271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.339619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.339917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.340046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.340071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.340086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.340251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.340402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.340423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.340437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.342388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.352037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.352345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.352500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.352534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.352552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.352733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.352898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.352919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.352932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.355026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.364360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.364706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.364819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.364844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.364860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.364976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.365176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.365197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.365210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.367253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.376656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.376971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.377086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.377112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.377127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.377259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.377379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.377400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.377415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.379661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.389015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.389295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.389436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.389461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.389476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.389601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.389770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.389791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.389806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.391903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.401347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.401638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.401768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.401793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.401808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.401972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.402141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.402162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.402176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.404400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.413690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.414012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.414143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.414174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.414191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.123 [2024-11-28 04:34:11.414339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.123 [2024-11-28 04:34:11.414488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.123 [2024-11-28 04:34:11.414533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.123 [2024-11-28 04:34:11.414550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.123 [2024-11-28 04:34:11.416683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.123 [2024-11-28 04:34:11.425999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.123 [2024-11-28 04:34:11.426225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.426357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.123 [2024-11-28 04:34:11.426382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.123 [2024-11-28 04:34:11.426398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.124 [2024-11-28 04:34:11.426556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.124 [2024-11-28 04:34:11.426742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.124 [2024-11-28 04:34:11.426764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.124 [2024-11-28 04:34:11.426778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.124 [2024-11-28 04:34:11.428919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.384 [2024-11-28 04:34:11.438334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.384 [2024-11-28 04:34:11.438618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.384 [2024-11-28 04:34:11.438783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.384 [2024-11-28 04:34:11.438808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.384 [2024-11-28 04:34:11.438823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.384 [2024-11-28 04:34:11.438971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.384 [2024-11-28 04:34:11.439123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.384 [2024-11-28 04:34:11.439144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.384 [2024-11-28 04:34:11.439157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.384 [2024-11-28 04:34:11.441391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.384 [2024-11-28 04:34:11.450659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.384 [2024-11-28 04:34:11.450947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.384 [2024-11-28 04:34:11.451075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.384 [2024-11-28 04:34:11.451099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.384 [2024-11-28 04:34:11.451123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.384 [2024-11-28 04:34:11.451272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.384 [2024-11-28 04:34:11.451441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.384 [2024-11-28 04:34:11.451464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.384 [2024-11-28 04:34:11.451478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.384 [2024-11-28 04:34:11.453801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.384 [2024-11-28 04:34:11.462904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.384 [2024-11-28 04:34:11.463180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.384 [2024-11-28 04:34:11.463314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.384 [2024-11-28 04:34:11.463339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.384 [2024-11-28 04:34:11.463355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.384 [2024-11-28 04:34:11.463470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.384 [2024-11-28 04:34:11.463648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.384 [2024-11-28 04:34:11.463671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.384 [2024-11-28 04:34:11.463685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.465794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.475242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.475557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.475655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.475682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.475698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.475846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.476010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.476031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.476045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.478090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.487391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.487667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.487779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.487805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.487821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.487942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.488125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.488146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.488160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.490173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.499795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.500152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.500259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.500286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.500301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.500466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.500659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.500681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.500696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.502852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.512219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.512533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.512650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.512676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.512693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.512825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.512977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.512997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.513011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.515119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.524446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.524771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.524901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.524927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.524944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.525125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.525326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.525348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.525362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.527345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.536881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.537175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.537332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.537358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.537374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.537548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.537670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.537691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.537705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.539851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.549211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.549489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.549609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.549637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.549653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.549802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.549999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.550020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.550034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.552111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.561431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.561773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.561913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.561939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.561955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.562103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.562316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.562342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.562357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.564347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.573789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.574062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.574173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.574199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.385 [2024-11-28 04:34:11.574214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.385 [2024-11-28 04:34:11.574362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.385 [2024-11-28 04:34:11.574603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.385 [2024-11-28 04:34:11.574625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.385 [2024-11-28 04:34:11.574639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.385 [2024-11-28 04:34:11.576763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.385 [2024-11-28 04:34:11.585979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.385 [2024-11-28 04:34:11.586278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.385 [2024-11-28 04:34:11.586377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.586403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.586419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.586593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.586698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.586719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.586733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 [2024-11-28 04:34:11.588748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 [2024-11-28 04:34:11.598239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.598513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.598646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.598673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.598688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.598869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.599017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.599038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.599057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 [2024-11-28 04:34:11.601142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 [2024-11-28 04:34:11.610540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.610842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.610944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.610971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.610987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.611136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.611317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.611337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.611351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 [2024-11-28 04:34:11.613499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 [2024-11-28 04:34:11.622992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.623271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.623373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.623400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.623415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.623557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.623710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.623731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.623745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 [2024-11-28 04:34:11.625768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 04:34:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:34.386 04:34:11 -- common/autotest_common.sh@862 -- # return 0 00:27:34.386 04:34:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:34.386 04:34:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:34.386 04:34:11 -- common/autotest_common.sh@10 -- # set +x 00:27:34.386 [2024-11-28 04:34:11.635138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.635494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.635635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.635663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.635679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.635860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.636042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.636069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.636084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 [2024-11-28 04:34:11.638267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 [2024-11-28 04:34:11.647498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.647823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.647996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.648022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.648037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.648186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.648370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.648392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.648406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 04:34:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:34.386 04:34:11 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:34.386 04:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:34.386 04:34:11 -- common/autotest_common.sh@10 -- # set +x 00:27:34.386 [2024-11-28 04:34:11.650637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 [2024-11-28 04:34:11.651848] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:34.386 04:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:34.386 04:34:11 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:34.386 04:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:34.386 04:34:11 -- common/autotest_common.sh@10 -- # set +x 00:27:34.386 [2024-11-28 04:34:11.660198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.660489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.660613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.660639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.660655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.660834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.660997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.661018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.661032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 [2024-11-28 04:34:11.663301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 [2024-11-28 04:34:11.672270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.672610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.672715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.672747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.672763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.672895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.673058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.673078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.386 [2024-11-28 04:34:11.673091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.386 [2024-11-28 04:34:11.675152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.386 [2024-11-28 04:34:11.684467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.386 [2024-11-28 04:34:11.684925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.685081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.386 [2024-11-28 04:34:11.685107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.386 [2024-11-28 04:34:11.685127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.386 [2024-11-28 04:34:11.685301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.386 [2024-11-28 04:34:11.685490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.386 [2024-11-28 04:34:11.685534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.387 [2024-11-28 04:34:11.685564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.387 [2024-11-28 04:34:11.687681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.645 Malloc0 00:27:34.645 04:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:34.645 04:34:11 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:34.645 04:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:34.645 04:34:11 -- common/autotest_common.sh@10 -- # set +x 00:27:34.645 [2024-11-28 04:34:11.697156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.645 [2024-11-28 04:34:11.697497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.645 [2024-11-28 04:34:11.697612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.645 [2024-11-28 04:34:11.697640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.645 [2024-11-28 04:34:11.697657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.645 [2024-11-28 04:34:11.697843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.645 [2024-11-28 04:34:11.697978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.645 [2024-11-28 04:34:11.697999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.645 [2024-11-28 04:34:11.698014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.645 [2024-11-28 04:34:11.700189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.645 04:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:34.645 04:34:11 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:34.645 04:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:34.645 04:34:11 -- common/autotest_common.sh@10 -- # set +x 00:27:34.645 [2024-11-28 04:34:11.709664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.645 [2024-11-28 04:34:11.709939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.645 [2024-11-28 04:34:11.710054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.645 [2024-11-28 04:34:11.710081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c27160 with addr=10.0.0.2, port=4420 00:27:34.645 [2024-11-28 04:34:11.710097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c27160 is same with the state(5) to be set 00:27:34.645 [2024-11-28 04:34:11.710229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c27160 (9): Bad file descriptor 00:27:34.645 [2024-11-28 04:34:11.710347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.645 [2024-11-28 04:34:11.710368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.645 [2024-11-28 04:34:11.710382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.645 04:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:34.645 04:34:11 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:34.645 04:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:34.645 04:34:11 -- common/autotest_common.sh@10 -- # set +x 00:27:34.645 [2024-11-28 04:34:11.712473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.645 [2024-11-28 04:34:11.715183] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:34.645 04:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:34.645 04:34:11 -- host/bdevperf.sh@38 -- # wait 4014471 00:27:34.645 [2024-11-28 04:34:11.721952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.645 [2024-11-28 04:34:11.791335] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:42.770 00:27:42.770 Latency(us) 00:27:42.770 [2024-11-28T03:34:20.081Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:42.770 [2024-11-28T03:34:20.081Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:42.770 Verification LBA range: start 0x0 length 0x4000 00:27:42.770 Nvme1n1 : 15.01 9108.49 35.58 16062.58 0.00 5070.51 813.13 21748.24 00:27:42.770 [2024-11-28T03:34:20.081Z] =================================================================================================================== 00:27:42.770 [2024-11-28T03:34:20.081Z] Total : 9108.49 35.58 16062.58 0.00 5070.51 813.13 21748.24 00:27:43.029 04:34:20 -- host/bdevperf.sh@39 -- # sync 00:27:43.029 04:34:20 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:43.029 04:34:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.029 04:34:20 -- common/autotest_common.sh@10 -- # set +x 00:27:43.029 04:34:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.029 04:34:20 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:43.029 04:34:20 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:43.029 04:34:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:43.029 04:34:20 -- nvmf/common.sh@116 -- # sync 00:27:43.029 04:34:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:43.029 04:34:20 -- nvmf/common.sh@119 -- # set +e 00:27:43.029 04:34:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:43.029 04:34:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:43.029 rmmod nvme_tcp 00:27:43.029 rmmod nvme_fabrics 00:27:43.029 rmmod nvme_keyring 00:27:43.288 04:34:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:43.288 04:34:20 -- nvmf/common.sh@123 -- # set -e 00:27:43.288 04:34:20 -- nvmf/common.sh@124 -- # return 0 00:27:43.288 04:34:20 -- nvmf/common.sh@477 -- # '[' -n 4015154 ']' 00:27:43.288 04:34:20 -- nvmf/common.sh@478 -- # killprocess 4015154 00:27:43.288 04:34:20 -- common/autotest_common.sh@936 -- # '[' -z 4015154 ']' 00:27:43.288 04:34:20 -- common/autotest_common.sh@940 -- # kill -0 4015154 00:27:43.288 04:34:20 -- common/autotest_common.sh@941 -- # uname 00:27:43.288 04:34:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:43.288 04:34:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4015154 00:27:43.288 04:34:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:43.288 04:34:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:43.288 04:34:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4015154' 00:27:43.288 killing process with pid 4015154 00:27:43.288 04:34:20 -- common/autotest_common.sh@955 -- # kill 4015154 00:27:43.288 04:34:20 -- common/autotest_common.sh@960 -- # wait 4015154 00:27:43.547 04:34:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:43.547 04:34:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:43.547 04:34:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:43.547 04:34:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:43.547 04:34:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:43.547 04:34:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:43.547 04:34:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:43.547 04:34:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:45.451 04:34:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:45.452 00:27:45.452 real 0m23.226s 00:27:45.452 user 1m0.187s 00:27:45.452 sys 0m5.267s 00:27:45.452 04:34:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:45.452 04:34:22 -- common/autotest_common.sh@10 -- # set +x 00:27:45.452 ************************************ 00:27:45.452 END TEST nvmf_bdevperf 00:27:45.452 ************************************ 00:27:45.711 04:34:22 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:45.711 04:34:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:45.711 04:34:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:45.711 04:34:22 -- common/autotest_common.sh@10 -- # set +x 00:27:45.711 ************************************ 00:27:45.711 START TEST nvmf_target_disconnect 00:27:45.711 ************************************ 00:27:45.711 04:34:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:45.711 * Looking for test storage... 00:27:45.711 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:45.711 04:34:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:45.711 04:34:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:45.711 04:34:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:45.711 04:34:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:45.711 04:34:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:45.711 04:34:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:45.711 04:34:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:45.711 04:34:22 -- scripts/common.sh@335 -- # IFS=.-: 00:27:45.711 04:34:22 -- scripts/common.sh@335 -- # read -ra ver1 00:27:45.711 04:34:22 -- scripts/common.sh@336 -- # IFS=.-: 00:27:45.711 04:34:22 -- scripts/common.sh@336 -- # read -ra ver2 00:27:45.711 04:34:22 -- scripts/common.sh@337 -- # local 'op=<' 00:27:45.711 04:34:22 -- scripts/common.sh@339 -- # ver1_l=2 00:27:45.711 04:34:22 -- scripts/common.sh@340 -- # ver2_l=1 00:27:45.711 04:34:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:45.711 04:34:22 -- scripts/common.sh@343 -- # case "$op" in 00:27:45.711 04:34:22 -- scripts/common.sh@344 -- # : 1 00:27:45.711 04:34:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:45.711 04:34:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:45.711 04:34:22 -- scripts/common.sh@364 -- # decimal 1 00:27:45.711 04:34:22 -- scripts/common.sh@352 -- # local d=1 00:27:45.711 04:34:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:45.711 04:34:22 -- scripts/common.sh@354 -- # echo 1 00:27:45.711 04:34:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:45.711 04:34:22 -- scripts/common.sh@365 -- # decimal 2 00:27:45.711 04:34:22 -- scripts/common.sh@352 -- # local d=2 00:27:45.711 04:34:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:45.711 04:34:22 -- scripts/common.sh@354 -- # echo 2 00:27:45.711 04:34:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:45.711 04:34:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:45.711 04:34:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:45.711 04:34:22 -- scripts/common.sh@367 -- # return 0 00:27:45.711 04:34:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:45.711 04:34:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:45.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:45.711 --rc genhtml_branch_coverage=1 00:27:45.711 --rc genhtml_function_coverage=1 00:27:45.711 --rc genhtml_legend=1 00:27:45.711 --rc geninfo_all_blocks=1 00:27:45.711 --rc geninfo_unexecuted_blocks=1 00:27:45.711 00:27:45.711 ' 00:27:45.711 04:34:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:45.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:45.711 --rc genhtml_branch_coverage=1 00:27:45.711 --rc genhtml_function_coverage=1 00:27:45.711 --rc genhtml_legend=1 00:27:45.711 --rc geninfo_all_blocks=1 00:27:45.711 --rc geninfo_unexecuted_blocks=1 00:27:45.711 00:27:45.711 ' 00:27:45.711 04:34:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:45.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:45.711 --rc genhtml_branch_coverage=1 00:27:45.711 --rc genhtml_function_coverage=1 00:27:45.711 --rc genhtml_legend=1 00:27:45.711 --rc geninfo_all_blocks=1 00:27:45.711 --rc geninfo_unexecuted_blocks=1 00:27:45.711 00:27:45.711 ' 00:27:45.711 04:34:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:45.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:45.711 --rc genhtml_branch_coverage=1 00:27:45.711 --rc genhtml_function_coverage=1 00:27:45.711 --rc genhtml_legend=1 00:27:45.711 --rc geninfo_all_blocks=1 00:27:45.711 --rc geninfo_unexecuted_blocks=1 00:27:45.711 00:27:45.711 ' 00:27:45.711 04:34:22 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:45.711 04:34:22 -- nvmf/common.sh@7 -- # uname -s 00:27:45.711 04:34:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:45.711 04:34:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:45.711 04:34:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:45.711 04:34:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:45.711 04:34:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:45.711 04:34:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:45.711 04:34:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:45.711 04:34:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:45.711 04:34:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:45.711 04:34:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:45.711 04:34:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:45.711 04:34:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:45.711 04:34:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:45.711 04:34:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:45.711 04:34:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:45.711 04:34:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:45.711 04:34:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:45.711 04:34:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:45.711 04:34:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:45.711 04:34:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:45.711 04:34:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:45.711 04:34:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:45.711 04:34:22 -- paths/export.sh@5 -- # export PATH 00:27:45.711 04:34:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:45.711 04:34:22 -- nvmf/common.sh@46 -- # : 0 00:27:45.711 04:34:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:45.711 04:34:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:45.711 04:34:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:45.711 04:34:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:45.712 04:34:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:45.712 04:34:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:45.712 04:34:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:45.712 04:34:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:45.712 04:34:22 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:45.712 04:34:22 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:45.712 04:34:22 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:45.712 04:34:22 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:45.712 04:34:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:45.712 04:34:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:45.712 04:34:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:45.712 04:34:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:45.712 04:34:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:45.712 04:34:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:45.712 04:34:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:45.712 04:34:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:45.712 04:34:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:45.712 04:34:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:45.712 04:34:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:45.712 04:34:22 -- common/autotest_common.sh@10 -- # set +x 00:27:47.647 04:34:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:47.647 04:34:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:47.647 04:34:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:47.647 04:34:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:47.647 04:34:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:47.647 04:34:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:47.647 04:34:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:47.647 04:34:24 -- nvmf/common.sh@294 -- # net_devs=() 00:27:47.647 04:34:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:47.647 04:34:24 -- nvmf/common.sh@295 -- # e810=() 00:27:47.647 04:34:24 -- nvmf/common.sh@295 -- # local -ga e810 00:27:47.647 04:34:24 -- nvmf/common.sh@296 -- # x722=() 00:27:47.647 04:34:24 -- nvmf/common.sh@296 -- # local -ga x722 00:27:47.647 04:34:24 -- nvmf/common.sh@297 -- # mlx=() 00:27:47.647 04:34:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:47.647 04:34:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:47.647 04:34:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:47.647 04:34:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:47.647 04:34:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:47.647 04:34:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:47.647 04:34:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:47.647 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:47.647 04:34:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:47.647 04:34:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:47.647 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:47.647 04:34:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:47.647 04:34:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:47.647 04:34:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:47.647 04:34:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:47.647 04:34:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:47.647 04:34:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:47.647 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:47.647 04:34:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:47.647 04:34:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:47.647 04:34:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:47.647 04:34:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:47.647 04:34:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:47.647 04:34:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:47.647 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:47.647 04:34:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:47.647 04:34:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:47.647 04:34:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:47.647 04:34:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:47.647 04:34:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:47.647 04:34:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:47.647 04:34:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:47.647 04:34:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:47.647 04:34:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:47.647 04:34:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:47.647 04:34:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:47.647 04:34:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:47.647 04:34:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:47.647 04:34:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:47.647 04:34:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:47.647 04:34:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:47.647 04:34:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:47.647 04:34:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:47.910 04:34:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:47.910 04:34:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:47.910 04:34:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:47.910 04:34:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:47.910 04:34:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:47.910 04:34:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:47.910 04:34:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:47.910 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:47.910 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:27:47.910 00:27:47.910 --- 10.0.0.2 ping statistics --- 00:27:47.910 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:47.910 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:27:47.910 04:34:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:47.910 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:47.910 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.055 ms 00:27:47.910 00:27:47.910 --- 10.0.0.1 ping statistics --- 00:27:47.910 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:47.910 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:27:47.910 04:34:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:47.910 04:34:25 -- nvmf/common.sh@410 -- # return 0 00:27:47.910 04:34:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:47.910 04:34:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:47.910 04:34:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:47.910 04:34:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:47.910 04:34:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:47.910 04:34:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:47.910 04:34:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:47.910 04:34:25 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:47.910 04:34:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:47.910 04:34:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:47.910 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:27:47.910 ************************************ 00:27:47.910 START TEST nvmf_target_disconnect_tc1 00:27:47.910 ************************************ 00:27:47.910 04:34:25 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:47.910 04:34:25 -- host/target_disconnect.sh@32 -- # set +e 00:27:47.910 04:34:25 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:47.910 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.910 [2024-11-28 04:34:25.162168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-28 04:34:25.162381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-28 04:34:25.162409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5dcb40 with addr=10.0.0.2, port=4420 00:27:47.910 [2024-11-28 04:34:25.162440] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:47.910 [2024-11-28 04:34:25.162465] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:47.910 [2024-11-28 04:34:25.162478] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:47.910 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:47.910 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:47.910 Initializing NVMe Controllers 00:27:47.910 04:34:25 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:47.910 04:34:25 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:47.910 04:34:25 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:47.910 04:34:25 -- common/autotest_common.sh@1142 -- # return 0 00:27:47.910 04:34:25 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:47.910 04:34:25 -- host/target_disconnect.sh@41 -- # set -e 00:27:47.910 00:27:47.910 real 0m0.086s 00:27:47.910 user 0m0.035s 00:27:47.910 sys 0m0.050s 00:27:47.910 04:34:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:47.910 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:27:47.910 ************************************ 00:27:47.910 END TEST nvmf_target_disconnect_tc1 00:27:47.910 ************************************ 00:27:47.910 04:34:25 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:47.910 04:34:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:47.910 04:34:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:47.910 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:27:47.910 ************************************ 00:27:47.910 START TEST nvmf_target_disconnect_tc2 00:27:47.910 ************************************ 00:27:47.910 04:34:25 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:47.910 04:34:25 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:47.910 04:34:25 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:47.910 04:34:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:47.910 04:34:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:47.910 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:27:47.910 04:34:25 -- nvmf/common.sh@469 -- # nvmfpid=4018358 00:27:47.910 04:34:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:47.910 04:34:25 -- nvmf/common.sh@470 -- # waitforlisten 4018358 00:27:47.910 04:34:25 -- common/autotest_common.sh@829 -- # '[' -z 4018358 ']' 00:27:47.910 04:34:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:47.911 04:34:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:47.911 04:34:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:47.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:47.911 04:34:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:47.911 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:27:48.170 [2024-11-28 04:34:25.237391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:48.170 [2024-11-28 04:34:25.237460] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:48.170 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.170 [2024-11-28 04:34:25.300646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:48.170 [2024-11-28 04:34:25.413974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:48.170 [2024-11-28 04:34:25.414144] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:48.170 [2024-11-28 04:34:25.414161] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:48.170 [2024-11-28 04:34:25.414173] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:48.170 [2024-11-28 04:34:25.414268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:48.170 [2024-11-28 04:34:25.414338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:48.170 [2024-11-28 04:34:25.414394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:48.170 [2024-11-28 04:34:25.414397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:49.107 04:34:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:49.107 04:34:26 -- common/autotest_common.sh@862 -- # return 0 00:27:49.107 04:34:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:49.107 04:34:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:49.107 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:27:49.107 04:34:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:49.107 04:34:26 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:49.107 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.107 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:27:49.107 Malloc0 00:27:49.107 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.107 04:34:26 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:49.107 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.107 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:27:49.107 [2024-11-28 04:34:26.276695] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:49.107 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.107 04:34:26 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:49.107 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.107 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:27:49.107 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.107 04:34:26 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:49.107 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.107 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:27:49.107 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.107 04:34:26 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:49.107 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.107 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:27:49.107 [2024-11-28 04:34:26.304934] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:49.107 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.107 04:34:26 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:49.107 04:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.107 04:34:26 -- common/autotest_common.sh@10 -- # set +x 00:27:49.107 04:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.107 04:34:26 -- host/target_disconnect.sh@50 -- # reconnectpid=4018520 00:27:49.107 04:34:26 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:49.107 04:34:26 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:49.107 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.013 04:34:28 -- host/target_disconnect.sh@53 -- # kill -9 4018358 00:27:51.013 04:34:28 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:51.289 Read completed with error (sct=0, sc=8) 00:27:51.289 starting I/O failed 00:27:51.289 Read completed with error (sct=0, sc=8) 00:27:51.289 starting I/O failed 00:27:51.289 Read completed with error (sct=0, sc=8) 00:27:51.289 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 [2024-11-28 04:34:28.328816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 [2024-11-28 04:34:28.329147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 [2024-11-28 04:34:28.329469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Write completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.290 Read completed with error (sct=0, sc=8) 00:27:51.290 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Write completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 Read completed with error (sct=0, sc=8) 00:27:51.291 starting I/O failed 00:27:51.291 [2024-11-28 04:34:28.329803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:51.291 [2024-11-28 04:34:28.329946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.330129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.330158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.330272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.330439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.330465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.330612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.330721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.330746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.330894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.330999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.331025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.331122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.331282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.331308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.331448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.331558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.331584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.331720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.331821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.331851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.331986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.332118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.332143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.332393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.332539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.332584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.332705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.332817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.332842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.332949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.333236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.333509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.333804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.333958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.334118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.334265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.334296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.334411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.334580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.334607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.334741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.334899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.334928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.335136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.335270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.335298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.335475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.335650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.335676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.335773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.335880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.335906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.336075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.336227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.336252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.336377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.336595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.336621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.336721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.336830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.336855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.291 [2024-11-28 04:34:28.336986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.337085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.291 [2024-11-28 04:34:28.337111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.291 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.337231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.337339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.337364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.337471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.337593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.337621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.337720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.337820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.337847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.337953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.338211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.338453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.338717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.338846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.338961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.339251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.339502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.339781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.339943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.340087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.340230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.340263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.340386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.340586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.340613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.340752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.340880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.340906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.341032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.341288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.341532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.341762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.341919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.342049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.342180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.342206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.342333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.342456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.342482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.342623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.342750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.342777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.342916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.343220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.343478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.343780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.343974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.344104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.344234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.344260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.344389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.344490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.344516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.344622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.344757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.344783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.292 qpair failed and we were unable to recover it. 00:27:51.292 [2024-11-28 04:34:28.344915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.345040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.292 [2024-11-28 04:34:28.345067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.345197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.345325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.345352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.345481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.345635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.345662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.345774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.345911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.345938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.346067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.346198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.346223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.346335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.346469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.346496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.346636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.346798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.346824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.346955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.347239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.347557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.347802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.347937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.348037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.348168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.348193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.348354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.348480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.348505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.348651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.348774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.348799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.348922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.349179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.349416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.349683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.349846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.349974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.350233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.350481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.350776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.350962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.351118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.351210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.351235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.351363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.351494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.351519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.351631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.351724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.351750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.351864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.351991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.352017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.352148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.352316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.352342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.352494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.352608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.352635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.352729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.352822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.352848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.293 qpair failed and we were unable to recover it. 00:27:51.293 [2024-11-28 04:34:28.352981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.293 [2024-11-28 04:34:28.353108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.353135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.353233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.353328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.353353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.353477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.353601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.353629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.353731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.353857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.353882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.354022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.354147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.354173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.354300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.354430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.354456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.354606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.354766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.354796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.354961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.355151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.355180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.355323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.355459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.355488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.355623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.355769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.355798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.355968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.356250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.356482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.356756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.356897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.357044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.357188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.357216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.357393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.357515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.357547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.357713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.357927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.357956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.358116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.358308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.358337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.358453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.358569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.358596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.358702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.358834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.358859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.358989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.359099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.359127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.359245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.359363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.359390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.359584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.359711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.359737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.359907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.360007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.360033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.294 qpair failed and we were unable to recover it. 00:27:51.294 [2024-11-28 04:34:28.360187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.294 [2024-11-28 04:34:28.360307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.360334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.360485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.360633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.360659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.360784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.360933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.360959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.361061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.361188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.361216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.361330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.361465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.361493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.361621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.361749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.361774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.361946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.362227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.362523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.362814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.362970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.363128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.363266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.363293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.363431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.363551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.363577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.363677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.363782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.363822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.363951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.364270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.364514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.364755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.364887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.364977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.365284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.365530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.365818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.365996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.366151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.366245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.366271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.366420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.366583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.366610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.366768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.366894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.366922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.367044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.367148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.367173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.367303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.367436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.367462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.367652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.367757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.367782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.367947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.368055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.368080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.295 [2024-11-28 04:34:28.368210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.368354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.295 [2024-11-28 04:34:28.368383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.295 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.368549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.368700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.368725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.368852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.368980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.369006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.369175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.369272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.369296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.369401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.369574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.369600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.369726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.369828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.369852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.369983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.370117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.370142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.370242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.370412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.370436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.370561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.370694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.370720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.370873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.370975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.371097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.371346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.371581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.371829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.371962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.372140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.372271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.372295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.372450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.372556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.372581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.372707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.372807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.372831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.372960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.373280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.373579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.373868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.373994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.374144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.374297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.374322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.374453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.374622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.374651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.374795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.374922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.374946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.375074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.375199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.375224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.375382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.375567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.375597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.375720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.375842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.375867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.375996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.376129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.376154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.376281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.376457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.376482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.296 qpair failed and we were unable to recover it. 00:27:51.296 [2024-11-28 04:34:28.376619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.376740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.296 [2024-11-28 04:34:28.376766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.376894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.377151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.377432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.377743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.377894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.378028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.378155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.378180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.378311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.378444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.378472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.378690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.378790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.378815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.378957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.379256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.379501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.379782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.379951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.380109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.380262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.380287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.380387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.380514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.380548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.380643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.380776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.380801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.380932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.381028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.381053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.381198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.381338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.381366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.381484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.381638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.381667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.381819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.381974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.382014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.382155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.382328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.382352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.382480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.382608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.382634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.382733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.382829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.382854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.382984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.383109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.383137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.383277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.383441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.383468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.383618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.383774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.383798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.383927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.384227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.384482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.384744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.384869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.297 qpair failed and we were unable to recover it. 00:27:51.297 [2024-11-28 04:34:28.384973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.385123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.297 [2024-11-28 04:34:28.385149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.385272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.385398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.385423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.385555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.385665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.385691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.385791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.385914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.385940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.386062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.386216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.386258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.386422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.386531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.386557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.386691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.386855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.386879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.386981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.387105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.387129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.387248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.387407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.387432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.387588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.387686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.387712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.387866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.388129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.388434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.388683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.388843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.388953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.389116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.389141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.389272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.389430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.389455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.389589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.389696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.389720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.389874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.390020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.390045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.390202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.390335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.390364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.390537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.390667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.390708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.390889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.390991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.391016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.391154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.391283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.391308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.391437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.391592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.391619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.391721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.391841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.391865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.391966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.392111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.392139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.392315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.392488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.392516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.392704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.392827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.392852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.392952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.393106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.393135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.393311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.393410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.393434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.298 qpair failed and we were unable to recover it. 00:27:51.298 [2024-11-28 04:34:28.393604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.393755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.298 [2024-11-28 04:34:28.393782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.393926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.394091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.394115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.394241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.394388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.394413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.394545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.394669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.394694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.394810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.394996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.395021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.395117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.395226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.395251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.395381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.395566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.395592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.395724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.395847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.395872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.396014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.396140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.396164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.396305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.396456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.396498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.396661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.396800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.396828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.396950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.397104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.397129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.397267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.397420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.397445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.397592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.397711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.397740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.397861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.397992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.398018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.398146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.398284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.398313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.398461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.398602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.398628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.398757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.398861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.398886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.398982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.399112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.399137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.399283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.399417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.399445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.399626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.399778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.399803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.399936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.400099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.400125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.400252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.400369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.400394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.400518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.400681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.400706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.400879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.401005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.401031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.299 [2024-11-28 04:34:28.401229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.401331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.299 [2024-11-28 04:34:28.401356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.299 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.401454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.401635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.401661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.401826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.401977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.402002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.402158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.402279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.402304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.402470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.402577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.402603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.402730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.402903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.402928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.403056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.403211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.403236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.403340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.403467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.403492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.403638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.403745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.403770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.403864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.404191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.404422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.404713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.404893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.405021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.405177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.405202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.405346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.405476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.405502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.405618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.405750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.405781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.405883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.405988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.406014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.406173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.406319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.406348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.406492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.406740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.406766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.406932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.407210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.407500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.407826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.407951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.408080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.408228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.408258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.408412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.408539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.408569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.408715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.408846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.408872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.409053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.409184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.409212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.409357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.409484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.409509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.409641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.409750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.409775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.300 [2024-11-28 04:34:28.409921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.410061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.300 [2024-11-28 04:34:28.410089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.300 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.410221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.410329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.410356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.410472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.410606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.410630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.410783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.410900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.410927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.411064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.411215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.411240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.411396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.411566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.411595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.411707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.411855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.411879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.412036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.412158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.412186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.412340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.412491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.412517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.412629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.412750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.412782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.412904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.413192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.413453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.413683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.413822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.413946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.414228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.414507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.414780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.414906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.415038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.415185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.415212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.415335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.415432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.415457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.415565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.415674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.415698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.415880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.415977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.416001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.416130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.416235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.416259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.416361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.416488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.416512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.416644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.416746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.416789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.416924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.417214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.417504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.417785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.417992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.301 [2024-11-28 04:34:28.418120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.418246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.301 [2024-11-28 04:34:28.418272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.301 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.418398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.418556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.418586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.418696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.418827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.418854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.418974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.419104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.419129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.419292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.419405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.419432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.419609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.419776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.419801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.419930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.420220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.420507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.420798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.420953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.421134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.421238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.421262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.421364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.421451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.421475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.421611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.421739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.421763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.421891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.421998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.422023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.422149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.422243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.422267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.422371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.422531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.422556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.422705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.422822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.422849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.422989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.423099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.423126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.423304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.423432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.423458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.423573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.423705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.423730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.423884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.424225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.424488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.424770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.424963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.425104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.425232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.425258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.425385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.425559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.425587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.425734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.425861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.425886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.425987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.426089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.426114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.426257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.426400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.426427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.426553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.426695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.302 [2024-11-28 04:34:28.426724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.302 qpair failed and we were unable to recover it. 00:27:51.302 [2024-11-28 04:34:28.426856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.427202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.427572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.427813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.427988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.428141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.428275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.428302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.428462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.428559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.428587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.428741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.428865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.428890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.429025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.429277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.429563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.429824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.429991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.430143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.430313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.430337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.430462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.430625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.430650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.430819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.430970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.430995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.431115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.431218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.431243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.431370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.431496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.431521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.431632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.431784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.431810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.431979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.432143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.432170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.432310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.432433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.432460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.432632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.432758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.432787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.432943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.433110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.433137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.433310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.433436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.433461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.433619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.433725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.433750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.433878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.433976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.434001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.434099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.434255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.434280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.303 qpair failed and we were unable to recover it. 00:27:51.303 [2024-11-28 04:34:28.434437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.303 [2024-11-28 04:34:28.434578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.434606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.434793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.434962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.434990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.435141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.435272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.435297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.435450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.435616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.435645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.435756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.435891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.435919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.436074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.436178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.436204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.436332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.436494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.436520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.436637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.436764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.436788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.436894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.436997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.437022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.437196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.437345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.437373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.437510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.437676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.437702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.437831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.437955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.437980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.438128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.438265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.438307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.438433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.438559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.438587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.438740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.438839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.438863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.439012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.439127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.439155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.439306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.439453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.439481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.439678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.439875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.439926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.440046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.440186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.440214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.440383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.440488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.440515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.440667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.440761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.440786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.440912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.441169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.441413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.441674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.441856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.442060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.442216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.442240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.442366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.442494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.442519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.442742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.442872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.442898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.443022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.443172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.443197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.304 qpair failed and we were unable to recover it. 00:27:51.304 [2024-11-28 04:34:28.443352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.304 [2024-11-28 04:34:28.443480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.443505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.443644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.443798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.443823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.444005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.444150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.444175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.444328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.444454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.444494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.444653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.444775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.444800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.444926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.445224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.445546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.445819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.445997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.446161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.446290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.446314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.446443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.446552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.446578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.446699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.446845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.446872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.447018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.447268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.447557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.447815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.447935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.448055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.448192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.448225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.448333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.448472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.448500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.448626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.448767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.448791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.448928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.449088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.449112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.449218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.449349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.449391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.449539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.449696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.449720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.449901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.450143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.450460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.450740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.450885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.451054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.451194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.451222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.451345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.451462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.451486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.451594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.451723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.451747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.305 qpair failed and we were unable to recover it. 00:27:51.305 [2024-11-28 04:34:28.451842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.305 [2024-11-28 04:34:28.451971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.451995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.452149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.452307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.452332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.452473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.452580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.452606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.452735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.452855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.452883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.453039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.453174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.453200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.453322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.453475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.453499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.453600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.453716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.453744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.453887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.454187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.454477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.454733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.454865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.455003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.455179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.455208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.455346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.455477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.455504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.455659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.455811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.455835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.455981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.456173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.456199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.456317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.456483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.456510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.456638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.456805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.456829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.456954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.457244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.457539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.457814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.457936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.458061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.458154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.458179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.458307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.458408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.458433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.458607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.458754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.458786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.458955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.459104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.459134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.459256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.459390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.459416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.459580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.459733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.459758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.459901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.460034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.460062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.460188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.460341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.460370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.306 qpair failed and we were unable to recover it. 00:27:51.306 [2024-11-28 04:34:28.460522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.306 [2024-11-28 04:34:28.460707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.460733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.460888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.460995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.461020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.461120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.461251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.461276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.461405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.461574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.461603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.461771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.461909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.461937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.462055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.462187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.462213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.462394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.462515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.462547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.462674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.462824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.462852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.462974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.463102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.463128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.463294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.463449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.463478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.463612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.463720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.463745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.463870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.464147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.464461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.464710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.464860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.464986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.465121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.465149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.465288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.465425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.465453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.465580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.465711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.465736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.465917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.466080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.466113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.466285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.466451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.466481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.466613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.466745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.466770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.466947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.467128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.467154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.467252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.467409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.467434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.467560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.467716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.467742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.467872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.468135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.468433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.468654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.468833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.468965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.469070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.307 [2024-11-28 04:34:28.469096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.307 qpair failed and we were unable to recover it. 00:27:51.307 [2024-11-28 04:34:28.469217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.469344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.469370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.469555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.469705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.469731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.469878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.470194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.470463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.470817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.470947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.471082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.471236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.471261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.471386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.471538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.471581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.471683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.471813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.471855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.472009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.472141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.472166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.472354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.472511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.472543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.472650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.472744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.472770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.472890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.472985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.473010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.473132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.473305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.473333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.473474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.473594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.473619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.473729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.473832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.473858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.473958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.474145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.474172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.474313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.474492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.474518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.474626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.474716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.474740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.474894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.475196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.475496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.475749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.475925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.476098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.476258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.476284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.476385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.476509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.476557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.308 qpair failed and we were unable to recover it. 00:27:51.308 [2024-11-28 04:34:28.476659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.476788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.308 [2024-11-28 04:34:28.476813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.476915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.477046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.477074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.477226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.477314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.477339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.477486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.477673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.477699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.477825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.477975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.478003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.478128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.478258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.478283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.478434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.478591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.478617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.478715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.478860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.478888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.479066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.479327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.479559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.479770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.479915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.480043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.480147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.480171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.480275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.480415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.480442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.480615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.480747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.480772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.480950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.481294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.481552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.481795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.481946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.482087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.482216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.482243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.482416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.482570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.482596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.482726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.482853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.482878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.483035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.483178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.483203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.483325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.483430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.483454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.483615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.483739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.483763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.483863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.483989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.484013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.484139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.484289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.484315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.484504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.484630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.484656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.484781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.484926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.484953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.309 qpair failed and we were unable to recover it. 00:27:51.309 [2024-11-28 04:34:28.485116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.485222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.309 [2024-11-28 04:34:28.485246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.485410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.485562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.485605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.485705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.485827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.485853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.485982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.486133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.486158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.486265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.486516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.486551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.486724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.486832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.486856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.486958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.487203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.487479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.487786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.487905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.488049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.488197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.488223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.488355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.488550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.488576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.488705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.488808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.488833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.488991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.489118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.489142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.489277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.489431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.489456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.489617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.489748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.489773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.489926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.490282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.490537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.490810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.490989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.491153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.491331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.491376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.491599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.491756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.491781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.491913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.492058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.492083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.492219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.492409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.492434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.492565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.492667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.492692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.492851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.492975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.493003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.493144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.493286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.493313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.493433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.493560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.493585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.493754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.493884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.493916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.310 qpair failed and we were unable to recover it. 00:27:51.310 [2024-11-28 04:34:28.494088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.310 [2024-11-28 04:34:28.494230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.494258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.494414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.494549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.494575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.494673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.494793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.494821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.494994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.495119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.495143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.495295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.495465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.495493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.495678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.495788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.495813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.495963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.496088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.496113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.496274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.496428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.496453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.496643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.496745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.496770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.496923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.497080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.497110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.497284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.497412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.497437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.497535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.497692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.497719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.497904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.498182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.498454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.498782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.498939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.499062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.499313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.499523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.499812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.499969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.500097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.500220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.500246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.500375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.500519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.500572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.500689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.500844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.500868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.501027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.501154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.501179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.501313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.501424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.501453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.501575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.501706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.501732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.501884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.501992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.502020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.502154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.502345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.502371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.502501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.502662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.502704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.311 qpair failed and we were unable to recover it. 00:27:51.311 [2024-11-28 04:34:28.502843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.311 [2024-11-28 04:34:28.502966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.502991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.503123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.503220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.503264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.503402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.503501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.503535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.503680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.503785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.503810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.503911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.504081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.504109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.504254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.504381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.504406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.504536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.504684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.504712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.504870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.505023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.505049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.505150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.505305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.505330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.505501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.505674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.505700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.505850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.506286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.506516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.506771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.506920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.507051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.507177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.507202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.507359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.507568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.507594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.507725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.507835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.507878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.508023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.508150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.508175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.508337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.508508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.508537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.508664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.508760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.508785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.508945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.509044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.509069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.509195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.509382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.509415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.509569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.509701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.509726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.509901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.510102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.510130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.510243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.510388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.510416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.510567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.510690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.312 [2024-11-28 04:34:28.510731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.312 qpair failed and we were unable to recover it. 00:27:51.312 [2024-11-28 04:34:28.510887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.510984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.511009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.511222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.511330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.511358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.511520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.511620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.511645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.511773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.511897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.511922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.512075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.512191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.512219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.512339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.512479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.512507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.512727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.512823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.512863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.513031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.513146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.513175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.513324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.513464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.513505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.513651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.513775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.513800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.513929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.514064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.514093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.514206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.514388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.514414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.514542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.514644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.514669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.514822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.515158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.515485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.515775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.515934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.516041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.516211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.516239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.516360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.516496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.516521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.516678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.516819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.516846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.516986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.517123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.517151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.517271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.517400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.517426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.517559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.517658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.517703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.517839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.517980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.518023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.518179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.518352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.518380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.518570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.518678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.518702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.518841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.518976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.519003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.519177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.519301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.519327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.519454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.519593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.313 [2024-11-28 04:34:28.519621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.313 qpair failed and we were unable to recover it. 00:27:51.313 [2024-11-28 04:34:28.519736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.519876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.519918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.520054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.520149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.520175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.520305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.520424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.520451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.520592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.520736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.520763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.520974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.521099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.521140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.521279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.521420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.521451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.521570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.521682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.521711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.521859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.521990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.522016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.522148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.522253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.522281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.522423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.522541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.522570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.522696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.522801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.522826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.522927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.523222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.523513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.523839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.523978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.524201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.524349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.524374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.524535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.524665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.524689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.524844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.524974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.525006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.525141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.525275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.525304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.525429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.525581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.525606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.525795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.525904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.525932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.526036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.526200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.526228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.526403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.526552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.526595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.526715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.526825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.526867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.526979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.527132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.527159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.527307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.527436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.527462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.527588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.527781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.527806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.527934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.528077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.528104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.528285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.528414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.314 [2024-11-28 04:34:28.528453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.314 qpair failed and we were unable to recover it. 00:27:51.314 [2024-11-28 04:34:28.528597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.528739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.528781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.528905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.529191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.529485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.529809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.529947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.530100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.530254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.530279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.530439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.530541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.530567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.530671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.530769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.530794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.530897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.530993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.531017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.531174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.531314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.531342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.531479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.531653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.531679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.531777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.531876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.531901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.531999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.532148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.532174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.532280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.532479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.532504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.532645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.532770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.532795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.532940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.533089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.533114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.533245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.533357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.533384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.533539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.533670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.533695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.533834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.534174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.534493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.534808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.534991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.535147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.535265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.535293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.535417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.535570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.535596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.535724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.535867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.535894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.536060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.536198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.536226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.536404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.536550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.536579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.536721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.536823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.536850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.536989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.537133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.315 [2024-11-28 04:34:28.537160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.315 qpair failed and we were unable to recover it. 00:27:51.315 [2024-11-28 04:34:28.537395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.537564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.537596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.537737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.537874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.537916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.538018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.538164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.538192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.538341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.538475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.538501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.538664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.538786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.538810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.538983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.539127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.539154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.539326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.539465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.539506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.539643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.539770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.539795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.539949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.540104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.540132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.540310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.540442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.540483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.540618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.540742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.540770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.540920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.541059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.541086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.541235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.541362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.541388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.541564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.541676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.541704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.541848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.541988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.542015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.542187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.542313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.542338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.542496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.542669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.542695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.542822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.542919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.542945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.543051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.543324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.543591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.543854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.543980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.544077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.544229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.544255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.544367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.544550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.544575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.544699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.544800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.544825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.544923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.545049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.545090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.545227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.545330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.545357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.545544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.545672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.545713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.545850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.545986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.316 [2024-11-28 04:34:28.546013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.316 qpair failed and we were unable to recover it. 00:27:51.316 [2024-11-28 04:34:28.546130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.546235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.546264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.546410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.546562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.546604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.546720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.546845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.546869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.546966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.547111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.547139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.547292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.547399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.547424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.547557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.547767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.547795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.547932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.548149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.548176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.548325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.548426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.548451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.548600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.548741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.548769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.548937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.549075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.549103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.549257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.549386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.549411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.549589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.549755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.549811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.549948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.550090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.550118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.550274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.550378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.550403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.550530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.550636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.550664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.550801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.550972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.551001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.551127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.551253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.551278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.551405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.551502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.551531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.551660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.551857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.551882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.552014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.552259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.552536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.552825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.552988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.553112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.553265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.553293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.553435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.553552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.553581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.317 [2024-11-28 04:34:28.553737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.553868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.317 [2024-11-28 04:34:28.553893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.317 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.553990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.554227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.554252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.554484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.554708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.554737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.554854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.554956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.554982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.555125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.555261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.555289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.555429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.555566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.555594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.555721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.555851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.555877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.555981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.556072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.556097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.556248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.556435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.556463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.556591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.556746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.556788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.556931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.557071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.557098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.557227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.557330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.557358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.557550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.557679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.557722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.557858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.558167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.558411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.558740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.558912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.559051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.559226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.559251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.559387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.559519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.559549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.559677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.559797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.559824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.559999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.560155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.560180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.560343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.560468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.560493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.560601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.560729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.560755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.560910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.561202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.561459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.561748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.561919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.562094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.562251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.562275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.562444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.562547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.562579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.318 [2024-11-28 04:34:28.562679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.562852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.318 [2024-11-28 04:34:28.562876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.318 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.563004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.563132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.563157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.563264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.563408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.563436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.563609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.563720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.563763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.563891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.563988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.564013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.564155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.564264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.564292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.564430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.564572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.564601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.564758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.564911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.564952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.565117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.565261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.565289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.565428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.565585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.565612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.565746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.565877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.565902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.566032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.566176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.566201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.566331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.566438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.566463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.566589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.566691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.566717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.566812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.566982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.567010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.567167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.567324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.567349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.567514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.567648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.567673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.567821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.567941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.567968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.568078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.568187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.568214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.568333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.568472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.568500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.568628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.568758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.568783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.568965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.569105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.569132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.569309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.569437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.569478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.569603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.569756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.569783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.569939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.570225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.570558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.570845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.570982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.571128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.571258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.571283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.319 [2024-11-28 04:34:28.571496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.571676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.319 [2024-11-28 04:34:28.571704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.319 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.571855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.572188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.572467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.572794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.572943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.573119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.573251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.573275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.573403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.573519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.573553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.573675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.573815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.573843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.573965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.574255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.574569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.574837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.574960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.575110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.575247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.575275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.575398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.575561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.575586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.575716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.575820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.575844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.575939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.576229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.576535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.576799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.576964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.577080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.577221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.577248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.577464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.577597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.577622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.577756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.577856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.577880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.578008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.578114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.578138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.578294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.578394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.578419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.578535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.578659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.578683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.578856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.578994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.579021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.579152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.579314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.579339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.579494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.579611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.579637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.579769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.579916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.579940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.320 qpair failed and we were unable to recover it. 00:27:51.320 [2024-11-28 04:34:28.580039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.320 [2024-11-28 04:34:28.580165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.580190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.580306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.580451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.580486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.580613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.580725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.580753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.580894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.581159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.581411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.581703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.581873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.581977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.582080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.321 [2024-11-28 04:34:28.582106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.321 qpair failed and we were unable to recover it. 00:27:51.321 [2024-11-28 04:34:28.582243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.582345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.582371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.609 [2024-11-28 04:34:28.582475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.582605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.582632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.609 [2024-11-28 04:34:28.582764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.582870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.582896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.609 [2024-11-28 04:34:28.583040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.609 [2024-11-28 04:34:28.583288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.609 [2024-11-28 04:34:28.583530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.609 [2024-11-28 04:34:28.583839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.583989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.609 [2024-11-28 04:34:28.584117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.584243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.609 [2024-11-28 04:34:28.584267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.609 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.584392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.584519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.584549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.584696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.584825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.584849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.584950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.585200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.585427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.585738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.585892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.586027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.586308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.586523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.586808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.586933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.587043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.587330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.587587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.587810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.587985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.588082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.588179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.588205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.588328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.588426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.588451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.588605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.588738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.588763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.588884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.589262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.589558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.589823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.589982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.590115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.590256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.590284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.590394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.590523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.590561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.590700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.590816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.590867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.590994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.591174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.591204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.591314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.591424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.591456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.591620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.591757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.591789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.591940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.592100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.592128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.610 qpair failed and we were unable to recover it. 00:27:51.610 [2024-11-28 04:34:28.592265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.610 [2024-11-28 04:34:28.592368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.592400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.592517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.592678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.592724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.592922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.593197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.593470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.593768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.593933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.594078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.594241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.594272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.594408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.594520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.594559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.594668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.594804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.594834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.594961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.595240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.595495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.595823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.595998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.596104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.596239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.596268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.596408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.596548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.596576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.596714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.596868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.596918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.597053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.597166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.597194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.597338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.597479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.597513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.597703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.597852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.597899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.598005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.598116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.598144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.598285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.598402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.598429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.598544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.598690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.598719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.598859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.599058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.599087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.599227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.599356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.599388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.599500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.599637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.599683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.599834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.600200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.600493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.600779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.611 [2024-11-28 04:34:28.600966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.611 qpair failed and we were unable to recover it. 00:27:51.611 [2024-11-28 04:34:28.601075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.601213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.601242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.601347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.601478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.601505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.601694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.601848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.601899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.602018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.602172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.602200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.602340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.602465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.602493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.602653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.602840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.602868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.603036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.603168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.603195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.603306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.603445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.603476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.603595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.603723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.603771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.603967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.604164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.604210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.604351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.604518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.604555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.604712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.604903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.604931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.605100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.605237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.605266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.605405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.605551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.605584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.605731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.605840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.605866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.606009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.606147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.606177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.606287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.606424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.606457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.606575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.606749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.606798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.606932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.607084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.607131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.607260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.607355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.607386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.607521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.607666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.607700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.607844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.607979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.608008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.608123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.608226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.608256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.608364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.608484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.608511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.608624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.608769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.608796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.608949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.609055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.609084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.609223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.609374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.609405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.609562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.609694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.609724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.612 [2024-11-28 04:34:28.609883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.610015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.612 [2024-11-28 04:34:28.610043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.612 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.610155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.610259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.610291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.610414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.610581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.610621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.610755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.610915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.610946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.611065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.611234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.611263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.611372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.611492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.611522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.611699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.611843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.611871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.611982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.612149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.612178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.612313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.612454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.612483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.612614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.612722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.612748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.612902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.613208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.613497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.613797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.613969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.614103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.614212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.614240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.614369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.614521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.614554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.614659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.614756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.614782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.614948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.615207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.615505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.615780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.615922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.616088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.616200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.616228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.616370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.616509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.616551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.616667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.616810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.616836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.616992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.617251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.617537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.617766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.617897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.618041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.618175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.618203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.613 qpair failed and we were unable to recover it. 00:27:51.613 [2024-11-28 04:34:28.618337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.613 [2024-11-28 04:34:28.618452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.618480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.618602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.618736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.618761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.618895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.619214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.619571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.619794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.619940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.620089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.620229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.620258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.620434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.620598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.620624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.620746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.620872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.620897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.621046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.621183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.621211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.621316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.621438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.621463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.621614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.621715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.621740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.621862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.621980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.622008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.622118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.622218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.622246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.622373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.622508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.622541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.622676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.622818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.622843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.622952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.623049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.623076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.623211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.623395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.623423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.623590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.623698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.623724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.623853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.623959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.624001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.624184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.624352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.624380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.624503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.624615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.624640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.624739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.624880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.624905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.625034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.625160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.625186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.614 [2024-11-28 04:34:28.625321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.625449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.614 [2024-11-28 04:34:28.625475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.614 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.625591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.625695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.625721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.625850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.625946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.625972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.626106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.626235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.626261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.626389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.626493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.626519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.626631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.626726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.626752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.626885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.626985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.627010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.627141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.627358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.627387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.627496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.627654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.627681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.627810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.627933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.627962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.628109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.628222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.628250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.628378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.628477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.628502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.628654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.628755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.628780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.628906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.629178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.629495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.629790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.629936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.630146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.630258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.630289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.630457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.630614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.630641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.630741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.630893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.630919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.631033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.631130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.631156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.631272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.631409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.631438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.631591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.631747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.631773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.631879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.631981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.632118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.632383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.632651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.632883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.632982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.633009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.633131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.633228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.633254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.615 qpair failed and we were unable to recover it. 00:27:51.615 [2024-11-28 04:34:28.633359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.633493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.615 [2024-11-28 04:34:28.633518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.633663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.633766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.633791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.633884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.634206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.634462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.634737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.634875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.634977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.635256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.635506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.635740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.635863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.635998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.636226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.636475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.636772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.636900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.637002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.637156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.637182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.637310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.637465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.637491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.637601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.637701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.637726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.637853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.637984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.638009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.638113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.638268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.638294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.638426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.638534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.638560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.638685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.638816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.638843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.638939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.639187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.639508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.639775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.639896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.640002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.640160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.640186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.640315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.640473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.640498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.640634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.640787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.640814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.640912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.641040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.641067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.616 qpair failed and we were unable to recover it. 00:27:51.616 [2024-11-28 04:34:28.641173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.616 [2024-11-28 04:34:28.641279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.641305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.641432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.641532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.641559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.641658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.641759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.641785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.641916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.642148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.642429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.642722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.642874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.642979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.643076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.643102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.643262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.643390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.643416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.643547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.643753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.643779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.643909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.644145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.644459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.644741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.644870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.644999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.645134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.645159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.645294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.645422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.645448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.645550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.645654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.645680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.645794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.645999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.646024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.646153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.646255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.646281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.646412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.646537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.646563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.646668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.646803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.646829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.646930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.647176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.647444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.647706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.647860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.648017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.648282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.648532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.617 [2024-11-28 04:34:28.648757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.617 [2024-11-28 04:34:28.648888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.617 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.648992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.649128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.649154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.649284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.649440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.649466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.649584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.649716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.649741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.649844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.649974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.650005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.650150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.650278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.650305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.650410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.650511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.650544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.650689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.650785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.650812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.650921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.651019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.651045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.651153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.651358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.651383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.651512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.651701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.651728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.651861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.651991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.652017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.652145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.652275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.652300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.652453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.652564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.652591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.652797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.652899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.652929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.653037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.653204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.653229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.653326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.653483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.653508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.653639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.653779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.653805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.653931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.654181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.654474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.654784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.654938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.655091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.655223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.655249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.655345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.655471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.655497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.655601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.655706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.655737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.655849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.655974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.618 [2024-11-28 04:34:28.656000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.618 qpair failed and we were unable to recover it. 00:27:51.618 [2024-11-28 04:34:28.656208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.656409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.656435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.656597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.656705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.656730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.656855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.656962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.656987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.657117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.657242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.657269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.657369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.657494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.657520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.657653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.657755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.657782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.657899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.658196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.658453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.658763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.658922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.659027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.659159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.659184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.659310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.659437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.659462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.659573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.659738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.659763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.659893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.659985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.660011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.660138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.660235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.660262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.660416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.660543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.660569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.660729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.660838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.660864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.660989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.661280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.661550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.661796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.661951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.662105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.662331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.662606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.662835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.662986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.663091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.663223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.663249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.663376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.663481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.663506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.663625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.663769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.663795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.619 [2024-11-28 04:34:28.663900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.664009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.619 [2024-11-28 04:34:28.664035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.619 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.664138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.664237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.664264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.664415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.664541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.664568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.664701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.664796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.664821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.664948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.665184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.665464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.665732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.665857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.665962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.666074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.666099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.666255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.666387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.666412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.666540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.666681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.666706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.666877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.666986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.667011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.667172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.667299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.667324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.667425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.667530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.667555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.667707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.667803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.667829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.667930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.668218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.668503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.668786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.668943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.669035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.669309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.669537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.669767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.669887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.670041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.670142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.670167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.670300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.670399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.670425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.670632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.670759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.670786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.670890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.670989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.671014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.671117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.671238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.671264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.671372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.671472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.620 [2024-11-28 04:34:28.671497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.620 qpair failed and we were unable to recover it. 00:27:51.620 [2024-11-28 04:34:28.671607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.671712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.671738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.671863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.671985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.672011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.672148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.672264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.672289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.672387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.672492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.672517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.672644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.672849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.672874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.672973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.673226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.673558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.673825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.673953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.674084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.674346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.674602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.674838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.674971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.675101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.675204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.675231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.675389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.675544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.675570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.675726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.675851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.675877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.676037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.676292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.676528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.676815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.676939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.677045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.677177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.677203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.677330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.677470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.677496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.677620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.677766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.677796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.677911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.678171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.678459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.678720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.678848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.678954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.679081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.679107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.621 [2024-11-28 04:34:28.679211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.679315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.621 [2024-11-28 04:34:28.679341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.621 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.679464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.679568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.679595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.679704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.679829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.679855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.679960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.680174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.680412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.680686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.680836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.680937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.681219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.681496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.681774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.681931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.682039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.682291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.682555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.682780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.682937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.683042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.683293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.683557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.683780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.683931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.684031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.684281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.684539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.684785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.684906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.685040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.685264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.685496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.685771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.685897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.686014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.686108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.686134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.686266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.686388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.686413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.622 [2024-11-28 04:34:28.686547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.686650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.622 [2024-11-28 04:34:28.686677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.622 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.686791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.686891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.686917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.687020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.687149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.687175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.687308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.687459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.687485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.687624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.687725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.687749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.687878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.688211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.688479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.688718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.688849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.688955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.689226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.689478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.689734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.689853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.689953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.690224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.690460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.690699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.690827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.690919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.691134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.691411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.691656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.691812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.691909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.692173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.692541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.692834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.692985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.693120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.693220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.693245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.623 qpair failed and we were unable to recover it. 00:27:51.623 [2024-11-28 04:34:28.693349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.693479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.623 [2024-11-28 04:34:28.693504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.693648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.693766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.693798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.693985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.694154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.694201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.694393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.694549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.694577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.694698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.694830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.694881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.695040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.695172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.695207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.695352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.695498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.695533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.695675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.695814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.695845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.695985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.696141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.696169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.696274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.696392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.696421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.696554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.696668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.696700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.696854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.696989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.697017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.697182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.697316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.697344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.697481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.697641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.697694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.697879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.697991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.698022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.698154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.698268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.698296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.698426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.698538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.698569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.698674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.698773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.698801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.698910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.699166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.699469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.699807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.699997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.700132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.700261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.700290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.700449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.700598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.700645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.700782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.700890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.700921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.701064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.701208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.701235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.701369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.701487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.701515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.701689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.701844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.701870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.702019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.702140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.702171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.624 qpair failed and we were unable to recover it. 00:27:51.624 [2024-11-28 04:34:28.702310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.624 [2024-11-28 04:34:28.702413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.702443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.702578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.702726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.702779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.702885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.702997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.703025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.703136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.703274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.703301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.703408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.703514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.703551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.703675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.703791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.703818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.703978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.704109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.704136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.704253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.704389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.704416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.704551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.704674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.704709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.704839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.704980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.705006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.705148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.705306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.705336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.705469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.705589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.705644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.705802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.705974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.706020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.706161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.706274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.706302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.706441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.706546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.706578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.706692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.706820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.706867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.706980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.707235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.707509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.707807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.707941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.708072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.708185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.708213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.708357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.708494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.708533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.708724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.708871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.708900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.709045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.709300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.709561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.709815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.709950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.710074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.710217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.710245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.625 [2024-11-28 04:34:28.710395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.710532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.625 [2024-11-28 04:34:28.710560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.625 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.710671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.710814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.710843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.710989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.711136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.711164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.711302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.711467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.711507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.711679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.711820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.711848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.711961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.712082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.712110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.712244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.712380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.712409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.712570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.712669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.712694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.712841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.712985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.713013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.713151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.713282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.713310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.713589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.713719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.713744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.713898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.714201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.714457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.714711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.714857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.715009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.715202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.715251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.715390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.715502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.715536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.715648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.715782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.715806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.715945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.716264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.716540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.716788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.716943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.717075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.717217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.717245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.717367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.717502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.717541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.717694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.717807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.717832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.717961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.718236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.718465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.718749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.718926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.626 [2024-11-28 04:34:28.719033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.719133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.626 [2024-11-28 04:34:28.719158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.626 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.719259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.719346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.719370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.719502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.719638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.719663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.719788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.719916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.719941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.720044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.720199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.720223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.720352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.720461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.720486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.720637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.720740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.720764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.720903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.721136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.721463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.721779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.721935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.722065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.722343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.722573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.722824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.722950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.723077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.723183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.723212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.723343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.723515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.723546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.723675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.723800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.723825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.723924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.724188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.724445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.724739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.724899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.725027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.725310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.725578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.725835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.725986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.627 qpair failed and we were unable to recover it. 00:27:51.627 [2024-11-28 04:34:28.726098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.627 [2024-11-28 04:34:28.726197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.726222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.726346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.726473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.726497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.726604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.726705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.726729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.726862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.726958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.726983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.727106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.727213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.727237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.727389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.727497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.727521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.727680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.727800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.727825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.727927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.728152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.728399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.728660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.728791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.728898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.729165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.729511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.729803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.729955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.730067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.730167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.730191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.730317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.730450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.730475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.730608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.730711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.730735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.730894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.731150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.731406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.731687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.731848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.731974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.732264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.732551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.732782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.732938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.733054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.733156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.733182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.733284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.733410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.733436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.733563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.733666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.733692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.628 qpair failed and we were unable to recover it. 00:27:51.628 [2024-11-28 04:34:28.733796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.628 [2024-11-28 04:34:28.733932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.733957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.734063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.734319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.734576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.734809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.734964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.735094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.735195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.735221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.735354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.735482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.735507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.735681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.735780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.735806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.735936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.736211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.736465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.736769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.736931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.737102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.737363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.737618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.737870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.737986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.738111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.738217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.738244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.738417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.738521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.738555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.738666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.738793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.738832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.738966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.739174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.739199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.739332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.739454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.739479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.739618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.739749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.739775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.739893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.739985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.740011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.740132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.740226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.740251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.740345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.740498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.740523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.740658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.740759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.740785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.740919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.741075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.741101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.741229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.741411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.741436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.741569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.741664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.741689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.629 qpair failed and we were unable to recover it. 00:27:51.629 [2024-11-28 04:34:28.741807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.629 [2024-11-28 04:34:28.741911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.741936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.742041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.742171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.742196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.742360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.742483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.742508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.742649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.742760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.742785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.742933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.743203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.743472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.743731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.743942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.744056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.744167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.744195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.744350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.744482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.744508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.744650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.744793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.744821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.744942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.745217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.745537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.745802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.745954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.746053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.746179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.746203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.746301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.746428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.746453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.746584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.746689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.746715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.746859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.747160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.747401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.747659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.747840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.747955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.748074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.748102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.748285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.748414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.748444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.748609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.748713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.748738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.748875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.749007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.749031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.749197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.749303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.749329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.749476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.749621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.749652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.749826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.749993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.750021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.630 qpair failed and we were unable to recover it. 00:27:51.630 [2024-11-28 04:34:28.750145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.630 [2024-11-28 04:34:28.750250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.750275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.750381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.750510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.750543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.750652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.750805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.750842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.750996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.751112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.751140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.751263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.751390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.751414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.751557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.751675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.751702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.751894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.752148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.752446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.752756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.752919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.753041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.753183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.753211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.753345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.753479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.753507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.753664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.753762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.753786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.753940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.754054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.754083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.754230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.754380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.754408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.754558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.754698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.754726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.754856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.754996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.755021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.755213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.755318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.755344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.755473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.755600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.755629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.755774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.755890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.755917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.756081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.756212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.756238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.756349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.756473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.756516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.756704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.756857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.756882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.756995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.757124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.757148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.757259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.757359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.757384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.757514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.757658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.757687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.757857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.758012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.758037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.758140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.758333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.758358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.758485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.758622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.631 [2024-11-28 04:34:28.758648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.631 qpair failed and we were unable to recover it. 00:27:51.631 [2024-11-28 04:34:28.758807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.758953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.758978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.759081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.759180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.759205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.759331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.759428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.759453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.759567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.759696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.759721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.759862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.760197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.760565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.760832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.760983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.761143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.761248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.761278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.761393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.761537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.761567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.761733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.761836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.761865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.761996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.762140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.762165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.762347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.762458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.762486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.762626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.762788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.762813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.762926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.763237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.763519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.763827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.763995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.764134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.764298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.764326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.764452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.764568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.764594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.764726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.764830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.764855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.765009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.765159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.765187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.765323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.765496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.765521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.765676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.765780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.765806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.765984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.766103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.766132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.766247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.766402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.632 [2024-11-28 04:34:28.766430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.632 qpair failed and we were unable to recover it. 00:27:51.632 [2024-11-28 04:34:28.766554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.766733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.766758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.766917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.767022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.767046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.767234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.767354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.767397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.767532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.767681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.767709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.767814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.767978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.768006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.768182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.768352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.768381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.768549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.768710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.768738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.768884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.768995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.769023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.769190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.769305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.769332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.769467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.769572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.769598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.769722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.769896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.769922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.770056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.770236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.770278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.770406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.770594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.770637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.770797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.770934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.770960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.771088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.771209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.771237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.771392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.771520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.771552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.771705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.771882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.771910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.772033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.772257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.772494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.772767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.772913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.773061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.773323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.773565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.773799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.773945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.774038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.774131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.774156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.774298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.774433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.774461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.774639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.774755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.774782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.774898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.775039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.633 [2024-11-28 04:34:28.775067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.633 qpair failed and we were unable to recover it. 00:27:51.633 [2024-11-28 04:34:28.775219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.775355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.775380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.775567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.775720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.775744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.775863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.776209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.776506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.776798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.776967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.777077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.777213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.777241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.777412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.777557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.777586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.777700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.777801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.777826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.777983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.778254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.778558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.778852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.778985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.779087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.779234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.779262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.779436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.779579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.779605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.779787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.779890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.779914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.780041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.780201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.780242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.780393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.780500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.780533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.780643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.780751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.780779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.780897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.781179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.781478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.781768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.781935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.782103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.782207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.782235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.782389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.782514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.782547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.782664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.782772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.782800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.782955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.783113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.783138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.783311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.783423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.783451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.783596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.783724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.634 [2024-11-28 04:34:28.783751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.634 qpair failed and we were unable to recover it. 00:27:51.634 [2024-11-28 04:34:28.783897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.784144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.784457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.784777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.784934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.785067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.785306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.785539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.785840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.785961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.786117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.786257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.786286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.786442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.786537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.786562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.786658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.786750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.786777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.786875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.787178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.787492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.787768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.787934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.788073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.788166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.788190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.788308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.788408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.788436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.788607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.788711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.788740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.788881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.789025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.789052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.789196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.789349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.789374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.789584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.789719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.789744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.789895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.790211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.790567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.790846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.790984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.791164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.791292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.791318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.791460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.791610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.791636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.791764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.791894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.791921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.792082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.792222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.635 [2024-11-28 04:34:28.792264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.635 qpair failed and we were unable to recover it. 00:27:51.635 [2024-11-28 04:34:28.792390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.792501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.792536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.792691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.792819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.792844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.792973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.793070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.793096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.793271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.793380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.793408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.793575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.793704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.793728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.793874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.793986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.794028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.794157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.794303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.794327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.794485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.794600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.794631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.794774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.794940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.794968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.795083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.795201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.795226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.795354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.795480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.795505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.795615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.795747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.795774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.795890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.796179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.796492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.796788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.796954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.797098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.797253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.797278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.797415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.797590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.797618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.797738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.797843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.797867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.798035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.798208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.798233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.798363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.798482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.798509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.798624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.798761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.798789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.798950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.799082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.799108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.799265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.799375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.799400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.799552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.799733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.799758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.799910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.800101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.800127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.800286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.800390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.800417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.800569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.800710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.800752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.636 qpair failed and we were unable to recover it. 00:27:51.636 [2024-11-28 04:34:28.800905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.801051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.636 [2024-11-28 04:34:28.801078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.801242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.801392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.801417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.801576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.801718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.801761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.801874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.802157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.802383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.802647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.802869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.802998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.803129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.803302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.803331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.803447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.803617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.803645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.803793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.803923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.803949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.804095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.804230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.804258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.804415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.804579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.804608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.804753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.804868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.804896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.805039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.805161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.805186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.805342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.805518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.805550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.805707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.805807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.805835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.805949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.806060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.806088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.806231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.806382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.806411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.806537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.806673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.806702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.806839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.806978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.807003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.807104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.807291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.807317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.807449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.807577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.807603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.807749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.807863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.807892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.807999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.808137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.808165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.808308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.808487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.808511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.637 [2024-11-28 04:34:28.808643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.808749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.637 [2024-11-28 04:34:28.808774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.637 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.808892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.809026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.809054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.809231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.809333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.809358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.809553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.809719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.809743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.809872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.810186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.810468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.810756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.810917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.811046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.811180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.811206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.811387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.811488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.811512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.811661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.811770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.811809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.811939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.812086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.812115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.812259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.812387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.812412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.812570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.812710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.812739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.812882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.812984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.813011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.813128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.813272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.813297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.813421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.813548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.813574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.813710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.813849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.813877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.814000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.814107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.814135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.814276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.814393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.814420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.814538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.814674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.814699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.814852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.814977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.815004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.815146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.815275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.815318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.815444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.815577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.815603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.815734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.815860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.815886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.816081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.816235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.816260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.816374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.816515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.816548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.816668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.816851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.816876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.817004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.817133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.817158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.638 qpair failed and we were unable to recover it. 00:27:51.638 [2024-11-28 04:34:28.817343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.817480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.638 [2024-11-28 04:34:28.817504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.817645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.817808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.817863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.818065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.818224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.818274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.818426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.818540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.818568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.818672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.818788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.818834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.818977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.819119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.819148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.819307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.819436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.819462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.819625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.819731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.819767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.819896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.820083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.820123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.820279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.820450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.820475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.820614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.820711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.820736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.820873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.821166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.821503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.821790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.821949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.822091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.822194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.822219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.822365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.822461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.822488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.822651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.822764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.822790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.822921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.823170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.823465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.823809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.823977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.824157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.824285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.824309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.824409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.824504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.824534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.824665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.824768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.824793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.824924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.825096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.825124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.825304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.825467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.825492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.825614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.825746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.825771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.825909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.826065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.826090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.639 qpair failed and we were unable to recover it. 00:27:51.639 [2024-11-28 04:34:28.826198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.826373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.639 [2024-11-28 04:34:28.826401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.826532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.826665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.826691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.826812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.826908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.826934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.827060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.827293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.827575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.827828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.827980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.828134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.828267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.828292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.828391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.828520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.828551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.828653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.828781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.828807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.828912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.829211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.829471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.829736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.829919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.830018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.830271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.830533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.830795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.830979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.831108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.831211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.831237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.831337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.831434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.831460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.831626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.831760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.831786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.831879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.831987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.832012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.832153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.832287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.832313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.832444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.832577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.832603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.832744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.832856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.832881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.833022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.833122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.833147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.833275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.833406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.833432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.833566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.833727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.833752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.833909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.834042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.834067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.640 qpair failed and we were unable to recover it. 00:27:51.640 [2024-11-28 04:34:28.834191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.834345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.640 [2024-11-28 04:34:28.834370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.834502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.834662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.834688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.834821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.834999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.835025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.835184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.835288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.835313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.835473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.835603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.835630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.835736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.835905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.835945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.836121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.836268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.836297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.836425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.836532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.836562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.836689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.836799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.836830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.836936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.837040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.837065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.837180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.837327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.837357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.837859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.838150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.838429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.838701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.838867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.838961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.839209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.839517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.839770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.839957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.840084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.840213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.840239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.840386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.840543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.840570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.840707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.840814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.840847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.840951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.841173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.841403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.841673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.841831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.641 qpair failed and we were unable to recover it. 00:27:51.641 [2024-11-28 04:34:28.841993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.842131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.641 [2024-11-28 04:34:28.842156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.842264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.842392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.842418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.842520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.842637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.842662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.842805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.842947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.842972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.843072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.843176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.843201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.843314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.843439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.843464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.843571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.843669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.843694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.843859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.843999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.844025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.844127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.844292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.844317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.844447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.844569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.844595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.844704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.844794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.844820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.844963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.845215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.845443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.845708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.845856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.845993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.846259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.846519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.846759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.846908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.847052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.847320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.847549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.847842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.847997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.848105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.848259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.848285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.848397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.848530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.848558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.848713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.848812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.848837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.848937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.849174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.849455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.642 qpair failed and we were unable to recover it. 00:27:51.642 [2024-11-28 04:34:28.849716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.642 [2024-11-28 04:34:28.849836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.849981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.850221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.850510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.850772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.850929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.851058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.851186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.851213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.851353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.851480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.851505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.851613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.851734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.851759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.851915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.852228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.852486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.852773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.852935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.853087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.853218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.853245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.853372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.853532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.853559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.853665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.853769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.853795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.853911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.854138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.854387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.854677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.854844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.854946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.855181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.855439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.855724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.855873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.855979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.856269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.856497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.856798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.856953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.857076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.857232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.857257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.857365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.857461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.857487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.643 qpair failed and we were unable to recover it. 00:27:51.643 [2024-11-28 04:34:28.857666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.857794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.643 [2024-11-28 04:34:28.857819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.857987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.858276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.858511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.858807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.858945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.859051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.859156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.859181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.859305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.859442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.859468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.859579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.859738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.859763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.859882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.860134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.860349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.860607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.860836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.860991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.861112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.861241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.861267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.861366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.861492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.861517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.861626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.861760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.861789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.861927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.862184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.862469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.862728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.862887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.863011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.863164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.863189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.863349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.863514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.863548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.863706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.863834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.863860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.863987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.864240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.864502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.864765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.864923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.865060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.865163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.865187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.865339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.865435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.865461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.644 qpair failed and we were unable to recover it. 00:27:51.644 [2024-11-28 04:34:28.865597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.865719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.644 [2024-11-28 04:34:28.865744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.865877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.866148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.866373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.866668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.866821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.866977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.867208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.867436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.867696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.867889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.867992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.868239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.868499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.868800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.868964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.869093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.869217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.869243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.869343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.869441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.869467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.869589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.869680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.869706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.869835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.869987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.870012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.870140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.870277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.870303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.870456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.870554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.870580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.870707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.870836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.870861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.871016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.871116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.871141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.871239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.871379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.871404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.871510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.871671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.871697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.871824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.871983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.872008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.872167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.872265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.872290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.872417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.872570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.872602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.872733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.872864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.872889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.873019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.873121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.873146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.873275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.873373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.873398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.645 qpair failed and we were unable to recover it. 00:27:51.645 [2024-11-28 04:34:28.873550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.873678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.645 [2024-11-28 04:34:28.873703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.873800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.873926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.873951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.874056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.874307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.874563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.874838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.874996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.875124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.875282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.875307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.875409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.875541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.875567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.875692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.875821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.875850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.875976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.876198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.876428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.876660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.876840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.876942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.877186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.877409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.877758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.877942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.878040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.878162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.878187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.878339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.878474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.878499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.878646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.878773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.878798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.878931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.879215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.879499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.879813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.879970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.880094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.880227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.880252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.880350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.880507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.880538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.646 qpair failed and we were unable to recover it. 00:27:51.646 [2024-11-28 04:34:28.880656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.646 [2024-11-28 04:34:28.880785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.880810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.880946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.881163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.881487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.881799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.881957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.882094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.882200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.882226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.882381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.882480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.882505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.882647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.882784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.882811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.882935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.883246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.883566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.883776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.883927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.884032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.884191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.884217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.884348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.884487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.884513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.884622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.884777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.884802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.884939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.885223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.885485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.885817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.885940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.886101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.886195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.886220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.886352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.886450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.886475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.886607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.886737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.886762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.886860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.886986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.887011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.887114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.887248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.887277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.887408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.887540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.887566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.887699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.887798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.887825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.887945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.888049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.888074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.888208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.888332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.888357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.888461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.888584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.888609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.647 qpair failed and we were unable to recover it. 00:27:51.647 [2024-11-28 04:34:28.888746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.647 [2024-11-28 04:34:28.888878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.888903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.889008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.889131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.889156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.889286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.889445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.889471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.889591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.889692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.889717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.889844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.889997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.890023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.890150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.890278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.890303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.890431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.890562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.890588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.890744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.890874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.890899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.891030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.891272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.891513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.648 [2024-11-28 04:34:28.891766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.648 [2024-11-28 04:34:28.891941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.648 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.892037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.932 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.892257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.932 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.892570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.932 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.892837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.892995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.932 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.893095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.893251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.893276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.932 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.893415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.893516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.893549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.932 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.893647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.893771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.932 [2024-11-28 04:34:28.893796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.932 qpair failed and we were unable to recover it. 00:27:51.932 [2024-11-28 04:34:28.893902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.893999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.894024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.894133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.894258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.894283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.894440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.894568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.894594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.894746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.894883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.894908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.895004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.895244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.895535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.895794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.895915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.896045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.896298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.896545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.896800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.896950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.897074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.897208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.897233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.897366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.897497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.897522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.897663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.897818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.897844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.897988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.898101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.898145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.898304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.898431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.898456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.898608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.898786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.898811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.898964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.899108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.899134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.899291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.899448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.899473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.899624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.899768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.899797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.900021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.900260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.900288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.900440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.900543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.900586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.900755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.900921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.900949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.901109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.901275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.901300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.901425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.901544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.901587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.901752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.901863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.901919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.902089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.902227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.902253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.933 [2024-11-28 04:34:28.902347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.902477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.933 [2024-11-28 04:34:28.902503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.933 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.902643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.902769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.902794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.902912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.903033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.903075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.903247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.903343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.903370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.903481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.903634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.903663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.903834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.903999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.904045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.904216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.904314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.904339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.904464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.904613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.904642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.904816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.904984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.905012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.905177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.905347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.905372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.905572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.905739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.905767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.905905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.906069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.906097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.906243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.906400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.906425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.906580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.906720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.906745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.906840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.907179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.907472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.907761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.907929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.908062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.908178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.908203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.908334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.908465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.908490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.908620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.908779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.908807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.908968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.909210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.909490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.909778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.909932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.910028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.910182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.910207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.910366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.910469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.910494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.910604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.910730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.910755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.910908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.911057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.911085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.934 [2024-11-28 04:34:28.911235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.911401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.934 [2024-11-28 04:34:28.911427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.934 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.911571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.911773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.911801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.911968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.912145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.912173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.912295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.912415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.912441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.912582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.912727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.912772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.912954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.913263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.913497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.913812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.913943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.914098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.914220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.914245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.914364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.914503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.914535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.914632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.914761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.914787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.914894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.915185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.915455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.915699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.915859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.915987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.916263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.916549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.916800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.916954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.917054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.917155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.917186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.917315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.917443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.917469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.917593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.917697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.917722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.917823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.917976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.918001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.918126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.918254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.918279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.918411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.918543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.918569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.918695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.918817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.918843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.918965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.919087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.919112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.919272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.919375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.919400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.935 qpair failed and we were unable to recover it. 00:27:51.935 [2024-11-28 04:34:28.919554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.919682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.935 [2024-11-28 04:34:28.919707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.919803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.919935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.919961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.920121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.920253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.920279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.920380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.920504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.920535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.920636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.920767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.920792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.920915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.921167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.921444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.921754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.921874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.922028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.922181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.922207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.922336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.922490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.922516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.922652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.922747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.922772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.922907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.923129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.923409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.923696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.923850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.923997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.924223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.924540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.924824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.924946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.925075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.925206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.925231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.925387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.925491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.925517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.925679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.925795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.925820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.925953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.926240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.926531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.926811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.926934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.927097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.927224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.927248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.927413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.927515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.927546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.936 [2024-11-28 04:34:28.927673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.927803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.936 [2024-11-28 04:34:28.927828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.936 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.927957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.928238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.928456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.928735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.928857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.928994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.929261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.929483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.929770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.929924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.930042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.930169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.930195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.930324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.930456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.930481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.930648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.930739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.930763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.930897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.931196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.931422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.931672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.931833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.931961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.932242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.932505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.932737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.932893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.933018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.933237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.933486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.933799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.933954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.934078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.934203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.934227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.937 qpair failed and we were unable to recover it. 00:27:51.937 [2024-11-28 04:34:28.934334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.937 [2024-11-28 04:34:28.934444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.934469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.934602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.934724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.934750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.934876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.934968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.934994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.935127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.935219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.935245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.935398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.935501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.935533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.935650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.935771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.935796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.935947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.936178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.936460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.936776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.936957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.937051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.937341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.937595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.937822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.937976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.938135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.938258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.938283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.938409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.938541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.938568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.938694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.938799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.938825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.938960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.939241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.939545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.939829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.939980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.940115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.940239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.940264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.940394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.940551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.940577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.940702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.940802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.940826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.940932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.941195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.941437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.941720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.941864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.941992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.942146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.942171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.938 qpair failed and we were unable to recover it. 00:27:51.938 [2024-11-28 04:34:28.942301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.938 [2024-11-28 04:34:28.942453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.942482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.942680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.942813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.942838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.942982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.943119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.943148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.943308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.943511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.943545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.943646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.943779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.943805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.943936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.944217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.944460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.944711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.944864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.945016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.945301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.945552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.945849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.945976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.946106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.946233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.946258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.946384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.946512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.946548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.946657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.946786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.946812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.946950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.947204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.947460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.947765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.947920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.948053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.948183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.948207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.948371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.948500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.948533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.948640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.948743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.948768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.948890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.949184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.949474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.949762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.949953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.950077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.950208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.950233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.950365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.950533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.950560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.939 qpair failed and we were unable to recover it. 00:27:51.939 [2024-11-28 04:34:28.950717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.939 [2024-11-28 04:34:28.950841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.950865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.951023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.951147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.951172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.951294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.951433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.951458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.951618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.951732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.951757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.951927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.952184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.952434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.952695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.952818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.952927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.953180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.953427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.953733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.953887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.954017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.954146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.954171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.954333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.954502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.954534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.954664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.954788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.954813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.954943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.955238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.955511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.955799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.955924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.956060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.956191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.956218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.956371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.956492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.956517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.956689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.956825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.956850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.956997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.957286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.957558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.957847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.957997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.958150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.958247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.958272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.958378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.958503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.958534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.958641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.958767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.958792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.940 qpair failed and we were unable to recover it. 00:27:51.940 [2024-11-28 04:34:28.958927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.940 [2024-11-28 04:34:28.959079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.959105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.959233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.959357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.959381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.959542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.959648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.959673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.959802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.959929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.959954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.960084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.960210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.960235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.960345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.960470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.960495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.960633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.960787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.960812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.960948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.961176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.961459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.961714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.961888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.962064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.962216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.962241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.962394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.962533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.962559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.962717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.962871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.962897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.963062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.963188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.963214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.963340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.963467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.963492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.963625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.963735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.963760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.963890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.964222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.964508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.964823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.964973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.965104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.965208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.965232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.965362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.965515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.965566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.965672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.965769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.965794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.965899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.966056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.966081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.966203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.966331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.941 [2024-11-28 04:34:28.966355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.941 qpair failed and we were unable to recover it. 00:27:51.941 [2024-11-28 04:34:28.966487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.966650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.966676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.966802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.966932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.966957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.967112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.967212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.967238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.967369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.967493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.967518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.967664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.967794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.967820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.967951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.968237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.968493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.968731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.968883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.968984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.969265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.969577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.969836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.969962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.970093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.970220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.970244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.970372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.970502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.970532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.970636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.970760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.970786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.970941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.971195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.971469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.971729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.971853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.972011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.972177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.972202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.972304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.972456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.972482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.972620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.972755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.972779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.972917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.973202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.973456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.973735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.973887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.974016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.974140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.974165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.942 [2024-11-28 04:34:28.974269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.974419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.942 [2024-11-28 04:34:28.974443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.942 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.974608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.974765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.974790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.974924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.975199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.975453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.975699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.975821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.975954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.976195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.976456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.976695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.976813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.976915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.977069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.977095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.977222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.977378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.977402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.977573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.977683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.977708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.977865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.977999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.978023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.978122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.978277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.978301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.978400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.978552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.978582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.978740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.978842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.978868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.978999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.979256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.979517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.979783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.979937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.980099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.980223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.980248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.980376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.980474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.980499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.980645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.980744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.980768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.980875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.980977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.981002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.981156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.981285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.981312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.981467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.981595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.981622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.981756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.981910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.981935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.982092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.982183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.982208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.943 [2024-11-28 04:34:28.982329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.982459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.943 [2024-11-28 04:34:28.982484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.943 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.982617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.982771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.982796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.982926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.983220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.983462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.983725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.983852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.983950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.984211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.984532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.984792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.984975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.985103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.985228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.985253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.985385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.985510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.985544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.985650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.985782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.985807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.985940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.986226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.986511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.986756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.986915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.987009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.987301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.987576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.987847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.987995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.988099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.988251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.988277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.988402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.988535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.988560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.988675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.988780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.988805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.988932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.989183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.989466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.989732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.989916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.990020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.990125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.990151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.944 [2024-11-28 04:34:28.990282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.990437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.944 [2024-11-28 04:34:28.990462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.944 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.990566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.990694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.990719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.990830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.990983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.991007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.991160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.991288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.991314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.991467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.991598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.991625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.991759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.991887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.991912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.992045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.992351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.992592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.992867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.992992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.993124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.993247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.993272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.993432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.993574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.993599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.993756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.993885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.993910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.994044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.994172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.994197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.994302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.994458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.994484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.994637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.994766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.994792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.994895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.995187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.995496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.995810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.995962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.996069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.996202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.996228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.996353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.996512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.996545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.996680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.996808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.996833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.996942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.997227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.997508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.997774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.997955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.998063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.998225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.998250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.998371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.998494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.998519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.945 [2024-11-28 04:34:28.998638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.998793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.945 [2024-11-28 04:34:28.998818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.945 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:28.998976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:28.999270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:28.999540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:28.999873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:28.999999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.000123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.000252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.000278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.000383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.000547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.000574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.000702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.000830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.000856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.000986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.001115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.001140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.001281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.001403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.001427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.001534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.001668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.001693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.001859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.001985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.002011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.002165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.002302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.002328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.002434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.002565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.002591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.002691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.002798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.002824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.002928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.003214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.003494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.003741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.003858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.004012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.004274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.004561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.004842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.004995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.005153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.005257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.005282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.005441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.005571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.005596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.005703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.005795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.005821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.946 [2024-11-28 04:34:29.005982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.006142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.946 [2024-11-28 04:34:29.006167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.946 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.006296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.006455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.006480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.006638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.006771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.006797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.006907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.007197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.007483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.007707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.007884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.008016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.008170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.008195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.008333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.008444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.008469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.008609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.008770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.008795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.008897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.008998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.009028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.009161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.009321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.009347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.009468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.009602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.009628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.009758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.009886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.009912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.010019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.010147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.010173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.010304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.010410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.010434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.010587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.010746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.010771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.010871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.011155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.011444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.011718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.011869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.012028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.012183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.012209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.012317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.012441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.012466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.012601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.012731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.012756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.012857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.012986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.013012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.013173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.013328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.013352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.013480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.013633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.013658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.013768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.013923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.013948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.014050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.014179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.014205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.947 [2024-11-28 04:34:29.014363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.014489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.947 [2024-11-28 04:34:29.014514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.947 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.014649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.014780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.014805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.014917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.015197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.015471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.015750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.015876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.016039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.016324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.016575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.016826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.016983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.017115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.017221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.017246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.017353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.017484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.017509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.017628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.017751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.017776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.017906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.018185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.018478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.018755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.018911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.019017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.019173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.019198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.019330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.019486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.019511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.019634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.019765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.019790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.019920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.020203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.020511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.020797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.020981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.021085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.021211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.021237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.021337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.021474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.021500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.021630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.021756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.021780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.021883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.021977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.022003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.022131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.022253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.022277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.948 qpair failed and we were unable to recover it. 00:27:51.948 [2024-11-28 04:34:29.022384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.022509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.948 [2024-11-28 04:34:29.022543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.022646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.022747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.022772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.022931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.023207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.023489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.023781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.023936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.024040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.024299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.024553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.024786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.024910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.025038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.025190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.025214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.025345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.025481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.025506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.025668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.025802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.025827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.025956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.026270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.026535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.026799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.026954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.027080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.027238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.027263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.027391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.027487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.027511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.027659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.027763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.027787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.027914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.028223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.028556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.028777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.028930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.029064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.029188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.029213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.029348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.029480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.029505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.029641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.029749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.029776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.029906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.030059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.030084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.030183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.030308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.030332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.949 qpair failed and we were unable to recover it. 00:27:51.949 [2024-11-28 04:34:29.030435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.030560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.949 [2024-11-28 04:34:29.030586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.030718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.030846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.030870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.030973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.031287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.031577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.031831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.031965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.032093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.032218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.032242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.032342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.032497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.032523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.032664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.032794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.032819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.032976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.033280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.033542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.033800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.033920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.034078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.034232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.034257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.034412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.034515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.034546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.034655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.034753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.034781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.034917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.035166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.035383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.035655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.035829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.035959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.036251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.036508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.036845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.036999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.037113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.037219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.037245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.037370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.037472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.037504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.950 qpair failed and we were unable to recover it. 00:27:51.950 [2024-11-28 04:34:29.037641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.037768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.950 [2024-11-28 04:34:29.037793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.037947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.038224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.038515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.038806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.038957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.039090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.039197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.039224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.039383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.039514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.039549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.039697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.039798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.039824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.039924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.040209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.040509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.040809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.040976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.041129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.041228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.041255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.041412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.041569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.041596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.041755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.041857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.041884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.042038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.042166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.042192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.042334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.042433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.042459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.042589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.042720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.042747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.042877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.043195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.043460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.043751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.043910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.044022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.044306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.044567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.044853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.044998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.045155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.045284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.045310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.045416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.045564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.045591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.951 qpair failed and we were unable to recover it. 00:27:51.951 [2024-11-28 04:34:29.045687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.045846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.951 [2024-11-28 04:34:29.045872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.045979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.046114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.046140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.046251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.046376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.046402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.046559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.046686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.046712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.046864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.046991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.047016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.047143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.047243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.047268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.047375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.047504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.047540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.047639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.047770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.047796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.047929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.048239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.048549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.048805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.048958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.049100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.049226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.049252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.049379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.049486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.049514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.049661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.049816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.049842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.050004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.050122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.050152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.050343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.050505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.050542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.050688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.050789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.050815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.050953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.051241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.051495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.051764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.051952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.052061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.052199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.052224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.052351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.052459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.052486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.052625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.052758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.052783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.052942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.053096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.053122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.053278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.053430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.053455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.053604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.053728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.053754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.053887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.054044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.952 [2024-11-28 04:34:29.054070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.952 qpair failed and we were unable to recover it. 00:27:51.952 [2024-11-28 04:34:29.054199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.054324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.054350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.054458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.054561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.054588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.054719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.054844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.054870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.055029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.055125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.055153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.055308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.055468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.055494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.055634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.055764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.055789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.055892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.056177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.056403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.056659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.056783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.056943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.057235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.057514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.057787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.057965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.058061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.058212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.058238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.058388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.058562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.058589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.058692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.058846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.058871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.059002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.059130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.059157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.059290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.059424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.059450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.059616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.059751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.059778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.059932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.060205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.060518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.060816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.060945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.061065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.061167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.061192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.061296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.061457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.061484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.061629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.061783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.061809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.061938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.062064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.062091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.953 [2024-11-28 04:34:29.062221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.062352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.953 [2024-11-28 04:34:29.062378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.953 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.062507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.062613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.062640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.062751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.062855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.062881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.062989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.063293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.063531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.063771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.063922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.064055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.064211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.064237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.064395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.064548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.064575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.064709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.064814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.064841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.064936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.065239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.065488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.065760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.065929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.066028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.066184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.066210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.066308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.066450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.066477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.066614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.066718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.066744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.066869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.066976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.067003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.067131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.067283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.067310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.067442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.067570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.067598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.067735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.067863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.067889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.068019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.068172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.068198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.068303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.068427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.068453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.068560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.068694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.068721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.068858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.069204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.069475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.069716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.069843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.069972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.070072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.070099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.954 qpair failed and we were unable to recover it. 00:27:51.954 [2024-11-28 04:34:29.070250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.954 [2024-11-28 04:34:29.070407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.070433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.070569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.070670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.070697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.070793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.070892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.070919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.071086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.071216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.071242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.071392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.071549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.071575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.071682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.071813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.071839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.071998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.072106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.072133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.072241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.072340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.072366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.072500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.072677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.072704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.072860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.073181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.073441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.073726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.073887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.073997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.074102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.074130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.074237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.074391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.074417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.074559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.074696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.074722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.074859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.074990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.075016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.075171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.075298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.075324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.075456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.075617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.075644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.075777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.075884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.075910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.076074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.076204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.076231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.076360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.076490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.076516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.076656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.076781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.076808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.076909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.077039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.077065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.077222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.077353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.077380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.955 [2024-11-28 04:34:29.077510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.077674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.955 [2024-11-28 04:34:29.077700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.955 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.077802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.077906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.077937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.078047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.078178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.078205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.078320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.078445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.078472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.078611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.078746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.078772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.078898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.078993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.079019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.079130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.079234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.079261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.079373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.079508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.079544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.079720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.079849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.079875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.080032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.080317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.080556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.080815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.080974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.081076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.081201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.081229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.081355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.081511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.081546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.081671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.081812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.081840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.081991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.082215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.082439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.082734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.082872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.083001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.083258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.083530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.083781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.083928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.084053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.084209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.084241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.084374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.084507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.084561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.084700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.084858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.084884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.084999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.085130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.085156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.085282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.085389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.085415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.956 qpair failed and we were unable to recover it. 00:27:51.956 [2024-11-28 04:34:29.085544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.085651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.956 [2024-11-28 04:34:29.085678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.085843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.086130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.086362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.086656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.086809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.086910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.087160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.087419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.087706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.087867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.087994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.088252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.088514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.088766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.088971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.089133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.089230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.089257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.089388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.089519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.089555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.089665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.089769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.089796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.089926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.090210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.090463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.090726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.090852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.090949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.091204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.091468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.091710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.091870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.091975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.092072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.092098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.092194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.092331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.092367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.092506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.092664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.957 [2024-11-28 04:34:29.092692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.957 qpair failed and we were unable to recover it. 00:27:51.957 [2024-11-28 04:34:29.092793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.092903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.092931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.093031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.093156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.093183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.093326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.093485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.093511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.093625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.093752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.093780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.093938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.094479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.094512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.094702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.094825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.094853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.094962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.095225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.095496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.095823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.095962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.096059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.096162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.096188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.096313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.096419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.096447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.096554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.096689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.096716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.096822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.096979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.097006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.097146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.097312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.097339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.097443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.097581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.097608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.097776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.097905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.097932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.098039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.098173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.098202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.098302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.098457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.098484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.098602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.098696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.098723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.098869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.098979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.099005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.099116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.099221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.099248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.099386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.099488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.099514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.958 qpair failed and we were unable to recover it. 00:27:51.958 [2024-11-28 04:34:29.099660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.958 [2024-11-28 04:34:29.099751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.099779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.099914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.100161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.100510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.100781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.100987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.101118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.101244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.101272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.101403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.101558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.101586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.101697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.101830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.101857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.101969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.102235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.102532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.102799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.102965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.103109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.103205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.103232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.103413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.103556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.103602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.103735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.103886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.103912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.104039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.104167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.104193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.104315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.104436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.104462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.104581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.104717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.104745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.104874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.104978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.105005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.105140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.105243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.105269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.105406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.105563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.105590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.105691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.105820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.105846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.105955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.106061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.106087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.106247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.106411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.106437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.106540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.106654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.106682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.106836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.107001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.107028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.107135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.107263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.107289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.107453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.107560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.107589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.959 qpair failed and we were unable to recover it. 00:27:51.959 [2024-11-28 04:34:29.107694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.959 [2024-11-28 04:34:29.107791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.107818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.107959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.108214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.108473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.108752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.108907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.109079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.109245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.109290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.109423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.109591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.109618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.109717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.109825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.109853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.109983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.110239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.110503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.110803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.110929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.111055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.111188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.111214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.111343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.111474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.111501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.111641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.111796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.111822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.111922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.112203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.112463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.112736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.112904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.113000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.113126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.113152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.113267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.113425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.113451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.113576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.113732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.113758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.960 [2024-11-28 04:34:29.113920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.114070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.960 [2024-11-28 04:34:29.114098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.960 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.114254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.114382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.114408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.114521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.114682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.114726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.114834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.114964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.114990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.115114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.115241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.115269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.115401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.115532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.115559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.115671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.115798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.115823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.115921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.116215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.116480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.116766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.116974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.117132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.117228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.117253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.117377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.117499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.117533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.117685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.117795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.117822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.117953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.118235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.118533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.118859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.118993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.119091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.119221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.119247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.119367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.119500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.119543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.119702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.119808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.119834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.119968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.120222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.120444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.961 qpair failed and we were unable to recover it. 00:27:51.961 [2024-11-28 04:34:29.120710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.961 [2024-11-28 04:34:29.120859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.121025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.121290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.121523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.121771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.121932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.122031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.122277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.122517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.122809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.122949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.123048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.123294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.123519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.123793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.123976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.124101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.124229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.124255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.124411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.124511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.124545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.124655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.124773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.124798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.124904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.125174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.125408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.125649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.125803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.125944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.126046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.126073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.126202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.126342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.126368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.126534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.126665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.126691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.126838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.126971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.127000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.127163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.127310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.127337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.127498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.127604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.127630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.127760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.127866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.127892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.128027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.128157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.128182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.128284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.128406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.962 [2024-11-28 04:34:29.128431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.962 qpair failed and we were unable to recover it. 00:27:51.962 [2024-11-28 04:34:29.128555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.128657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.128688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.128784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.128953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.128990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.129096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.129226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.129252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.129347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.129456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.129483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.129630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.129733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.129759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.129914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.130149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.130401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.130677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.130824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.130925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.131189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.131440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.131707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.131838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.131973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.132283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.132518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.132800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.132982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.133111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.133275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.133300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.133441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.133575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.133602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.133710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.133831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.133857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.133988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.134143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.134169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.134324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.134433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.134459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.134593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.134768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.134812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.134955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.135096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.135122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.135250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.135390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.135416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.135555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.135686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.135712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.135871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.136002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.136028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.136159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.136285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.136310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.963 qpair failed and we were unable to recover it. 00:27:51.963 [2024-11-28 04:34:29.136413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.136514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.963 [2024-11-28 04:34:29.136547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.136680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.136811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.136837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.136965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.137096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.137123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.137260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.137388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.137415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.137514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.137672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.137717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.137863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.137978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.138006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.138133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.138234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.138260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.138395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.138532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.138559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.139412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.139568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.139597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.139734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.139884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.139911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.140043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.140145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.140169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.140323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.140425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.140451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.140580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.140691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.140717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.140866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.141156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.141416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.141691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.141942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.142093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.142201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.142227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.142357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.142487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.142514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.142674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.142852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.142881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.143033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.143190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.143215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.143343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.143501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.143535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.143667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.143835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.143882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.144034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.144149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.144175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.144302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.144407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.144432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.144575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.144705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.144732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.144864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.145022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.145048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.145184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.145315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.145341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.145468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.145648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.145693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.964 qpair failed and we were unable to recover it. 00:27:51.964 [2024-11-28 04:34:29.145823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.964 [2024-11-28 04:34:29.145990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.146033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.146159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.146261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.146286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.146397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.146555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.146582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.146751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.146851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.146877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.147012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.147140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.147168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.147267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.147395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.147422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.147549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.147710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.147737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.147845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.148161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.148422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.148707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.148877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.148984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.149248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.149492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.149767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.149894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.149989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.150251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.150571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.150804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.150959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.151064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.151165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.151190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.151312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.151444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.151470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.151591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.151737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.151781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.151903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.152032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.152058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.152189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.152290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.152316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.152452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.152559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.152595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.965 qpair failed and we were unable to recover it. 00:27:51.965 [2024-11-28 04:34:29.152720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.965 [2024-11-28 04:34:29.152828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.152854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.152981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.153271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.153535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.153771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.153933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.154031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.154295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.154553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.154793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.154948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.155092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.155193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.155219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.155350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.155453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.155480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.155617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.155745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.155788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.155937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.156062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.156089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.156216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.156350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.156375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.156492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.156653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.156697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.156827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.156975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.157002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.157156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.157276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.157302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.157405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.157538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.157566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.157676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.157774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.157800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.157901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.158031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.158056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.158191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.158290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.158315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.966 qpair failed and we were unable to recover it. 00:27:51.966 [2024-11-28 04:34:29.158416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.158517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.966 [2024-11-28 04:34:29.158557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.158688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.158854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.158880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.159017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.159156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.159181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.159311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.159418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.159445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.159631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.159783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.159828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.159986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.160205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.160466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.160699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.160842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.160945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.161251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.161488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.161758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.161953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.162110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.162237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.162262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.162372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.162495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.162521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.162634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.162757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.162782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.162886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.163182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.163455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.163710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.163839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.163967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.164073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.164100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.164259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.164392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.164418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.164566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.164735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.164778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.164932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.165208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.165470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.165733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.165869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.166000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.166131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.166158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.967 [2024-11-28 04:34:29.166258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.166396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.967 [2024-11-28 04:34:29.166422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.967 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.166529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.166661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.166686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.166815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.166916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.166942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.167064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.167192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.167218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.167351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.167491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.167517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.167666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.167769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.167795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.167905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.168182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.168442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.168728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.168925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.169054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.169292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.169536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.169822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.169977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.170098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.170196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.170222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.170321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.170441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.170467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.170613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.170774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.170829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.170966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.171264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.171514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.171821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.171951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.172108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.172243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.172270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.172400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.172529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.172556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.172709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.172845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.172889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.173011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.173156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.173181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.173286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.173415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.173440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.173549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.173668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.173714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.173857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.174012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.174057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.174153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.174311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.174346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.968 qpair failed and we were unable to recover it. 00:27:51.968 [2024-11-28 04:34:29.174482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.174636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.968 [2024-11-28 04:34:29.174683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.174836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.174985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.175015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.175153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.175286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.175312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.175418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.175518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.175551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.175700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.175844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.175889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.176001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.176141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.176167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.176323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.176456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.176483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.176595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.176697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.176724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.176825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.176984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.177011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.177112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.177210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.177237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.177407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.177502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.177535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.177647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.177749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.177775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.177887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.178172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.178441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.178692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.178853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.178988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.179281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.179508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.179742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.179898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.180063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.180198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.180224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.180351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.180455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.180481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.180637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.180751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.180808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.180909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.181158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.181441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.181755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.181885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.969 qpair failed and we were unable to recover it. 00:27:51.969 [2024-11-28 04:34:29.182015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.182116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.969 [2024-11-28 04:34:29.182142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.182268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.182394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.182420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.182521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.182657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.182683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.182783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.182913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.182939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.183068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.183196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.183223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.183323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.183446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.183472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.183591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.183721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.183764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.183880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.184139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.184415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.184647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.184771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.184898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.185131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.185415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.185739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.185918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.186019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.186270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.186553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.186824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.186955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.187061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.187318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.187553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.187828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.187948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.188076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.188181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.188215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.188345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.188484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.188509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.188639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.188792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.188841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.970 [2024-11-28 04:34:29.188969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.189121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.970 [2024-11-28 04:34:29.189147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.970 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.189252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.189380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.189406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.189569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.189676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.189702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.189815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.189918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.189943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.190085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.190213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.190239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.190340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.190477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.190503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.190627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.190717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.190742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.190902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.191003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.191029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.191155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.191277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.191303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.191443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.191612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.191657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.191813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.191991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.192035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.192164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.192262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.192288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.192404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.192509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.192541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.192694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.192853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.192879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.193020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.193176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.193202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.193330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.193424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.193450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.193548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.193679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.193723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.193846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.193988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.194014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.194168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.194277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.194304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.194436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.194581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.194610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.194731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.194834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.194861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.194957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.195243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.195500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.195828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.195998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.196102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.196209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.196234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.196357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.196462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.196487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.196619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.196765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.196796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.196957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.197088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.197115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.971 qpair failed and we were unable to recover it. 00:27:51.971 [2024-11-28 04:34:29.197248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.971 [2024-11-28 04:34:29.197377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.197403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.197590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.197712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.197738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.197867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.197964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.197990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.198081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.198185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.198212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.198340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.198471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.198497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.198643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.198751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.198796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.198923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.199219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.199477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.199739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.199888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.200021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.200289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.200545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.200785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.200976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.201073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.201205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.201230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.201360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.201485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.201510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.201626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.201790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.201833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.201986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.202138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.202164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.202264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.202362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.202389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.202520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.202677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.202721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.202870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.203172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.203446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.203719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.203880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.203981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.204306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.204539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.204861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.204991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.972 [2024-11-28 04:34:29.205123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.205291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.972 [2024-11-28 04:34:29.205317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.972 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.205447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.205554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.205581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.205736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.205884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.205914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.206056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.206164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.206190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.206293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.206434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.206460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.206587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.206734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.206760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.206905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.207210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.207484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.207722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.207848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.208011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.208114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.208140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.208270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.208382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.208407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.208549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.208666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.208692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.208854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.209199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.209477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.209772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.209950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.210079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.210347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.210600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.210860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.210982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.211105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.211204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.211230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.211366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.211459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.211489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.211605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.211702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.211729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.211841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.211981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.212007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.212118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.212225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.212252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.212360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.212489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.212514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.212647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.212779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.212805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.212924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.213053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.213079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.973 qpair failed and we were unable to recover it. 00:27:51.973 [2024-11-28 04:34:29.213213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.213314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.973 [2024-11-28 04:34:29.213340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.213467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.213595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.213625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.213774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.213877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.213902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.213997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.214123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.214153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.214316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.214420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.214447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.214560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.214685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.214711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.214842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.214995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.215021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.215118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.215274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.215300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.215413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.215519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.215553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.215706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.215831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.215861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.215997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.216261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.216544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.216867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.216999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.217129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.217234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.217262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.217378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.217504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.217553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.217664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.217771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:51.974 [2024-11-28 04:34:29.217798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:51.974 qpair failed and we were unable to recover it. 00:27:51.974 [2024-11-28 04:34:29.217940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.218183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.218448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.218705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.218866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.218971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.219126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.219151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.219276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.219400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.219426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.219537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.219679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.219727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.219853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.219999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.220024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.220155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.220260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.220286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.245 qpair failed and we were unable to recover it. 00:27:52.245 [2024-11-28 04:34:29.220396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.245 [2024-11-28 04:34:29.220508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.220540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.220686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.220823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.220849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.220948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.221157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.221413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.221654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.221784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.221890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.222022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.222055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.222184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.222326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.222352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.222492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.222681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.222724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.222864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.222992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.223017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.223136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.223293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.223319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.223478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.223660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.223689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.223824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.223988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.224158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.224396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.224632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.224868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.224997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.225122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.225340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.225644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.225891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.225991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.226016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.226139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.226284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.226310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.226412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.226535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.226561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.226687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.226835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.226860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.226963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.227088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.227115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.227249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.227383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.227409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.227510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.227652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.227681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.227845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.228182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.228462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.228714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.228930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.229083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.229214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.229251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.229406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.229520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.229554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.229671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.229833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.229862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.230018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.230114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.230140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.230297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.230438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.230463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.230620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.230756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.230802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.230947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.231087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.231131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.231260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.231385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.231411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.231536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.231728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.231774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.231928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.232074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.232100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.232203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.232326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.232352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.232479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.232626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.232672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.232817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.232961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.233004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.233128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.233267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.233293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.233433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.233599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.233628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.246 qpair failed and we were unable to recover it. 00:27:52.246 [2024-11-28 04:34:29.233756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.233901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.246 [2024-11-28 04:34:29.233928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.234059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.234322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.234604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.234823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.234937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.235071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.235164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.235190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.235289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.235418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.235443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.235585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.235722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.235748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.235860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.235984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.236011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.236121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.236251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.236278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.236377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.236475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.236500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.236602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.236716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.236745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.236872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.237152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.237416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.237673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.237799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.237930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf80600 is same with the state(5) to be set 00:27:52.247 [2024-11-28 04:34:29.238114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.238227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.238256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.238393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.238500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.238535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.238772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.238888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.238918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.239062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.239174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.239203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.239347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.239520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.239572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.239668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.239811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.239839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.239969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.240289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.240571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.240826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.240994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.241136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.241303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.241331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.241471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.241603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.241630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.241729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.241884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.241909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.242141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.242281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.242309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.242421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.242543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.242588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.242677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.242804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.242832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.242943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.243214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.243522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.243750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.243901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.244049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.244166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.244195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.244331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.244472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.244500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.244642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.244747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.244776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.244964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.245121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.245151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.245326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.245463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.245492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.245627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.245758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.245784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.245944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.246049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.246078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.246251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.246377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.246403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.247 qpair failed and we were unable to recover it. 00:27:52.247 [2024-11-28 04:34:29.246578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.246710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.247 [2024-11-28 04:34:29.246735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.246891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.246997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.247024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.247139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.247275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.247303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.247447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.247605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.247631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.247772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.247954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.247980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.248102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.248237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.248265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.248414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.248560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.248604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.248711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.248833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.248861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.249035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.249290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.249555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.249805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.249956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.250081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.250223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.250251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.250363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.250534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.250577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.250702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.250798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.250823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.250979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.251242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.251466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.251722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.251902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.252011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.252114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.252140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.252299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.252444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.252471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.252615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.252720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.252745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.252883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.252986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.253013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.253190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.253309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.253335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.253485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.253621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.253647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.253744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.253890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.253916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.254076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.254215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.254242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.254355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.254502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.254534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.254658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.254756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.254786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.254918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.255243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.255539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.255796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.255963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.256064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.256163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.256189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.256296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.256427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.256453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.256574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.256690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.256715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.256848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.257176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.257455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.257715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.257887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.258032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.258159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.258184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.258315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.258428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.258454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.258564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.258705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.258730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.258898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.258999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.259025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.259144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.259271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.259296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.259406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.259507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.259538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.248 qpair failed and we were unable to recover it. 00:27:52.248 [2024-11-28 04:34:29.259659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.248 [2024-11-28 04:34:29.259810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.259835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.259937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.260186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.260460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.260698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.260829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.260963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.261199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.261479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.261762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.261937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.262042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.262175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.262201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.262337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.262435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.262461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.262595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.262712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.262748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.262944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.263094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.263129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.263315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.263479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.263516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.263681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.263787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.263812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.263939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.264183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.264448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.264712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.264881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.264981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.265250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.265562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.265801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.265957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.266052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.266197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.266223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.266321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.266451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.266476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.266618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.266753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.266778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.266913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.267176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.267481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.267766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.267889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.268014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.268300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.268554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.268821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.268982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.269110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.269332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.269610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.269840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.269992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.270121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.270225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.270251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.270382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.270489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.270514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.270653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.270787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.270812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.270984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.271300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.271563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.271856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.271979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.272133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.272355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.272589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.272813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.272989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.273083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.273212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.273238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.273373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.273470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.273495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.249 qpair failed and we were unable to recover it. 00:27:52.249 [2024-11-28 04:34:29.273653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.249 [2024-11-28 04:34:29.273755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.273780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.273939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.274163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.274449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.274734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.274868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.274995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.275245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.275472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.275741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.275886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.275982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.276245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.276534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.276800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.276982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.277125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.277253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.277278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.277388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.277515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.277549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.277677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.277782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.277807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.277914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.278168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.278468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.278741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.278905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.279036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.279175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.279200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.279340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.279496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.279522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.279670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.279774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.279799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.279929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.280160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.280437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.280695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.280826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.280956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.281205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.281425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.281690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.281855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.281982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.282113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.282139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.282303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.282425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.282450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.282548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.282671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.282700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.282843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.282998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.283124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.283363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.283618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.283865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.283996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.284021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.284123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.284249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.284275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.284407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.284544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.284570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.284726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.284883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.284908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.285009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.285238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.285580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.285860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.285987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.286086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.286307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.286541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.286864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.286981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.250 [2024-11-28 04:34:29.287115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.287242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.250 [2024-11-28 04:34:29.287268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.250 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.287396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.287523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.287556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.287687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.287817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.287842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.287972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.288102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.288128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.288260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.288465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.288490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.288650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.288749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.288776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.288914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.289169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.289426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.289719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.289905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.290032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.290236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.290261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.290464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.290611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.290639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.290736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.290839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.290864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.291000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.291213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.291474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.291736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.291894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.292022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.292284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.292565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.292788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.292946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.293046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.293351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.293584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.293812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.293945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.294053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.294282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.294522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.294742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.294895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.294991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.295275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.295562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.295850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.295977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.296137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.296263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.296288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.296428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.296557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.296590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.296721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.296818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.296843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.296939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.297160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.297391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.297740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.297904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.298008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.298252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.298504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.298768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.298923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.299025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.299129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.299154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.299283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.299412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.299437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.299563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.299702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.299727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.251 [2024-11-28 04:34:29.299861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.299989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.251 [2024-11-28 04:34:29.300014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.251 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.300151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.300247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.300272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.300404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.300543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.300568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.300694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.300797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.300822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.300918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.301160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.301411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.301748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.301918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.302031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.302284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.302569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.302823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.302953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.303075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.303322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.303587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.303869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.303999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.304107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.304363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.304612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.304877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.304995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.305124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.305255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.305280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.305374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.305467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.305492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.305646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.305851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.305877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.306014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.306268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.306530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.306797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.306917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.307022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.307150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.307175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.307307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.307415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.307444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.307596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.307728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.307753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.307858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.307990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.308016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.308141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.308269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.308295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.308416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.308506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.308537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.308691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.308797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.308822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.308915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.309161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.309497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.309779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.309931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.310033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.310285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.310537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.310767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.310926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.311059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.311190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.311216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.311349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.311477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.311502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.311690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.311807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.311838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.311987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.312223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.312484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.312722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.312852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.312963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.313099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.313126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.313231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.313358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.252 [2024-11-28 04:34:29.313385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.252 qpair failed and we were unable to recover it. 00:27:52.252 [2024-11-28 04:34:29.313513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.313651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.313679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.313806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.313904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.313930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.314034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.314320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.314543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.314808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.314968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.315067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.315200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.315226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.315356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.315451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.315477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.315622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.315733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.315759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.315861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.315992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.316019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.316113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.316238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.316263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.316399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.316504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.316535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.316635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.316734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.316760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.316915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.317166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.317441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.317719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.317872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.318035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.318301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.318531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.318823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.318950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.319077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.319185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.319211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.319338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.319470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.319496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.319607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.319733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.319760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.319920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.320146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.320433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.320693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.320850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.321010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.321268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.321535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.321771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.321927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.322029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.322264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.322521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.322792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.322949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.323076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.323176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.323202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.323300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.323396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.323422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.323588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.323687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.323714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.323873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.323997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.324023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.324147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.324246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.324272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.324394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.324536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.324564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.324695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.324802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.324829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.324931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.325221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.325504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.325748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.325873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.253 qpair failed and we were unable to recover it. 00:27:52.253 [2024-11-28 04:34:29.326004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.253 [2024-11-28 04:34:29.326109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.326136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.326240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.326377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.326403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.326535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.326650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.326678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.326813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.326911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.326937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.327040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.327320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.327600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.327831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.327964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.328064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.328295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.328563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.328830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.328969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.329100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.329203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.329228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.329357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.329490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.329516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.329679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.329823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.329849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.329946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.330261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.330481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.330735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.330885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.331013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.331271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.331560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.331800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.331987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.332130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.332258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.332284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.332381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.332486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.332513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.332680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.332792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.332820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.332923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.333201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.333483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.333736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.333889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.333997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.334254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.334487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.334729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.334881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.334981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.335293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.335574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.335804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.335933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.336092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.336196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.336223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.336353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.336454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.336482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.336592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.336726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.336753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.336908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.337183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.337400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.337621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.337778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.337908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.338145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.338422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.338685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.338811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.338942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.339046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.339072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.254 [2024-11-28 04:34:29.339199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.339327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.254 [2024-11-28 04:34:29.339353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.254 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.339480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.339628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.339659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.339820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.339949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.339975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.340108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.340232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.340258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.340363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.340491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.340517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.340652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.340781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.340806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.340906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.341179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.341401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.341752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.341875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.342032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.342161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.342187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.342342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.342433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.342463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.342609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.342731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.342757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.342854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.343148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.343438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.343734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.343883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.344037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.344139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.344165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.344293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.344414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.344439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.344569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.344727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.344753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.344909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.345036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.345062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.345287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.345423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.345454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.345585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.345714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.345741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.345897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.346153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.346477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.346731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.346888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.347013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.347168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.347194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.347323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.347427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.347453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.347578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.347678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.347704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.347868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.348151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.348414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.348675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.348801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.348933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.349226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.349514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.349757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.349914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.350041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.350168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.350195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.350319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.350478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.350505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.350642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.350772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.350798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.350938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.351171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.351423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.351684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.351834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.351928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.352216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.352534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.352794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.352951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.353108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.353232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.353258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.353358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.353515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.255 [2024-11-28 04:34:29.353552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.255 qpair failed and we were unable to recover it. 00:27:52.255 [2024-11-28 04:34:29.353688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.353821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.353848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.353959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.354242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.354453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.354760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.354885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.355047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.355176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.355203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.355335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.355470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.355497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.355603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.355741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.355767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.355866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.355993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.356020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.356153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.356252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.356277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.356408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.356563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.356590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.356726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.356823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.356850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.356952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.357233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.357522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.357796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.357925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.358084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.358371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.358632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.358877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.358995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.359127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.359280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.359306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.359413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.359572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.359599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.359736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.359888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.359914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.360040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.360297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.360548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.360802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.360939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.361096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.361225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.361252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.361412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.361563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.361590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.361725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.361853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.361879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.362006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.362160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.362186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.362326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.362455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.362483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.362650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.362812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.362839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.362948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.363201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.363455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.363714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.363844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.363978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.364134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.364160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.364286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.364452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.364478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.364609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.364772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.364798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.364933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.365235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.365568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.365853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.365982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.366135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.366256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.366283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.366418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.366543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.366570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.366672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.366822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.366848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.256 qpair failed and we were unable to recover it. 00:27:52.256 [2024-11-28 04:34:29.366974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.256 [2024-11-28 04:34:29.367096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.367121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.367221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.367327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.367353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.367485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.367591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.367619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.367763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.367860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.367888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.368060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.368326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.368599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.368853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.368974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.369075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.369329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.369561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.369842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.369993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.370151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.370252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.370279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.370384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.370510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.370542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.370680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.370814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.370841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.370988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.371161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.371186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.371291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.371417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.371442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.371538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.371654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.371698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.371864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.372223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.372494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.372774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.372943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.373054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.373180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.373206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.373365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.373490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.373517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.373679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.373880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.373924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.374084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.374215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.374240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.374338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.374466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.374491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.374652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.374818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.374846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.374970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.375091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.375117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.375252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.375350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.375376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.375496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.375663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.375707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.375862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.375986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.376113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.376369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.376609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.376865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.376994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.377019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.377146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.377268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.377294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.377422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.377553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.377588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.377694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.377797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.377824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.377987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.378274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.378553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.378817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.378933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.379058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.379189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.379214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.379314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.379414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.379440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.379595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.379727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.379752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.379915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.380179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.380434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.380698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.380879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.257 qpair failed and we were unable to recover it. 00:27:52.257 [2024-11-28 04:34:29.381006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.257 [2024-11-28 04:34:29.381102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.381127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.381292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.381394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.381420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.381558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.381715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.381746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.381863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.381967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.381997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.382139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.382289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.382320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.382456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.382555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.382581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.382676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.382853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.382881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.383042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.383190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.383231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.383393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.383554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.383580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.383737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.383951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.383998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.384135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.384274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.384303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.384425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.384554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.384581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.384715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.384822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.384850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.385001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.385131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.385157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.385310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.385419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.385454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.385594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.385697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.385725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.385826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.385983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.386008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.386162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.386283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.386308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.386457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.386609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.386635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.386741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.386868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.386893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.387017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.387140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.387165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.387302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.387421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.387449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.387603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.387757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.387783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.387932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.388112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.388137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.388294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.388465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.388498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.388639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.388743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.388768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.388873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.389020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.389049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.389220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.389377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.389423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.389585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.389717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.389742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.389852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.389980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.390005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.390121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.390232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.390262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.390404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.390549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.390592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.390721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.390846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.390871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.390967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.391205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.391465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.391743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.391909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.392116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.392281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.392309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.392479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.392605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.392631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.392767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.392919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.392947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.393118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.393289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.393317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.393457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.393606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.393634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.393736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.393863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.393889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.394025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.394188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.394214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.394341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.394521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.394553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.394663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.394794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.394820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.394945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.395223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.395535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.258 qpair failed and we were unable to recover it. 00:27:52.258 [2024-11-28 04:34:29.395793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.258 [2024-11-28 04:34:29.395987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.396093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.396198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.396226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.396355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.396482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.396509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.396642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.396754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.396784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.396891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.396998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.397028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.397161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.397299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.397327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.397447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.397583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.397611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.397772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.397930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.397958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.398130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.398286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.398312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.398456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.398583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.398610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.398719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.398906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.398933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.399070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.399240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.399268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.399459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.399619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.399645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.399769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.399921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.399951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.400092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.400229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.400258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.400395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.400542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.400568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.400672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.400807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.400833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.400981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.401147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.401175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.401419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.401576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.401603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.401735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.401862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.401887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.401989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.402145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.402174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.402277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.402434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.402460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.402573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.402686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.402711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.402900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.403208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.403507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.403825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.403986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.404116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.404219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.404245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.404386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.404538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.404565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.404655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.404751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.404776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.404872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.404999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.405024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.405151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.405307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.405333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.405487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.405684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.405712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.405855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.405989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.406015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.406171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.406309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.406339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.406508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.406715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.406741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.406878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.407197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.407476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.407748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.407900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.408030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.408284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.408546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.408799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.408912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.409006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.409099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.409124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.409278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.409376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.409403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.409506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.409666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.409695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.409849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.409975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.410000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.259 qpair failed and we were unable to recover it. 00:27:52.259 [2024-11-28 04:34:29.410127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.410227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.259 [2024-11-28 04:34:29.410252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.410386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.410557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.410597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.410778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.410943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.410971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.411120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.411250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.411276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.411398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.411549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.411576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.411732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.411849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.411876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.411979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.412103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.412129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.412228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.412338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.412364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.412549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.412681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.412710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.412864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.413190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.413490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.413792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.413926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.414054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.414203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.414232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.414370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.414477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.414507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.414677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.414811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.414836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.414947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.415076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.415101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.415272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.415387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.415416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.415575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.415688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.415715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.415871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.416163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.416454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.416747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.416879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.417006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.417284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.417511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.417778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.417968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.418099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.418195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.418221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.418373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.418569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.418600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.418726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.418838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.418863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.418990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.419116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.419142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.419255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.419422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.419450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.419572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.419693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.419719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.419852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.419975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.420000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.420140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.420254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.420282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.420394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.420539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.420569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.420684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.420788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.420813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.420969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.421200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.421461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.421715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.421927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.422096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.422276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.422302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.422411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.422542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.422570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.422675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.422776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.422801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.422903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.423061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.423086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.423216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.423310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.423335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.423478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.423643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.423670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.423831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.423981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.424009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.424146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.424277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.424303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.424402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.424494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.424520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.260 qpair failed and we were unable to recover it. 00:27:52.260 [2024-11-28 04:34:29.424652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.260 [2024-11-28 04:34:29.424755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.424780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.424940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.425216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.425535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.425838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.425987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.426126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.426255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.426283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.426422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.426587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.426614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.426777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.426873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.426900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.427078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.427218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.427246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.427379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.427485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.427514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.427627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.427722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.427747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.427882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.428182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.428460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.428728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.428865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.429044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.429293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.429542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.429794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.429993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.430130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.430240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.430267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.430428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.430553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.430597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.430698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.430846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.430874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.431052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.431284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.431537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.431795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.431918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.432022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.432175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.432201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.432364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.432493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.432518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.432690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.432828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.432854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.432985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.433270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.433542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.433794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.433929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.434080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.434220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.434249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.434401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.434560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.434587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.434690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.434833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.434859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.435019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.435175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.435200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.435336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.435467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.435492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.435628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.435731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.435757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.435886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.436002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.436051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.436206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.436335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.436376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.436551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.436676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.436702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.436865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.437215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.437499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.437784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.437941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.438092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.438219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.438245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.261 qpair failed and we were unable to recover it. 00:27:52.261 [2024-11-28 04:34:29.438389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.438498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.261 [2024-11-28 04:34:29.438535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.438685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.438782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.438808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.438951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.439252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.439599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.439869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.439994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.440167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.440310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.440338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.440476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.440662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.440689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.440843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.441208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.441483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.441804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.441924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.442061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.442231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.442259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.442421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.442550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.442576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.442735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.442875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.442919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.443026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.443281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.443603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.443836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.443990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.444144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.444299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.444327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.444484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.444623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.444649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.444777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.444910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.444936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.445058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.445198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.445227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.445355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.445448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.445474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.445615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.445769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.445794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.445928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.446059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.446088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.446242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.446400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.446443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.446602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.446704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.446730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.446874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.447194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.447478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.447736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.447869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.447973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.448314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.448565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.448843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.448957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.449056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.449210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.449238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.449372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.449515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.449548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.449678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.449800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.449826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.449956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.450256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.450542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.450769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.450930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.451058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.451156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.451189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.451342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.451467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.451492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.451637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.451766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.451791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.451947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.452264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.452490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.452744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.452929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.453053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.453175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.453201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.262 qpair failed and we were unable to recover it. 00:27:52.262 [2024-11-28 04:34:29.453375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.262 [2024-11-28 04:34:29.453472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.453497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.453622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.453759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.453785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.453916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.454038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.454068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.454165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.454327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.454356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.454463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.454635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.454662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.454822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.454976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.455001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.455148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.455300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.455325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.455422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.455549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.455583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.455694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.455823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.455849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.455968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.456293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.456541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.456787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.456954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.457066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.457232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.457260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.457446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.457604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.457630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.457737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.457846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.457875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.457985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.458125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.458153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.458270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.458427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.458453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.458590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.458734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.458762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.458902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.459215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.459520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.459807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.459952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.460095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.460226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.460252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.460441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.460541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.460578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.460740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.460889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.460917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.461038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.461164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.461190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.461310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.461460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.461488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.461648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.461745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.461770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.461898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.461992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.462017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.462206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.462308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.462334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.462463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.462613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.462639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.462762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.462863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.462891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.463009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.463250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.463551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.463785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.463937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.464034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.464150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.464178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.464299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.464422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.464448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.464576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.464685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.464713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.464853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.464997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.465023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.465131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.465225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.465251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.465380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.465467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.465493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.465631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.465762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.465792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.465927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.466215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.466516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.466782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.466958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.467105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.467257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.467282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.467378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.467498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.467544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.467679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.467788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.263 [2024-11-28 04:34:29.467814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.263 qpair failed and we were unable to recover it. 00:27:52.263 [2024-11-28 04:34:29.467952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.468103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.468130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.468288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.468467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.468495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.468682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.468785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.468810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.468913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.469210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.469477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.469735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.469864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.469966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.470230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.470496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.470819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.470993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.471120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.471218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.471244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.471357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.471496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.471544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.471662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.471781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.471810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.471984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.472268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.472539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.472822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.472971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.473128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.473251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.473276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.473403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.473519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.473556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.473738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.473836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.473861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.473972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.474153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.474178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.474299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.474435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.474463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.474614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.474717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.474742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.474843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.474983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.475012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.475148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.475260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.475289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.475463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.475565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.475591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.475716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.475861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.475889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.476028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.476200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.476228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.476377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.476507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.476540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.476702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.476836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.476861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.476994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.477105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.477147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.477281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.477409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.477434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.477584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.477693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.477722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.477866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.478017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.478042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.478171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.478301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.478327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.478508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.478659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.478699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.478826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.478988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.479016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.479194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.479329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.479354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.479517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.479711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.479740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.479854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.480168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.480484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.480801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.480986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.481081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.481239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.481264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.481416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.481553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.481585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.481699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.481867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.481895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.264 qpair failed and we were unable to recover it. 00:27:52.264 [2024-11-28 04:34:29.482075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.482194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.264 [2024-11-28 04:34:29.482219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.482372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.482520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.482552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.482681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.482830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.482858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.483005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.483143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.483169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.483343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.483497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.483522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.483703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.483882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.483910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.484037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.484130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.484155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.484290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.484439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.484464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.484596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.484756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.484782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.484923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.485205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.485492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.485819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.485973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.486128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.486251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.486277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.486413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.486573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.486598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.486697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.486822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.486848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.486940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.487240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.487566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.487847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.487989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.488101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.488236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.488278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.488406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.488535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.488561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.488759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.488849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.488874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.489002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.489164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.489192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.489308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.489458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.489484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.489633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.489805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.489831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.489984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.490289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.490521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.490841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.490983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.491130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.491259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.491284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.491477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.491614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.491640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.491820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.491986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.492015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.492159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.492285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.492310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.492408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.492532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.492558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.492659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.492806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.492834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.493014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.493139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.493179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.493318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.493488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.493521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.493649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.493763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.493789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.493953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.494124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.494152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.494306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.494431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.494456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.494557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.494711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.494741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.494869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.495022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.495047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.495171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.495336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.495364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.495554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.495716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.495741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.495868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.495994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.496019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.496164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.496344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.496369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.496501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.496631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.496663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.496765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.496865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.496890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.497008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.497120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.497148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.497289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.497427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.497456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.265 qpair failed and we were unable to recover it. 00:27:52.265 [2024-11-28 04:34:29.497647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.265 [2024-11-28 04:34:29.497780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.497805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.497908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.498009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.498034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.498188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.498300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.498328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.498452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.498626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.498653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.498802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.498974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.499127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.499349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.499572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.499862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.499996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.500137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.500265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.500290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.500420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.500571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.500601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.500732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.500919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.500945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.501097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.501222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.501247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.501365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.501477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.501507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.501722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.501868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.501897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.502074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.502205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.502232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.502363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.502468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.502497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.502622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.502775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.502800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.502903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.503229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.503551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.503844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.503970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.504101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.504268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.504296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.504491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.504624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.504650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.504751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.504913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.504938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.505040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.505158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.505186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.505301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.505439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.505467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.505618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.505776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.505801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.505954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.506232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.506484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.506808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.506985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.507116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.507300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.507329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.507471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.507593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.507619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.507790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.507943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.507968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.508089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.508230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.508258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.508437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.508540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.508566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.508694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.508852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.508899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.509027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.509170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.509198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.509323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.509455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.509480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.509590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.509731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.509759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.509900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.510189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.510451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.510792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.510961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.511103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.511233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.511259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.511409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.511520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.511556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.266 qpair failed and we were unable to recover it. 00:27:52.266 [2024-11-28 04:34:29.511739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.266 [2024-11-28 04:34:29.511852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.511877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.511978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.512102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.512128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.512267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.512435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.512463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.512598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.512782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.512808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.512934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.513061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.513087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.513264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.513408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.513433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.513576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.513691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.513719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.513898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.514208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.514451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.514694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.514841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.515017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.515321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.515614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.515873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.515993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.516103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.516227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.516271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.516440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.516594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.516621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.516778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.516942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.516970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.517078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.517224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.517251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.517384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.517473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.517498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.517655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.517830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.517855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.518015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.518174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.518200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.518334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.518461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.518486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.518591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.518721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.518750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.518857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.518998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.519027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.519198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.519324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.519349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.519503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.519659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.519685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.519806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.519999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.520024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.520151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.520242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.520267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.520389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.520557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.520585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.520724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.520897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.520926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.521078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.521238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.521280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.521466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.521595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.521622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.521749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.521861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.521890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.522040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.522171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.522196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.522349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.522469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.522497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.522628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.522736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.522761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.522857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.522988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.523013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.523144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.523244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.523271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.523393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.523556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.523586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.523710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.523840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.523866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.524010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.524308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.524583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.524869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.524992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.525093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.525339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.525562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.525796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.525919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.526050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.526175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.526200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.526316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.526482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.267 [2024-11-28 04:34:29.526510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.267 qpair failed and we were unable to recover it. 00:27:52.267 [2024-11-28 04:34:29.526660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.526808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.526836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.526985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.527117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.527142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.527298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.527470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.527498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.527623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.527718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.527744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.527879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.527979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.528004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.528128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.528229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.528254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.528403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.528510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.528546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.528693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.528819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.528844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.528992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.529276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.529495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.529746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.529915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.530018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.530326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.530590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.530853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.530988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.531106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.531260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.531285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.531424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.531601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.531630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.531742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.531878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.531919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.532047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.532200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.532225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.532382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.532521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.532558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.532704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.532849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.532877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.533031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.533152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.533177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.533351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.533536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.533562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.533689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.533835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.533863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.534009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.534140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.534165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.534319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.534422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.534450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.534602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.534730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.534755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.534888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.534992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.535017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.535139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.535257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.535286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.535436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.535563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.535589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.535690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.535813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.535842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.535960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.536099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.536127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.536300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.536450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.536476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.536579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.536732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.536758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.536914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.537164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.537475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.537789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.537996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.538126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.538272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.538300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.538454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.538580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.538606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.538728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.538866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.538899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.539068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.539215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.539243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.539390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.539519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.539553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.539679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.539823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.539851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.539982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.540152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.540181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.540321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.540474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.540517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.540719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.540819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.540845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.540971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.541075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.541118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.541282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.541382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.541407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.268 qpair failed and we were unable to recover it. 00:27:52.268 [2024-11-28 04:34:29.541584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.268 [2024-11-28 04:34:29.541693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.541735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.269 qpair failed and we were unable to recover it. 00:27:52.269 [2024-11-28 04:34:29.541867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.269 qpair failed and we were unable to recover it. 00:27:52.269 [2024-11-28 04:34:29.542229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.269 qpair failed and we were unable to recover it. 00:27:52.269 [2024-11-28 04:34:29.542460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.269 qpair failed and we were unable to recover it. 00:27:52.269 [2024-11-28 04:34:29.542753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.542891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.269 qpair failed and we were unable to recover it. 00:27:52.269 [2024-11-28 04:34:29.543044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.543170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.269 [2024-11-28 04:34:29.543195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.269 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.543323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.543493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.543521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.543735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.543894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.543919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.544108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.544235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.544260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.544412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.544554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.544597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.544755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.544900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.544928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.545041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.545133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.545158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.545303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.545442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.545485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.545649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.545783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.545825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.545949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.546242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.546494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.546780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.546930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.547066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.547191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.547217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.547349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.547494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.547523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.547691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.547844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.547869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.548065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.548164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.548189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.548288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.548442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.548470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.548615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.548742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.548767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.548877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.548983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.549012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.559 [2024-11-28 04:34:29.549128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.549282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.559 [2024-11-28 04:34:29.549307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.559 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.549438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.549565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.549592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.549721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.549900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.549926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.550085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.550268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.550296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.550443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.550577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.550602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.550747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.550894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.550921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.551105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.551259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.551284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.551407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.551494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.551530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.551656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.551771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.551799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.551977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.552096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.552121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.552244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.552368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.552393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.552545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.552685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.552714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.552846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.553219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.553509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.553804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.553978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.554076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.554208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.554233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.554423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.554515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.554548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.554685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.554863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.554891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.555050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.555301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.555519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.555823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.555950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.556066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.556238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.556263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.556419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.556551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.556580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.556729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.556884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.556909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.557036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.557161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.557186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.557327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.557491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.557518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.557684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.557805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.557830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.560 qpair failed and we were unable to recover it. 00:27:52.560 [2024-11-28 04:34:29.557993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.560 [2024-11-28 04:34:29.558145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.558170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.558290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.558428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.558458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.558615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.558707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.558732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.558868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.559206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.559486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.559791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.559921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.560061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.560195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.560223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.560332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.560488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.560513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.560676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.560787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.560815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.560916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.561196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.561489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.561775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.561947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.562044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.562195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.562220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.562377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.562521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.562571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.562697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.562845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.562873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.562994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.563123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.563148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.563301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.563406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.563436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.563576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.563745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.563774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.563943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.564193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.564491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.564815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.564974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.565131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.565307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.565335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.565448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.565584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.565613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.565736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.565899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.565924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.566042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.566157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.566186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.566369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.566493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.566519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.561 qpair failed and we were unable to recover it. 00:27:52.561 [2024-11-28 04:34:29.566650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.561 [2024-11-28 04:34:29.566759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.566788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.566962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.567253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.567570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.567792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.567958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.568100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.568211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.568239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.568390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.568515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.568548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.568702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.568810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.568838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.568986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.569113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.569138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.569262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.569389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.569414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.569514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.569685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.569714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.569830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.569974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.570003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.570149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.570244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.570269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.570439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.570567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.570593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.570709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.570829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.570857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.570972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.571100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.571127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.571279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.571428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.571456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.571591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.571733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.571774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.571930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.572220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.572490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.572806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.572958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.573110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.573252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.573280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.573446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.573591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.573620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.573791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.573923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.573966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.574072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.574215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.574243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.574388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.574497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.574531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.574689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.574795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.574820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.574975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.575104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.575132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.562 qpair failed and we were unable to recover it. 00:27:52.562 [2024-11-28 04:34:29.575265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.562 [2024-11-28 04:34:29.575451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.575477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.575576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.575702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.575728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.575899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.576050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.576076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.576205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.576327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.576355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.576499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.576666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.576692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.576871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.577155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.577440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.577664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.577819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.577931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.578223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.578441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.578725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.578904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.579059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.579188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.579229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.579393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.579557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.579586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.579693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.579809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.579839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.579995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.580147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.580172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.580297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.580440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.580468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.580632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.580757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.580782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.580886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.581210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.581496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.581779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.581932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.582059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.582228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.582256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.563 [2024-11-28 04:34:29.582373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.582514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.563 [2024-11-28 04:34:29.582550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.563 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.582707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.582861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.582903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.583052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.583207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.583232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.583327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.583455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.583480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.583659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.583753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.583778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.583968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.584273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.584532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.584820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.584948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.585140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.585265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.585292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.585428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.585522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.585556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.585666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.585791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.585817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.585974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.586127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.586169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.586304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.586435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.586460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.586603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.586766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.586794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.586940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.587104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.587132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.587282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.587407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.587432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.587578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.587691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.587720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.587868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.588251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.588560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.588838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.588986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.589106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.589232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.589257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.589388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.589486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.589511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.589614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.589788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.589816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.589963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.590214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.590516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.590803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.590955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.564 [2024-11-28 04:34:29.591097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.591241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.564 [2024-11-28 04:34:29.591283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.564 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.591448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.591585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.591614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.591756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.591907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.591933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.592077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.592190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.592218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.592360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.592470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.592500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.592666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.592825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.592850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.593015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.593156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.593184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.593325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.593493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.593521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.593677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.593802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.593827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.593985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.594156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.594182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.594335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.594465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.594497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.594667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.594799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.594824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.594989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.595260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.595530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.595778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.595960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.596078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.596230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.596255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.596409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.596512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.596545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.596695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.596829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.596857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.596963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.597308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.597572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.597841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.597988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.598141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.598292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.598317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.598466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.598632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.598660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.598793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.598972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.598996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.599094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.599215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.599240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.599360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.599503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.599544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.599663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.599810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.599839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.565 qpair failed and we were unable to recover it. 00:27:52.565 [2024-11-28 04:34:29.599965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.600092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.565 [2024-11-28 04:34:29.600117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.600262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.600435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.600461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.600624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.600818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.600844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.600965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.601266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.601513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.601794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.601947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.602100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.602239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.602267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.602445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.602585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.602612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.602781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.602934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.602959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.603068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.603177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.603206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.603341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.603452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.603480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.603648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.603783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.603809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.603924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.604208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.604456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.604760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.604903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.605022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.605168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.605193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.605319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.605409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.605435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.605591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.605734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.605763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.605935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.606073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.606101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.606223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.606377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.606402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.606568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.606702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.606729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.606845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.606983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.607011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.607162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.607267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.607292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.607446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.607572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.607602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.607771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.607926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.607951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.608085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.608187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.608212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.608334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.608476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.608503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.566 qpair failed and we were unable to recover it. 00:27:52.566 [2024-11-28 04:34:29.608659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.608807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.566 [2024-11-28 04:34:29.608833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.608961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.609091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.609117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.609245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.609389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.609417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.609554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.609673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.609706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.609866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.609995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.610020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.610120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.610244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.610270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.610414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.610556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.610584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.610698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.610816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.610841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.611018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.611150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.611178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.611292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.611441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.611466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.611569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.611692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.611718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.611910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.612194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.612473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.612756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.612928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.613023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.613147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.613172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.613299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.613458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.613500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.613609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.613741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.613770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.613866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.613998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.614026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.614145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.614271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.614297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.614441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.614613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.614642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.614780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.614922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.614952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.615128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.615255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.615282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.615446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.615590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.615617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.615743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.615872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.615898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.616063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.616167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.616193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.616286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.616418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.616443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.616593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.616728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.616756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.616903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.617003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.617029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.567 qpair failed and we were unable to recover it. 00:27:52.567 [2024-11-28 04:34:29.617133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.617259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.567 [2024-11-28 04:34:29.617284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.617382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.617509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.617543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.617722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.617848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.617873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.618054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.618176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.618204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.618375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.618512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.618548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.618700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.618838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.618864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.618983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.619124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.619152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.619288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.619453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.619481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.619675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.619848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.619876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.619989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.620321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.620639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.620860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.620995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.621105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.621272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.621300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.621445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.621567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.621593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.621741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.621888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.621917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.622048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.622306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.622568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.622805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.622979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.623128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.623220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.623246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.623421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.623651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.623706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.623853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.623960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.623988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.624136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.624261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.624287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.624437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.624549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.624579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.624694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.624832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.624878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.568 qpair failed and we were unable to recover it. 00:27:52.568 [2024-11-28 04:34:29.625035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.568 [2024-11-28 04:34:29.625136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.625161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.625316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.625428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.625456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.625599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.625773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.625801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.625963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.626287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.626567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.626851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.626999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.627161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.627289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.627315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.627454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.627588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.627617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.627741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.627873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.627898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.628058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.628210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.628238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.628359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.628471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.628500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.628655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.628788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.628813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.628946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.629251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.629539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.629829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.629969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.630083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.630217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.630259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.630358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.630514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.630546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.630708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.630815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.630840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.630997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.631136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.631164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.631341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.631487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.631517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.631675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.631817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.631845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.631961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.632065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.632094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.632215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.632370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.632395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.632552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.632729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.632754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.632907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.633058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.633100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.633224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.633311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.633337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.633463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.633574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.633603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.569 qpair failed and we were unable to recover it. 00:27:52.569 [2024-11-28 04:34:29.633736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.569 [2024-11-28 04:34:29.633836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.633864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.634016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.634308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.634603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.634832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.634982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.635160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.635293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.635321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.635489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.635658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.635687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.635808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.635929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.635954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.636146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.636273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.636299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.636455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.636651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.636676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.636804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.636906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.636931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.637113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.637241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.637272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.637422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.637604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.637629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.637762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.637893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.637919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.638056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.638197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.638240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.638343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.638473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.638499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.638603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.638706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.638732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.638861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.639152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.639437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.639750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.639914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.640060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.640197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.640225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.640419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.640547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.640592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.640709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.640820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.640863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.640987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.641134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.641159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.641315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.641417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.641443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.641602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.641776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.641802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.641956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.642090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.642118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.642263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.642390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.642415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.570 qpair failed and we were unable to recover it. 00:27:52.570 [2024-11-28 04:34:29.642567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.570 [2024-11-28 04:34:29.642692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.642720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.642888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.643181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.643464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.643740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.643924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.644060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.644200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.644226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.644386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.644536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.644565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.644707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.644812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.644839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.644973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.645126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.645151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.645333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.645464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.645492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.645630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.645731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.645755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.645857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.645987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.646012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.646154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.646287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.646330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.646486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.646588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.646614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.646705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.646808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.646833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.646956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.647112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.647137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.647288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.647428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.647456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.647597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.647761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.647786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.647917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.648215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.648536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.648783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.648961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.649087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.649239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.649267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.649428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.649588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.649614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.649763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.649880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.649923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.650056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.650202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.650230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.650406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.650563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.650606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.650753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.650901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.650926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.651054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.651192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.651220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.571 qpair failed and we were unable to recover it. 00:27:52.571 [2024-11-28 04:34:29.651383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.571 [2024-11-28 04:34:29.651506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.651538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.651644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.651772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.651797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.651909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.652228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.652507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.652820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.652942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.653094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.653224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.653266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.653435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.653574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.653603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.653716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.653831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.653856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.653983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.654299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.654545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.654823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.654957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.655120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.655250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.655275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.655399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.655495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.655566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.655725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.655876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.655901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.656050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.656193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.656221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.656369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.656492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.656517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.656682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.656809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.656850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.657001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.657114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.657142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.657249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.657428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.657453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.657578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.657713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.657738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.657891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.658230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.658445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.658785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.658954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.659130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.659229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.572 [2024-11-28 04:34:29.659253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.572 qpair failed and we were unable to recover it. 00:27:52.572 [2024-11-28 04:34:29.659409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.659552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.659578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.659699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.659889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.659914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.660087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.660266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.660292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.660396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.660493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.660519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.660661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.660851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.660877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.661005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.661156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.661184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.661364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.661539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.661568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.661706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.661872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.661899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.662062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.662156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.662181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.662338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.662509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.662546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.662694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.662806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.662834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.663007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.663156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.663181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.663312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.663434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.663459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.663587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.663760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.663788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.663966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.664099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.664124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.664284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.664439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.664481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.664634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.664748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.664776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.664889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.665026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.665056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.665207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.665361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.665391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.665538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.665690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.665716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.665838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.665990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.666032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.666183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.666276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.666301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.666460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.666593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.666622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.666735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.666854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.666895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.667026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.667125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.667150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.667256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.667408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.667436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.667619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.667774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.667799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.573 [2024-11-28 04:34:29.667902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.668057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.573 [2024-11-28 04:34:29.668081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.573 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.668233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.668367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.668412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.668510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.668686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.668715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.668861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.669172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.669476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.669798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.669950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.670047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.670271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.670544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.670824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.670988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.671117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.671260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.671302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.671466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.671562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.671588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.671732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.671843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.671871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.672010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.672162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.672187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.672318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.672445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.672471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.672671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.672799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.672824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.672962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.673100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.673128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.673303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.673428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.673470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.673574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.673731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.673757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.673921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.674075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.674103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.674250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.674380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.674406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.674568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.674667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.674694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.674798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.675004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.675029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.675213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.675337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.675362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.675510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.675660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.675689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.675861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.675973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.676001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.676145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.676267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.676293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.676442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.676600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.676626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.574 [2024-11-28 04:34:29.676724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.676875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.574 [2024-11-28 04:34:29.676900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.574 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.676994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.677092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.677118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.677267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.677443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.677468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.677625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.677784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.677814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.677996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.678126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.678167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.678317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.678455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.678483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.678641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.678782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.678807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.678931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.679200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.679439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.679708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.679836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.679986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.680124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.680152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.680320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.680465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.680490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.680594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.680748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.680780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.680909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.681191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.681480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.681737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.681882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.682011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.682151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.682194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.682355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.682448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.682474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.682606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.682751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.682777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.682908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.683022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.683050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.683195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.683322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.683347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.683514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.683663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.683691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.683866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.684033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.684060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.684188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.684322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.684347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.684476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.684679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.684705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.684833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.684983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.685012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.685143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.685265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.685291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.575 [2024-11-28 04:34:29.685437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.685568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.575 [2024-11-28 04:34:29.685598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.575 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.685709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.685886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.685912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.686069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.686174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.686199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.686361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.686500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.686530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.686647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.686797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.686825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.686943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.687098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.687123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.687263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.687397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.687425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.687556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.687721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.687749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.687895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.688163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.688504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.688763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.688883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.689043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.689222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.689249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.689400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.689538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.689564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.689688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.689812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.689837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.689946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.690098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.690126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.690263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.690401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.690429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.690604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.690730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.690755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.690939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.691053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.691096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.691257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.691405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.691449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.691575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.691682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.691708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.691849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.691982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.692010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.692184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.692308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.692333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.692464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.692561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.692586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.692755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.692896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.692924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.693035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.693184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.693212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.693326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.693454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.693479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.693584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.693757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.693785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.693927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.694061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.694089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.576 [2024-11-28 04:34:29.694237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.694364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.576 [2024-11-28 04:34:29.694390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.576 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.694538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.694647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.694688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.694845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.694989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.695017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.695132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.695253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.695278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.695404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.695552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.695579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.695710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.695829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.695858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.696036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.696136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.696165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.696317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.696460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.696488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.696642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.696746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.696773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.696903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.697208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.697504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.697747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.697899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.698021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.698158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.698187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.698330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.698478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.698506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.698638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.698767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.698793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.698975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.699081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.699111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.699276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.699408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.699433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.699575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.699712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.699753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.699908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.700007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.700032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.700188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.700331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.700359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.700513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.700652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.700678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.700804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.700986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.701011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.701144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.701266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.701291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.701419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.701530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.701556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.701680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.701773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.701798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.577 qpair failed and we were unable to recover it. 00:27:52.577 [2024-11-28 04:34:29.701914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.577 [2024-11-28 04:34:29.702027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.702055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.702184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.702292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.702317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.702439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.702557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.702586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.702699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.702808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.702838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.702984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.703118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.703143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.703261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.703354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.703380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.703558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.703708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.703733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.703888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.703989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.704015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.704119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.704276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.704304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.704449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.704618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.704647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.704800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.704953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.704978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.705091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.705244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.705269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.705400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.705573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.705599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.705704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.705856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.705882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.706009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.706123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.706150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.706308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.706446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.706471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.706591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.706749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.706790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.706904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.707085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.707111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.707241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.707369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.707395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.707487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.707619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.707645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.707812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.707991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.708016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.708154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.708297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.708330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.708473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.708605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.708631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.708785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.708926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.708953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.709066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.709167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.709195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.709341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.709467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.709494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.709658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.709808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.709836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.709947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.710094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.710122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.710240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.710373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.710398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.578 qpair failed and we were unable to recover it. 00:27:52.578 [2024-11-28 04:34:29.710552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.578 [2024-11-28 04:34:29.710705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.710730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.710835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.710985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.711013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.711195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.711288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.711317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.711434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.711570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.711599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.711767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.711900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.711929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.712105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.712264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.712307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.712480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.712618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.712647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.712780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.712918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.712948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.713126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.713257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.713282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.713410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.713538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.713567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.713734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.713880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.713905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.714002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.714347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.714602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.714846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.714967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.715102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.715224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.715252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.715359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.715506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.715537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.715689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.715814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.715840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.715966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.716110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.716138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.716307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.716443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.716471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.716622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.716780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.716806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.716954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.717094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.717125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.717269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.717412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.717438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.717568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.717727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.717753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.717910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.718204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.718491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.718789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.718920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.719068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.719207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.719235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.579 qpair failed and we were unable to recover it. 00:27:52.579 [2024-11-28 04:34:29.719382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.579 [2024-11-28 04:34:29.719475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.719501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.719621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.719766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.719794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.719905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.720245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.720584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.720809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.720983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.721137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.721263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.721289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.721413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.721519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.721550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.721697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.721877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.721902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.721999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.722159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.722184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.722302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.722420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.722463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.722594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.722746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.722771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.722988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.723241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.723538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.723822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.723971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.724073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.724174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.724199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.724327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.724422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.724447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.724542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.724701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.724726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.724852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.724981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.725007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.725181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.725285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.725313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.725465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.725593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.725619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.725743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.725853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.725882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.726019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.726159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.726187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.726341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.726471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.726496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.726643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.726827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.726852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.727007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.727120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.727163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.727257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.727409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.727434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.727558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.727697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.727727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.580 qpair failed and we were unable to recover it. 00:27:52.580 [2024-11-28 04:34:29.727846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.580 [2024-11-28 04:34:29.727984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.728025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.728128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.728281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.728306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.728418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.728560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.728588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.728730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.728923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.728948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.729081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.729211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.729236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.729371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.729537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.729565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.729720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.729837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.729862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.730018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.730145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.730170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.730273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.730390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.730415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.730594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.730700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.730728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.730873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.731173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.731448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.731733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.731855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.731995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.732133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.732161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.732269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.732400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.732428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.732554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.732713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.732739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.732884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.733031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.733056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.733252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.733351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.733376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.733501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.733634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.733660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.733806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.733984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.734009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.734167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.734309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.734337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.734485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.734594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.734621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.734728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.734826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.734851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.734980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.735095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.735123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.735296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.735426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.735452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.735641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.735769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.735794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.735916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.736053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.736081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.736256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.736355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.736381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.581 qpair failed and we were unable to recover it. 00:27:52.581 [2024-11-28 04:34:29.736487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.581 [2024-11-28 04:34:29.736677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.736706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.736873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.737179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.737512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.737827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.737993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.738113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.738251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.738276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.738425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.738596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.738625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.738743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.738913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.738943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.739075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.739200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.739225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.739352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.739482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.739510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.739651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.739841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.739867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.739971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.740099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.740124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.740292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.740447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.740475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.740625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.740759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.740787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.740899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.741206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.741548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.741835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.741989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.742142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.742244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.742274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.742376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.742490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.742519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.742677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.742799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.742824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.742987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.743116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.743141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.743310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.743455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.743483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.743622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.743778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.743803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.743953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.744082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.744110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.582 [2024-11-28 04:34:29.744253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.744368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.582 [2024-11-28 04:34:29.744393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.582 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.744495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.744660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.744686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.744844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.744957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.744985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.745157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.745297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.745325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.745452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.745556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.745582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.745716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.745862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.745890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.746028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.746170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.746195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.746298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.746432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.746457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.746630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.746742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.746772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.746876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.747197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.747494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.747815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.747985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.748089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.748263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.748288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.748441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.748552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.748581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.748685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.748821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.748849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.748991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.749124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.749149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.749280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.749435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.749462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.749634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.749794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.749862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.750041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.750168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.750210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.750329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.750442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.750472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.750615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.750722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.750751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.750868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.751156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.751469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.751785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.751934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.752049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.752181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.752224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.752320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.752471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.752496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.752604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.752737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.752762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.583 [2024-11-28 04:34:29.752949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.753054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.583 [2024-11-28 04:34:29.753080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.583 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.753239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.753389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.753417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.753562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.753664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.753691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.753848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.753987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.754015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.754182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.754320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.754348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.754472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.754606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.754632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.754729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.754855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.754881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.755021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.755168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.755193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.755344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.755497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.755560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.755727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.755834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.755862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.755998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.756333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.756580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.756834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.756986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.757117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.757246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.757271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.757374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.757473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.757498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.757630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.757727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.757752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.757857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.757990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.758015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.758159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.758303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.758335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.758473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.758579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.758607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.758732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.758855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.758880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.758989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.759152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.759177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.759350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.759482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.759510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.759640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.759803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.759844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.759999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.760126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.760151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.760285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.760445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.760470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.760628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.760760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.760785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.760913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.761091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.761119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.761225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.761360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.761389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.584 [2024-11-28 04:34:29.761544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.761671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.584 [2024-11-28 04:34:29.761696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.584 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.761871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.762180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.762458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.762712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.762829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.762983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.763125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.763152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.763305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.763440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.763465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.763618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.763754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.763782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.763931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.764215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.764509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.764793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.764935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.765049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.765171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.765195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.765335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.765483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.765508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.765661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.765764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.765792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.765941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.766205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.766501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.766840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.766989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.767133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.767276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.767303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.767420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.767593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.767619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.767720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.767880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.767905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.768096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.768224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.768249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.768397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.768508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.768542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.768694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.768827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.768852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.768981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.769080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.769105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.769203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.769346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.769373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.769535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.769663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.769689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.769830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.769981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.770006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.585 [2024-11-28 04:34:29.770156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.770298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.585 [2024-11-28 04:34:29.770326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.585 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.770467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.770557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.770583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.770735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.770843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.770871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.771008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.771176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.771205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.771359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.771462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.771487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.771684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.771793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.771818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.771914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.772169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.772435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.772751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.772913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.773061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.773164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.773190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.773340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.773481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.773509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.773686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.773801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.773829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.773945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.774236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.774552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.774822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.774974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.775122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.775222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.775250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.775399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.775515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.775564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.775669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.775824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.775850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.776023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.776160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.776188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.776329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.776478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.776503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.776645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.776776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.776801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.776900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.777079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.777107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.777214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.777332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.777360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.777513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.777646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.777672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.586 qpair failed and we were unable to recover it. 00:27:52.586 [2024-11-28 04:34:29.777859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.778010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.586 [2024-11-28 04:34:29.778035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.778227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.778378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.778403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.778537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.778671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.778696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.778815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.778966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.778994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.779166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.779284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.779309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.779434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.779537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.779563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.779665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.779833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.779861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.780016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.780171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.780197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.780386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.780520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.780552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.780671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.780815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.780843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.780980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.781127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.781152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.781280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.781434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.781475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.781597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.781778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.781807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.781961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.782282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.782553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.782805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.782954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.783082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.783184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.783210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.783397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.783529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.783555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.783655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.783783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.783807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.783906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.784255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.784536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.784793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.784945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.785051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.785215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.785242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.785385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.785530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.785558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.785710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.785804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.785828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.785973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.786146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.786174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.786346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.786452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.786481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.587 qpair failed and we were unable to recover it. 00:27:52.587 [2024-11-28 04:34:29.786617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.786747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.587 [2024-11-28 04:34:29.786772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.786909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.787076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.787104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.787247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.787417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.787446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.787592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.787724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.787749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.787906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.788021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.788050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.788167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.788311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.788339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.788496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.788603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.788630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.788813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.788994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.789019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.789146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.789284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.789312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.789460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.789593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.789619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.789778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.789929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.789954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.790048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.790216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.790244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.790386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.790519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.790550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.790643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.790739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.790765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.790946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.791258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.791579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.791857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.791995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.792152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.792250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.792275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.792400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.792549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.792575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.792677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.792791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.792819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.792971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.793297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.793647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.793871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.793996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.794185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.794284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.794309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.794431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.794569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.794597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.794724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.794852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.794877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.794976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.795098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.795124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.588 qpair failed and we were unable to recover it. 00:27:52.588 [2024-11-28 04:34:29.795261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.795388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.588 [2024-11-28 04:34:29.795414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.795541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.795666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.795691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.795822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.795992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.796020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.796154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.796296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.796336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.796489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.796627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.796653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.796755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.796857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.796884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.797019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.797141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.797184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.797281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.797434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.797459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.797614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.797735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.797760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.797902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.798069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.798097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.798217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.798336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.798361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.798544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.798771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.798796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.798929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.799214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.799438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.799767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.799935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.800038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.800165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.800190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.800289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.800449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.800477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.800653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.800764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.800805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.800907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.801191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.801521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.801843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.801966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.802138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.802271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.802299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.802434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.802547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.802577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.802736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.802839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.802864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.803026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.803207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.803232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.803388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.803504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.803548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.803676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.803781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.803807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.589 qpair failed and we were unable to recover it. 00:27:52.589 [2024-11-28 04:34:29.803930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.804060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.589 [2024-11-28 04:34:29.804087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.804239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.804415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.804440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.804567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.804698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.804723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.804890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.805160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.805448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.805778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.805971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.806107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.806250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.806275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.806406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.806534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.806560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.806692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.806814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.806839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.806982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.807124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.807164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.807326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.807447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.807489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.807677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.807807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.807832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.807937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.808192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.808466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.808742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.808868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.808993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.809244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.809539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.809785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.809938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.810065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.810172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.810199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.810348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.810483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.810511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.810710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.810821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.810846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.810972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.811100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.811125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.811225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.811423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.811448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.811550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.811676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.811701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.811837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.811978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.812006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.812154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.812256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.812282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.590 qpair failed and we were unable to recover it. 00:27:52.590 [2024-11-28 04:34:29.812377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.590 [2024-11-28 04:34:29.812505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.812538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.812695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.812816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.812844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.812977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.813094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.813122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.813272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.813404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.813429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.813584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.813717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.813745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.813888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.814174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.814489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.814765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.814899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.815060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.815185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.815210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.815338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.815448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.815476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.815601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.815743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.815768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.815905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.816204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.816518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.816815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.816941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.817062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.817186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.817210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.817341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.817457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.817485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.817643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.817750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.817776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.817919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.818238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.818554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.818828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.818996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.819168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.819309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.819337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.819455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.819615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.819642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.819785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.819886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.591 [2024-11-28 04:34:29.819913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.591 qpair failed and we were unable to recover it. 00:27:52.591 [2024-11-28 04:34:29.820081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.820188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.820216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.820389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.820485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.820510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.820637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.820788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.820813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.820934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.821084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.821113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.821297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.821426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.821466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.821633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.821781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.821809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.821920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.822249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.822540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.822782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.822909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.823087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.823235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.823278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.823418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.823567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.823597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.823717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.823831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.823859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.823987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.824207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.824538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.824806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.824985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.825175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.825294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.825319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.825424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.825542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.825571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.825718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.825850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.825875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.826030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.826182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.826210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.826362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.826456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.826481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.826619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.826724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.826751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.826908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.827049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.827091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.827227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.827377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.827405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.827581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.827682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.827707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.827853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.828019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.828047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.828195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.828320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.828345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.828467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.828557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.592 [2024-11-28 04:34:29.828584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.592 qpair failed and we were unable to recover it. 00:27:52.592 [2024-11-28 04:34:29.828712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.828837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.828862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.829013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.829132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.829160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.829308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.829432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.829457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.829634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.829799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.829828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.829998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.830115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.830140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.830274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.830401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.830427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.830607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.830777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.830805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.830952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.831072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.831100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.831257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.831378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.831403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.831549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.831724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.831750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.831873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.832226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.832532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.832782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.832948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.833101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.833253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.833279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.833452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.833592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.833621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.833752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.833853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.833881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.834009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.834139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.834166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.834319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.834464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.834491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.834631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.834727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.834752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.834920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.835017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.835042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.835199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.835370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.835398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.835537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.835675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.835704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.835859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.836144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.836416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.836746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.836869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.836986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.837097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.837139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.837297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.837484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.593 [2024-11-28 04:34:29.837509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.593 qpair failed and we were unable to recover it. 00:27:52.593 [2024-11-28 04:34:29.837639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.837737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.837762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.594 qpair failed and we were unable to recover it. 00:27:52.594 [2024-11-28 04:34:29.837896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.594 qpair failed and we were unable to recover it. 00:27:52.594 [2024-11-28 04:34:29.838185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.594 qpair failed and we were unable to recover it. 00:27:52.594 [2024-11-28 04:34:29.838513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.594 qpair failed and we were unable to recover it. 00:27:52.594 [2024-11-28 04:34:29.838792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.838934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.594 qpair failed and we were unable to recover it. 00:27:52.594 [2024-11-28 04:34:29.839078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.839215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.594 [2024-11-28 04:34:29.839243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.594 qpair failed and we were unable to recover it. 00:27:52.594 [2024-11-28 04:34:29.839369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.839522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.839562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.839717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.839868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.839894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.839996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.840174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.840202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.840348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.840478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.840503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.840632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.840751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.840779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.840929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.841191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.841474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.841783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.841945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.842058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.842192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.842218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.842363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.842509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.842548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.842705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.842822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.842852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.842980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.843118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.843144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.843300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.843399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.843424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.891 [2024-11-28 04:34:29.843572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.843699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.891 [2024-11-28 04:34:29.843725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.891 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.843866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.843996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.844021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.844178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.844282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.844311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.844474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.844667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.844697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.844872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.845176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.845456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.845798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.845960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.846138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.846261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.846286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.846414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.846588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.846617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.846773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.846930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.846971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.847113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.847244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.847272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.847407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.847541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.847578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.847727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.847856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.847882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.847988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.848079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.848104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.848236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.848387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.848429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.848559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.848665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.848691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.848822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.848971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.849000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.849141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.849283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.849320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.849466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.849556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.849582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.849700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.849841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.849869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.850050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.850181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.850207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.850303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.850455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.850486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.850639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.850747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.850790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.850891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.850993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.851035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.851216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.851351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.851393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.851563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.851741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.851767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.851922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.852080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.852113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.852261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.852411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.852438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.892 qpair failed and we were unable to recover it. 00:27:52.892 [2024-11-28 04:34:29.852542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.892 [2024-11-28 04:34:29.852661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.852686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.852789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.852916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.852943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.853070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.853197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.853223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.853362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.853515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.853551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.853671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.853813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.853838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.854000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.854104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.854129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.854282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.854378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.854405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.854511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.854664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.854692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.854855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.854978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.855004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.855197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.855314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.855343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.855456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.855603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.855629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.855759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.855876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.855901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.856080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.856221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.856249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.856358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.856491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.856546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.856706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.856813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.856839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.856994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.857105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.857133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.857307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.857419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.857449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.857605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.857727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.857753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.857941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.858073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.858098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.858199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.858351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.858393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.858553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.858653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.858678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.858832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.858998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.859026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.859164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.859338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.859366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.859511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.859642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.859667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.859797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.859912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.859941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.860083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.860223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.860252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.860392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.860520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.860553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.860705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.860874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.860902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.861012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.861180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.861208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.893 qpair failed and we were unable to recover it. 00:27:52.893 [2024-11-28 04:34:29.861384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.893 [2024-11-28 04:34:29.861520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.861570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.861674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.861830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.861860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.861971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.862087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.862115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.862234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.862388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.862413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.862579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.862678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.862706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.862869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.863191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.863545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.863776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.863939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.864121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.864245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.864286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.864429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.864581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.864624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.864713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.864838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.864863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.864998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.865092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.865117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.865261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.865410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.865435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.865589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.865743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.865771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.865898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.865993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.866019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.866146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.866295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.866323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.866452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.866567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.866596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.866775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.866901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.866927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.867098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.867252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.867278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.867400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.867509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.867548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.867732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.867865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.867890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.867986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.868107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.868132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.868315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.868452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.868481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.868647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.868799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.868836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.868987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.869153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.869181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.869317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.869467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.869492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.869655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.869756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.869781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.869908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.870007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.870032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.894 qpair failed and we were unable to recover it. 00:27:52.894 [2024-11-28 04:34:29.870156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.894 [2024-11-28 04:34:29.870281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.870306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.870467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.870636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.870665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.870821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.870978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.871003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.871161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.871295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.871323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.871468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.871624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.871650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.871813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.871963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.871988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.872112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.872268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.872310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.872449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.872579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.872605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.872762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.872875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.872903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.873077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.873205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.873230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.873329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.873424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.873449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.873559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.873733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.873761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.873918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.874252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.874536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.874808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.874929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.875084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.875188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.875214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.875306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.875425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.875450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.875613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.875755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.875780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.875877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.876196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.876521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.876783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.876971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.877060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.877187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.877212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.877358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.877470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.877498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.877667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.877773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.877803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.877924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.878077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.878106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.878287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.878447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.895 [2024-11-28 04:34:29.878473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.895 qpair failed and we were unable to recover it. 00:27:52.895 [2024-11-28 04:34:29.878573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.878680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.878706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.878832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.879010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.879039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.879214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.879382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.879410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.879534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.879688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.879714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.879903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.880218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.880512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.880785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.880933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.881127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.881302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.881330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.881477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.881621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.881664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.881808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.881946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.881988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.882146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.882262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.882290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.882418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.882573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.882599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.882752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.882859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.882887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.883056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.883200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.883225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.883330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.883460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.883484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.883676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.883816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.883845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.883957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.884305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.884553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.884829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.884974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.885101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.885197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.885222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.885358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.885487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.885515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.885657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.885814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.885839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.885991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.886087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.886112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.896 [2024-11-28 04:34:29.886302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.886409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.896 [2024-11-28 04:34:29.886435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.896 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.886561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.886706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.886735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.886889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.887141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.887454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.887749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.887923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.888096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.888211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.888238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.888351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.888466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.888494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.888615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.888719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.888746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.888879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.889154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.889400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.889755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.889914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.890044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.890178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.890207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.890331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.890456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.890482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.890634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.890750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.890779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.890921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.891174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.891482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.891817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.891979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.892137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.892259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.892284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.892440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.892562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.892588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.892712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.892896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.892921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.893046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.893199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.893224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.893367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.893513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.893574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.893685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.893797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.893826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.894006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.894242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.894543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.897 [2024-11-28 04:34:29.894862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.897 [2024-11-28 04:34:29.894990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.897 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.895084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.895212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.895242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.895347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.895441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.895467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.895592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.895723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.895748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.895857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.895972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.896000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.896147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.896275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.896300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.896395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.896491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.896516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.896701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.896828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.896853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.896980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.897290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.897606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.897831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.897983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.898115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.898242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.898267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.898393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.898509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.898547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.898722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.898862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.898890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.899014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.899108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.899134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.899257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.899383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.899408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.899576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.899728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.899756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.899878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.900010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.900035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.900164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.900343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.900371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.900540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.900679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.900707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.900864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.901178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.901490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.901766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.901915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.902078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.902242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.902271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.902432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.902536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.902562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.902729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.902858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.902899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.903005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.903116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.903144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.898 qpair failed and we were unable to recover it. 00:27:52.898 [2024-11-28 04:34:29.903251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.903391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.898 [2024-11-28 04:34:29.903418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.903536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.903671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.903697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.903854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.903988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.904016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.904118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.904227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.904255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.904386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.904517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.904550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.904680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.904817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.904846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.904957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.905102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.905130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.905253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.905387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.905412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.905554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.905706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.905732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.905863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.906153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.906455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.906789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.906942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.907088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.907217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.907242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.907369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.907494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.907521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.907676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.907810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.907838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.907967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.908121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.908147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.908326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.908471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.908499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.908638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.908749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.908774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.908899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.909152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.909397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.909723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.909875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.910001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.910115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.910150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.910318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.910497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.910522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.910661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.910763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.910790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.910915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.911088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.911116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.911256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.911407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.911432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.911585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.911686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.911712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.899 qpair failed and we were unable to recover it. 00:27:52.899 [2024-11-28 04:34:29.911866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.911974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.899 [2024-11-28 04:34:29.912002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.912150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.912300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.912325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.912449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.912582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.912607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.912717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.912822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.912863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.913031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.913166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.913194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.913375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.913481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.913506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.913655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.913754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.913779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.913909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.914233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.914561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.914860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.914999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.915156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.915285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.915310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.915454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.915577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.915603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.915785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.915942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.915968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.916129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.916224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.916249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.916374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.916483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.916511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.916658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.916806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.916831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.916931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.917233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.917537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.917873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.917994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.918094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.918217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.918242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.918344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.918496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.918533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.918708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.918829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.918854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.918995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.919161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.919189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.919319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.919507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.919540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.900 qpair failed and we were unable to recover it. 00:27:52.900 [2024-11-28 04:34:29.919647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.919801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.900 [2024-11-28 04:34:29.919827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.919953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.920119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.920148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.920332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.920462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.920487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.920635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.920738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.920765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.920889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.921022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.921050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.921209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.921331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.921356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.921513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.921620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.921645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.921800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.921980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.922005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.922103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.922225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.922250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.922377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.922507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.922546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.922666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.922779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.922809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.922924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.923064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.923106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.923237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.923392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.923417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.923558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.923691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.923718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.923823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.923992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.924020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.924131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.924262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.924288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.924461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.924600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.924629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.924776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.924915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.924943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.925057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.925160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.925185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.925316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.925419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.925444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.925598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.925737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.925766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.925890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.926225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.926476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.926786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.926904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.927025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.927132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.927160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.927326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.927433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.927461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.927578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.927715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.927740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.927881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.927977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.928003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.901 qpair failed and we were unable to recover it. 00:27:52.901 [2024-11-28 04:34:29.928109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.928203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.901 [2024-11-28 04:34:29.928228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.928356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.928476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.928501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.928682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.928880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.928909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.929050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.929301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.929587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.929846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.929975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.930080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.930236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.930262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.930419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.930582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.930609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.930769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.930887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.930915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.931061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.931166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.931191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.931353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.931479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.931505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.931659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.931808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.931835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.931965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.932090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.932116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.932247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.932359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.932389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.932539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.932679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.932708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.932871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.933203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.933480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.933783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.933915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.934047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.934166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.934190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.934333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.934469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.934513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.934627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.934746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.934771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.934899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.934993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.935020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.935166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.935278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.935308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.935453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.935618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.935644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.935807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.935972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.936000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.936136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.936274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.936302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.936450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.936610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.936636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.902 qpair failed and we were unable to recover it. 00:27:52.902 [2024-11-28 04:34:29.936782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.936885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.902 [2024-11-28 04:34:29.936913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.937046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.937189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.937214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.937337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.937437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.937467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.937584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.937737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.937762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.937913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.938169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.938400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.938685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.938816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.938943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.939069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.939094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.939243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.939387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.939415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.939579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.939720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.939748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.939872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.940186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.940449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.940703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.940857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.941107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.941261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.941288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.941435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.941563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.941589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.941721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.941847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.941872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.942002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.942143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.942171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.942303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.942432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.942461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.942637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.942791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.942835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.942973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.943223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.943561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.943815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.943992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.944121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.944250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.944276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.944402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.944507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.944554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.944680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.944848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.944876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.945070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.945198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.945225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.903 qpair failed and we were unable to recover it. 00:27:52.903 [2024-11-28 04:34:29.945354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.903 [2024-11-28 04:34:29.945486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.945512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.945648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.945756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.945784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.945928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.946040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.946068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.946245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.946373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.946414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.946557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.946723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.946751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.946889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.947173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.947470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.947751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.947898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.948002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.948158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.948184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.948350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.948492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.948521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.948677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.948832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.948857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.949013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.949180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.949208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.949373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.949485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.949513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.949655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.949792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.949820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.949972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.950077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.950102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.950266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.950398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.950424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.950550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.950714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.950743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.950899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.951175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.951482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.951712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.951892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.952002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.952109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.952137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.952239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.952379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.952420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.952575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.952730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.952760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.952894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.953149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.953433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.953687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.953813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.904 qpair failed and we were unable to recover it. 00:27:52.904 [2024-11-28 04:34:29.953912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.904 [2024-11-28 04:34:29.954061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.954089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.954261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.954390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.954415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.954551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.954689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.954717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.954871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.954999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.955025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.955144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.955244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.955271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.955419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.955580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.955609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.955751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.955889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.955917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.956060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.956211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.956236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.956358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.956537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.956563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.956655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.956830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.956858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.957039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.957165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.957190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.957321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.957440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.957470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.957663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.957787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.957812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.957977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.958105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.958130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.958278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.958423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.958448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.958612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.958759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.958787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.958968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.959096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.959137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.959273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.959410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.959452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.959605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.959726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.959754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.959903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.960058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.960083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.960230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.960356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.960381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.960513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.960717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.960745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.960898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.961168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.961477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.961828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.905 [2024-11-28 04:34:29.961945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.905 qpair failed and we were unable to recover it. 00:27:52.905 [2024-11-28 04:34:29.962056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.962200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.962228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.962372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.962539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.962568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.962683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.962811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.962836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.962993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.963131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.963159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.963305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.963441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.963469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.963641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.963731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.963756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.963896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.964191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.964486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.964742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.964894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.964984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.965181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.965206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.965333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.965462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.965487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.965648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.965784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.965809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.965958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.966115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.966141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.966272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.966368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.966394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.966541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.966675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.966703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.966869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.967155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.967415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.967695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.967889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.968036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.968137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.968166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.968313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.968480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.968509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.968671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.968811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.968840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.968966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.969088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.969114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.969236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.969371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.969396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.969548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.969719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.969748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.969903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.970065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.970090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.970239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.970374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.970417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.970571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.970664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.906 [2024-11-28 04:34:29.970689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.906 qpair failed and we were unable to recover it. 00:27:52.906 [2024-11-28 04:34:29.970811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.970966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.970992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.971117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.971273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.971298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.971430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.971580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.971609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.971789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.971915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.971941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.972121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.972254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.972282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.972436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.972564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.972589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.972713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.972837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.972862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.973025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.973117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.973142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.973294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.973423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.973448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.973579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.973707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.973734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.973868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.973997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.974022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.974147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.974260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.974288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.974419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.974552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.974578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.974715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.974856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.974884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.975068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.975220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.975245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.975376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.975533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.975559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.975705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.975815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.975844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.975989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.976125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.976153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.976293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.976418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.976443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.976591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.976726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.976754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.976891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.977184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.977446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.977746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.977905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.978006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.978129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.978155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.978302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.978479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.978504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.978645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.978817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.978845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.978989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.979113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.979138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.979301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.979456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.907 [2024-11-28 04:34:29.979481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.907 qpair failed and we were unable to recover it. 00:27:52.907 [2024-11-28 04:34:29.979618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.979759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.979787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.979965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.980093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.980118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.980268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.980415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.980440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.980537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.980716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.980749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.980898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.980990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.981016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.981155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.981319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.981347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.981458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.981606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.981635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.981754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.981878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.981904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.982025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.982158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.982187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.982350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.982478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.982503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.982642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.982742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.982766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.982920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.983241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.983569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.983833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.983965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.984128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.984275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.984303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.984482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.984625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.984651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.984786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.984962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.984990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.985102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.985243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.985269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.985366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.985492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.985518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.985647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.985769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.985798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.985964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.986122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.986151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.986300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.986455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.986481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.986643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.986819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.986844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.987032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.987183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.987208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.987334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.987454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.987479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.987677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.987815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.987843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.987952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.988123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.988152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.908 [2024-11-28 04:34:29.988304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.988446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.908 [2024-11-28 04:34:29.988471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.908 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.988635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.988812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.988840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.988983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.989122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.989150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.989296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.989421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.989447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.989599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.989731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.989760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.989898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.990166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.990455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.990729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.990933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.991119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.991243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.991283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.991418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.991561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.991591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.991739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.991885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.991911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.992038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.992376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.992593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.992876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.992997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.993171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.993306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.993348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.993470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.993626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.993655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.993828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.993968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.993993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.994175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.994317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.994345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.994498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.994626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.994652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.994773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.994900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.994925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.995049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.995194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.995223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.995363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.995514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.995548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.995678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.995808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.995834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.995998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.996155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.996180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.909 qpair failed and we were unable to recover it. 00:27:52.909 [2024-11-28 04:34:29.996315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.996461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.909 [2024-11-28 04:34:29.996491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.996617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.996712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.996737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.996861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.996984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.997012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.997124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.997240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.997268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.997389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.997492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.997517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.997630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.997728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.997753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.997878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.998193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.998532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.998780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.998942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.999080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.999199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.999224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.999379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.999534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.999560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:29.999676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.999793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:29.999821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.000004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.000179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.000208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.000377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.000473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.000501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.000652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.000772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.000802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.000916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.001207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.001444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.001711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.001870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.002051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.002175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.002204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.002350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.002491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.002519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.002661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.002814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.002840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.002991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.003159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.003188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.003306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.003447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.003476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.003631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.003754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.003779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.003941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.004122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.004150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.004264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.004431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.004459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.004576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.004699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.004725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.910 qpair failed and we were unable to recover it. 00:27:52.910 [2024-11-28 04:34:30.004861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.910 [2024-11-28 04:34:30.004968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.004995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.006970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.007102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.007133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.007286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.007447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.007475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.007581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.007702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.007728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.007834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.007988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.008017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.008187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.008329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.008357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.008482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.008609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.008636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.008761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.008872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.008900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.009039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.009177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.009206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.009352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.009488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.009517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.009654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.009791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.009837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.010013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.010157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.010187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.010334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.010489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.010515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.010650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.010757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.010782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.010930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.011214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.011453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.011756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.011904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.012110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.012222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.012251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.012389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.012499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.012532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.012659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.012823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.012851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.012957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.013236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.013534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.013835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.013974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.014150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.014290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.014318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.014442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.014576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.014602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.014703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.014843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.014886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.015042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.015235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.015261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.911 qpair failed and we were unable to recover it. 00:27:52.911 [2024-11-28 04:34:30.015384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.911 [2024-11-28 04:34:30.015567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.015594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.015693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.015849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.015874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.016030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.016186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.016211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.016308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.016440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.016466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.016591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.016743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.016768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.016905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.017243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.017564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.017822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.017964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.018110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.018239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.018265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.018393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.018550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.018577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.018708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.018851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.018879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.019001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.019278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.019543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.019820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.019999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.020096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.020195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.020221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.020382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.020504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.020536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.020649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.020744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.020769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.020890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.020995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.021023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.021162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.021305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.021348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.021457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.021587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.021614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.021753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.021887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.021913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.022031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.022318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.022595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.022860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.022996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.023122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.023251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.023278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.023455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.023617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.023644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.912 qpair failed and we were unable to recover it. 00:27:52.912 [2024-11-28 04:34:30.023751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.912 [2024-11-28 04:34:30.023904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.023930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.024055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.024152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.024177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.024318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.024433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.024461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.024596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.024724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.024750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.024877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.024978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.025004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.025129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.025235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.025263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.025424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.025548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.025575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.025740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.025869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.025912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.026054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.026155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.026184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.026326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.026496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.026532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.026650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.026780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.026805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.026968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.027135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.027161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.027260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.027407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.027436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.027616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.027750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.027776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.027936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.028230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.028452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.028709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.028833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.028975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.029158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.029183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.029311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.029443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.029469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.029621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.029721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.029747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.029870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.029990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.030016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.030143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.030274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.030300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.030401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.030519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.030552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.030707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.030812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.030837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.030976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.031106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.031133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.031262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.031373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.031401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.031542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.031692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.031718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.913 qpair failed and we were unable to recover it. 00:27:52.913 [2024-11-28 04:34:30.031844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.031974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.913 [2024-11-28 04:34:30.032000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.032122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.032272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.032298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.032429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.032564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.032590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.032714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.032840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.032866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.032996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.033272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.033534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.033801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.033963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.034128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.034288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.034325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.035016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.035285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.035570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.035799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.035970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.036140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.036335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.036364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.036504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.036638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.036666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.036811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.036953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.036981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.037145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.037275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.037301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.037486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.037621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.037652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.037785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.037943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.037972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.038085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.038264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.038293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.038422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.038536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.038563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.038714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.038816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.038842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.038942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.039153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.039423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.039736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.039862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.914 qpair failed and we were unable to recover it. 00:27:52.914 [2024-11-28 04:34:30.039968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.914 [2024-11-28 04:34:30.040095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.040121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.040253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.040358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.040385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.040573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.040668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.040694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.040796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.040925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.040951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.041077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.041198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.041225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.041376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.041523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.041555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.041647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.041779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.041805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.041975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.042082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.042110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.042251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.042396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.042421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.042623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.042750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.042775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.042939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.043202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.043465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.043780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.043930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.044109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.044224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.044254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.044379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.044579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.044605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.044734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.044838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.044863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.044961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.045211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.045471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.045705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.045846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.045968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.046230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.046537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.046791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.046937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.047080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.047220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.047249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.047386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.047503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.047558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.047712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.047845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.047871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.047973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.048081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.048107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.915 qpair failed and we were unable to recover it. 00:27:52.915 [2024-11-28 04:34:30.048203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.915 [2024-11-28 04:34:30.048327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.048352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.048472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.048596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.048623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.048776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.048893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.048935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.049097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.049234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.049270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.049389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.049586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.049613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.049711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.049828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.049856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.050023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.050131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.050161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.050295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.050427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.050456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.050599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.050703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.050729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.050884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.051173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.051441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.051725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.051869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.052028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.052184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.052231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.052398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.052539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.052582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.052682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.052813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.052839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.052942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.053068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.053094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.053257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.053380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.053406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.053560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.053715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.053741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.053876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.054188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.054468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.054767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.054914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.055083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.055212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.055238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.055395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.055550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.055580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.055734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.055839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.055866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.055962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.056119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.056145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.056299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.056447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.056475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.056625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.056783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.056809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.916 qpair failed and we were unable to recover it. 00:27:52.916 [2024-11-28 04:34:30.056971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.916 [2024-11-28 04:34:30.057096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.057124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.057292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.057462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.057490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.057627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.057725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.057750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.057904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.058215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.058508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.058801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.058951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.059127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.059238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.059267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.059430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.059600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.059628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.059759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.059881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.059910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.060053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.060206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.060232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.060382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.060548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.060591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.060716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.060840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.060882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.060983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.061093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.061119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.061228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.061393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.061435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.061592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.061736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.061762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.061895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.062243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.062537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.062770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.062921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.063048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.063180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.063208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.063356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.063465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.063493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.063677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.063780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.063807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.063935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.064206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.064505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.064816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.064937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.065068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.065165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.065208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.065314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.065423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.917 [2024-11-28 04:34:30.065451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.917 qpair failed and we were unable to recover it. 00:27:52.917 [2024-11-28 04:34:30.065593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.065717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.065742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.065896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.066039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.066065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.066173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.066352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.066380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.066522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.066695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.066721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.066831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.066974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.067004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.067116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.067245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.067271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.067421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.067561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.067587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.067722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.067828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.067871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.067983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.068132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.068161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.068282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.068402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.068430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.068620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.068751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.068776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.068937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.069281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.069549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.069788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.069967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.070064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.070191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.070217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.070359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.070468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.070497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.070656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.070787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.070813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.070971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.071093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.071133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.071249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.071396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.071438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.071600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.071693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.071719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.071875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.072195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.072537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.072775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.918 [2024-11-28 04:34:30.072926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.918 qpair failed and we were unable to recover it. 00:27:52.918 [2024-11-28 04:34:30.073067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.073218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.073248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.073412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.073578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.073605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.073708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.073861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.073887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.074032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.074177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.074205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.074348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.074489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.074517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.074654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.074751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.074776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.074930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.075110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.075135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.075283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.075391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.075419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.075567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.075664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.075689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.075859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.076186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.076501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.076742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.076928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.077067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.077175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.077203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.077326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.077487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.077515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.077679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.077813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.077838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.077989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.078277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.078566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.078828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.078986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.079110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.079206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.079232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.079408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.079585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.079611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.079706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.079869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.079901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.080034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.080194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.080222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.080359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.080533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.080562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.080681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.080810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.080836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.080962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.081089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.081114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.081220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.081338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.081367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.919 [2024-11-28 04:34:30.081523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.081670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.919 [2024-11-28 04:34:30.081696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.919 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.081827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.081968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.081993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.082147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.082316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.082344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.082458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.082608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.082634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.082739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.082842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.082868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.082996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.083126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.083151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.083294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.083491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.083519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.083678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.083770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.083796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.083897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.084040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.084068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.084236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.084451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.084479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.084609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.084759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.084785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.084942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.085261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.085568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.085831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.085981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.086107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.086243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.086271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.086438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.086593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.086618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.086754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.086882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.086907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.087113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.087277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.087305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.087469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.087607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.087649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.087746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.087910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.087936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.088115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.088230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.088255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.088378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.088594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.088620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.088743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.088848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.088875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.089052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.089165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.089194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.089352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.089490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.089515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.089683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.089789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.089814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.090019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.090174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.090217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.090388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.090571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.090597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.920 qpair failed and we were unable to recover it. 00:27:52.920 [2024-11-28 04:34:30.090726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.920 [2024-11-28 04:34:30.090856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.090881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.090978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.091267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.091552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.091798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.091942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.092081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.092205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.092231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.092362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.092494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.092523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.092669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.092769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.092794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.092965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.093231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.093499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.093796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.093922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.094042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.094165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.094193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.094365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.094470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.094498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.094688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.094835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.094863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.094998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.095271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.095563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.095825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.095976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.096121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.096267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.096295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.096412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.096539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.096565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.096695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.096827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.096853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.096994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.097105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.097133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.097248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.097436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.097464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.097613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.097714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.097739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.097912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.098231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.098577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.098841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.098996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.921 qpair failed and we were unable to recover it. 00:27:52.921 [2024-11-28 04:34:30.099122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.921 [2024-11-28 04:34:30.099259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.099285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.099405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.099521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.099574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.099726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.099829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.099854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.100019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.100118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.100144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.100315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.100498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.100532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.100665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.100817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.100845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.101012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.101151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.101179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.101329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.101471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.101499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.101664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.101757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.101783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.101920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.102165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.102479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.102810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.102986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.103135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.103302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.103331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.103559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.103677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.103702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.103859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.104169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.104537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.104833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.104969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.105109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.105240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.105269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.105437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.105582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.105608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.105713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.105831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.105860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.106002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.106140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.106168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.106334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.106457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.106482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.106610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.106771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.106796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.106947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.107092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.107120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.107257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.107424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.107452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.107610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.107763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.107789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.107970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.108120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.108160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.922 qpair failed and we were unable to recover it. 00:27:52.922 [2024-11-28 04:34:30.108316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.922 [2024-11-28 04:34:30.108455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.108483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.108640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.108769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.108794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.108919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.109060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.109088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.109257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.109407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.109435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.109611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.109760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.109785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.109931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.110212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.110552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.110865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.110999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.111109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.111274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.111302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.111471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.111624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.111653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.111775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.111917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.111945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.112061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.112212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.112237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.112364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.112486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.112511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.112643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.112814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.112839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.112979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.113132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.113158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.113319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.113494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.113522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.113663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.113761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.113787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.113918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.114028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.114056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.114204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.114358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.114383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.114566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.114720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.114745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.114888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.115280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.115565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.115809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.115951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.116093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.116237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.923 [2024-11-28 04:34:30.116266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.923 qpair failed and we were unable to recover it. 00:27:52.923 [2024-11-28 04:34:30.116410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.116531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.116574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.116672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.116813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.116841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.116965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.117118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.117143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.117269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.117437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.117464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.117597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.117732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.117759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.117932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.118176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.118472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.118786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.118940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.119072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.119220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.119248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.119397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.119539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.119583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.119724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.119906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.119933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.120111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.120264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.120292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.120434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.120593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.120619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.120715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.120877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.120903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.121029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.121136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.121164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.121320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.121459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.121484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.121615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.121742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.121769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.121896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.122061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.122087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.122261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.122371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.122399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.122552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.122699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.122724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.122880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.123212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.123476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.123757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.123939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.124074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.124226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.124254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.124417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.124559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.124585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.124711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.124841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.124866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.924 qpair failed and we were unable to recover it. 00:27:52.924 [2024-11-28 04:34:30.124988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.924 [2024-11-28 04:34:30.125145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.125173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.125333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.125447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.125475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.125634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.125766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.125792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.125946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.126047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.126076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.126194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.126351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.126376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.126521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.126676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.126704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.126872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.127196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.127539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.127823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.127984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.128108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.128215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.128241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.128362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.128498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.128535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.128707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.128851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.128879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.129020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.129129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.129157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.129301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.129450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.129478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.129612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.129747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.129773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.129869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.129991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.130016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.130205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.130333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.130358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.130497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.130636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.130663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.130765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.130896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.130922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.131113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.131250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.131275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.131400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.131521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.131558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.131678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.131817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.131842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.131964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.132112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.132140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.132247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.132392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.132420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.132589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.132693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.132718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.132824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.132977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.133005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.133152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.133292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.133321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.133467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.133563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.133589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.925 qpair failed and we were unable to recover it. 00:27:52.925 [2024-11-28 04:34:30.133721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.925 [2024-11-28 04:34:30.133844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.133887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.134021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.134157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.134185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.134304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.134472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.134498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.134675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.134779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.134804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.134937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.135047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.135075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.135241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.135335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.135361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.135522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.135688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.135714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.135893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.136210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.136537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.136835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.136998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.137199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.137344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.137372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.137557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.137659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.137684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.137825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.137994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.138022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.138166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.138266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.138292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.138425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.138540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.138584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.138712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.138902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.138927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.139062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.139195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.139220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.139411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.139614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.139640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.139814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.139928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.139956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.140100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.140237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.140262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.140362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.140515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.140566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.140726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.140839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.140868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.141045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.141170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.141212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.141327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.141432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.141461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.141616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.141744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.141769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.141877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.141974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.142000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.142135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.142326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.142351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.142479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.142655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.142684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.926 qpair failed and we were unable to recover it. 00:27:52.926 [2024-11-28 04:34:30.142849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.926 [2024-11-28 04:34:30.142978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.143003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.143155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.143262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.143287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.143434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.143585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.143611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.143711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.143838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.143865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.143989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.144169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.144195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.144351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.144501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.144535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.144683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.144821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.144847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.145003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.145168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.145196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.145383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.145631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.145657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.145812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.145996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.146055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.146198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.146324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.146351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.146517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.146657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.146685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.146813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.146947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.146972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.147070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.147173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.147198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.147304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.147420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.147449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.147629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.147760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.147785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.147914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.148155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.148433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.148714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.148897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.149075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.149219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.149247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.149388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.149551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.149594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.149727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.149830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.149856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.149965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.150107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.150135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.150313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.150451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.150493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.150652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.150755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.150782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.150910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.151057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.151082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.927 qpair failed and we were unable to recover it. 00:27:52.927 [2024-11-28 04:34:30.151207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.151346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.927 [2024-11-28 04:34:30.151372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.151564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.151690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.151715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.151816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.151942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.151970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.152113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.152217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.152246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.152352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.152497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.152534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.152694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.152837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.152865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.153039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.153301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.153539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.153828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.153982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.154132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.154237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.154265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.154431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.154570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.154598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.154746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.154848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.154873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.155002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.155099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.155142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.155262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.155406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.155435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.155582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.155738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.155763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.155914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.156053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.156082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.156270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.156428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.156456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.156638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.156791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.156816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.156969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.157121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.157149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.157289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.157454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.157482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.157639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.157799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.157840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.157983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.158163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.158188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.158317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.158487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.158515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.158699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.158857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.158882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.159047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.159140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.159165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.159273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.159385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.159413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.928 [2024-11-28 04:34:30.159546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.159677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.928 [2024-11-28 04:34:30.159703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.928 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.159812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.159977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.160005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.160115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.160224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.160267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.160450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.160603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.160629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.160767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.160928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.160976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.161120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.161263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.161291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.161426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.161540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.161583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.161703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.161840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.161865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.161995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.162112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.162140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.162288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.162442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.162468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.162661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.162791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:52.929 [2024-11-28 04:34:30.162833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:52.929 qpair failed and we were unable to recover it. 00:27:52.929 [2024-11-28 04:34:30.162940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.163228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.163536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.163776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.163992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.164121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.164248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.164273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.164394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.164514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.164554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.164679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.164839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.164866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.164993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.165109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.165138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.165274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.165393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.165422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.165587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.165732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.165758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.165892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.166179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.166434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.166657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.166822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.211 qpair failed and we were unable to recover it. 00:27:53.211 [2024-11-28 04:34:30.166981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.211 [2024-11-28 04:34:30.167092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.167120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.167243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.167398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.167423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.167560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.167669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.167700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.167796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.167932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.167957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.168058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.168196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.168224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.168393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.168537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.168581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.168681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.168784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.168826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.168940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.169240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.169532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.169817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.169953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.170130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.170278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.170306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.170420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.170583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.170609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.170715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.170814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.170839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.170947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.171259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.171518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.171777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.171935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.172067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.172177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.172207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.172375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.172522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.172553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.172699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.172827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.172868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.173019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.173162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.173190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.173319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.173430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.173458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.173615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.173742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.173767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.173917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.174035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.174065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.174261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.174429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.174458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.174612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.174755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.174780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.174966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.175066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.175091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.212 [2024-11-28 04:34:30.175241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.175368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.212 [2024-11-28 04:34:30.175393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.212 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.175573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.175702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.175727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.175914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.176206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.176489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.176774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.176928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.177063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.177174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.177203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.177370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.177509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.177545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.177709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.177834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.177860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.177987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.178137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.178165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.178292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.178446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.178474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.178608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.178733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.178758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.178862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.178985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.179011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.179108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.179231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.179256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.179399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.179539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.179583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.179683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.179776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.179816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.179975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.180248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.180538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.180802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.180915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.181057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.181226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.181254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.181362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.181531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.181574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.181702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.181839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.181867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.181975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.182084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.182112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.182231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.182405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.182433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.182582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.182705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.182730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.182895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.183177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.183514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.213 qpair failed and we were unable to recover it. 00:27:53.213 [2024-11-28 04:34:30.183750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.213 [2024-11-28 04:34:30.183907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.184016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.184180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.184207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.184358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.184497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.184576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.184690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.184845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.184873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.185014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.185162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.185190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.185392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.185539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.185583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.185716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.185855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.185883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.186029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.186165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.186194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.186362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.186503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.186537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.186660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.186794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.186819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.186914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.187257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.187573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.187831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.187999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.188145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.188282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.188308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.188488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.188664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.188694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.188825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.188993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.189021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.189182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.189301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.189326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.189449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.189611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.189637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.189742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.189883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.189911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.190063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.190214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.190240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.190363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.190513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.190545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.190646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.190751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.190776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.190906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.191241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.191481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.191792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.191943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.192060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.192206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.192236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.192408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.192553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.192582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.214 qpair failed and we were unable to recover it. 00:27:53.214 [2024-11-28 04:34:30.192752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.214 [2024-11-28 04:34:30.192877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.192901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.193049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.193189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.193217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.193358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.193496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.193532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.193708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.193834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.193875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.194013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.194121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.194151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.194300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.194436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.194464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.194611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.194715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.194741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.194887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.195033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.195061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.195182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.195348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.195380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.195535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.195675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.195700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.195852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.196017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.196045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.196156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.196351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.196376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.196513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.196684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.196709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.196865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.196998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.197026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.197136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.197316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.197344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.197467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.197602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.197628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.197766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.197918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.197947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.198056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.198193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.198235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.198413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.198531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.198574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.198720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.198898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.198926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.199036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.199209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.199237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.199404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.199539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.199582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.199704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.199834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.199859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.199981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.200174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.200202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.200343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.200450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.200476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.200617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.200766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.200794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.200962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.201096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.201124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.201301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.201445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.201473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.215 [2024-11-28 04:34:30.201617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.201745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.215 [2024-11-28 04:34:30.201771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.215 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.201936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.202082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.202110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.202264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.202415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.202456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.202605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.202713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.202739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.202896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.203073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.203101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.203246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.203416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.203444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.203599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.203753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.203779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.203921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.204071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.204100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.204312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.204447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.204474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.204640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.204771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.204796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.204892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.205038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.205066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.205220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.205344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.205374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.205540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.205713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.205738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.205910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.206098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.206123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.206277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.206370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.206411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.206596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.206736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.206761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.206919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.207042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.207067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.207247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.207388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.207416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.207577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.207728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.207754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.207897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.208040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.208065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.208216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.208329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.208357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.208542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.208676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.208701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.208857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.208990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.209018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.209160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.209322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.209347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.209499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.209623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.216 [2024-11-28 04:34:30.209653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.216 qpair failed and we were unable to recover it. 00:27:53.216 [2024-11-28 04:34:30.209806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.209939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.209964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.210097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.210256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.210282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.210460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.210610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.210637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.210761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.210886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.210913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.211046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.211291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.211584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.211831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.211948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.212099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.212238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.212267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.212412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.212548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.212590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.212726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.212829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.212856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.213014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.213144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.213170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.213299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.213398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.213440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.213592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.213719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.213745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.213863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.214161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.214457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.214759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.214965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.215073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.215245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.215271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.215386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.215539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.215565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.215686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.215835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.215860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.215984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.216116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.216144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.216285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.216412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.216438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.216567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.216725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.216750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.216873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.217206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.217549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.217799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.217932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.217 [2024-11-28 04:34:30.218025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.218151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.217 [2024-11-28 04:34:30.218176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.217 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.218326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.218440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.218468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.218581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.218713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.218741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.218896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.218997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.219022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.219174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.219311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.219340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.219477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.219634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.219661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.219761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.219913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.219939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.220054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.220190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.220219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.220352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.220488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.220515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.220646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.220743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.220769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.220939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.221074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.221102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.221276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.221466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.221494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.221654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.221778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.221803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.221939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.222089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.222117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.222284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.222423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.222451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.222603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.222731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.222756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.222892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.223233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.223497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.223771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.223899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.224030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.224230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.224255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.224386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.224542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.224568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.224717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.224832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.224858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.225031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.225173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.225201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.225324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.225488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.225513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.225652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.225771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.225799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.225950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.226068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.226093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.226223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.226353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.226378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.226504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.226696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.226727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.226865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.227045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.218 [2024-11-28 04:34:30.227070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.218 qpair failed and we were unable to recover it. 00:27:53.218 [2024-11-28 04:34:30.227171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.227310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.227335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.227487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.227678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.227704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.227833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.227957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.227985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.228175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.228272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.228297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.228416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.228570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.228599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.228752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.228907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.228932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.229062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.229193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.229218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.229375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.229517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.229568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.229712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.229848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.229876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.229989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.230118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.230143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.230308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.230447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.230475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.230597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.230776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.230801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.230926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.231245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.231542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.231843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.231996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.232119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.232234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.232265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.232404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.232554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.232583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.232730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.232886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.232928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.233086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.233241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.233266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.233380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.233568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.233594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.233698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.233818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.233843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.234009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.234165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.234193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.234407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.235031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.235064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.235205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.235336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.235362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.235559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.235684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.235713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.235883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.236040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.236065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.236190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.236323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.236349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.219 [2024-11-28 04:34:30.236503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.236667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.219 [2024-11-28 04:34:30.236696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.219 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.236808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.236987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.237020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.237206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.237367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.237395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.237541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.237684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.237712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.237854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.237994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.238022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.238193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.238295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.238321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.238439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.238562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.238605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.238732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.238919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.238947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.239120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.239295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.239324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.239538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.239669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.239695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.239833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.239935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.239960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.240067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.240221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.240249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.240409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.240538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.240583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.240739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.240863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.240888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.241046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.241207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.241233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.241365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.241483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.241512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.241712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.241815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.241848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.242012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.242189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.242228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.242375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.242494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.242523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.242668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.242810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.242835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.242957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.243080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.243110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.243231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.243369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.243395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.243572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.243728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.243754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.243878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.244057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.244085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.244203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.244335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.244365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.220 [2024-11-28 04:34:30.244521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.244671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.220 [2024-11-28 04:34:30.244697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.220 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.244825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.244956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.244984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.245092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.245233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.245261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.245440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.245568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.245597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.245712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.245827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.245853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.246006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.246289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.246521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.246792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.246956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.247085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.247196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.247224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.247346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.247491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.247520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.247658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.247786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.247827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.247959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.248113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.248139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.248305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.248454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.248482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.248607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.248731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.248757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.248893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.249002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.249050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.249147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.249271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.249297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.249422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.249576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.249606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.249726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.250407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.250439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.250573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.250720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.250749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.250884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.250987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.251012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.251164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.251311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.251339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.251507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.251661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.251690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.251809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.252191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.252509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.252776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.252913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.253079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.253235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.253260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.253484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.253638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.253667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.221 [2024-11-28 04:34:30.253804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.253977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.221 [2024-11-28 04:34:30.254002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.221 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.254177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.254281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.254307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.254410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.254539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.254566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.254673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.254784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.254810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.254954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.255294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.255536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.255808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.255985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.256131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.256322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.256350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.256536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.256690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.256720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.256814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.256953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.256979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.257084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.257240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.257265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.257383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.257493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.257520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.257647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.257767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.257795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.257919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.258074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.258099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.258304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.258450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.258478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.258605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.258730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.258758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.258884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.259200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.259516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.259795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.259974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.260081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.260198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.260227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.260397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.260538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.260567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.260698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.260788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.260814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.260969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.261077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.261105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.261290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.261411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.261437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.261595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.261703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.261731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.261856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.261988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.262014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.262119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.262232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.262261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.222 [2024-11-28 04:34:30.262376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.262513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.222 [2024-11-28 04:34:30.262555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.222 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.262670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.262786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.262814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.262941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.263290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.263533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.263784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.263931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.264060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.264157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.264182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.264318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.264498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.264536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.264685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.264837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.264865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.265039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.265144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.265169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.265286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.265421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.265451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.265583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.265682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.265708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.265841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.265985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.266013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.266188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.266301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.266329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.266443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.266545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.266571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.266676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.266780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.266805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.266899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.267191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.267467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.267721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.267897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.268047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.268185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.268214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.268395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.268488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.268517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.268666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.268762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.268787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.268932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.269103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.269131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.269241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.269382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.269410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.269547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.269697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.269725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.269879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.270201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.270469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.223 [2024-11-28 04:34:30.270806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.223 [2024-11-28 04:34:30.270955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.223 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.271111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.271215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.271242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.271393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.271511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.271548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.271676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.271833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.271858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.271992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.272252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.272587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.272819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.272976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.273102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.273232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.273260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.273409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.273515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.273549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.273652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.273756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.273781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.273897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.274208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.274500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.274746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.274866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.275007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.275185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.275210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.275341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.275437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.275480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.275659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.275788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.275813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.275940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.276041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.276069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.276187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.276336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.276364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.276553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.276710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.276736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.276915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.277028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.277064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.277189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.277335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.277363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.277502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.277691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.277724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.277913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.278082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.278111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.278234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.278378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.278408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.278575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.278685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.278715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.278865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.278998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.279027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.279158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.279299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.279333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.224 [2024-11-28 04:34:30.279500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.279629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.224 [2024-11-28 04:34:30.279659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.224 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.279779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.279954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.279983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.280157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.280342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.280374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.280519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.280655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.280684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.280802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.280951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.280981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.281159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.281289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.281325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.281543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.281660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.281689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.281810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.281983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.282012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.282192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.282332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.282378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.282565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.282677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.282706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.282876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.283067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.283096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.283214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.283380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.283413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.283566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.283683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.283713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.283906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.284266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.284587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.284826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.284963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.285098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.285271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.285299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.285470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.285608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.285634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.285742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.285880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.285908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.286070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.286204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.286229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.286380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.286484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.286520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.286662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.286766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.286792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.286920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.287072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.287097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.287195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.287326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.287355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.287480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.287620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.287646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.225 qpair failed and we were unable to recover it. 00:27:53.225 [2024-11-28 04:34:30.287755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.225 [2024-11-28 04:34:30.287856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.287898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.288038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.288190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.288216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.288346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.288471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.288496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.288605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.288714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.288739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.288833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.288985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.289013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.289163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.289305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.289334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.289463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.289568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.289594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.289694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.289875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.289900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.290039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.290139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.290169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.290315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.290489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.290522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.290642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.290734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.290759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.290878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.291182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.291479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.291796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.291991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.292145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.292250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.292278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.292433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.292576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.292602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.292700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.292801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.292849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.293001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.293127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.293152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.293307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.293422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.293450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.293632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.293756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.293781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.293926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.294100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.294128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.294275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.294400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.294426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.294556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.294710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.294735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.294886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.295211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.295512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.295772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.295998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.296155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.296261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.296288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.226 qpair failed and we were unable to recover it. 00:27:53.226 [2024-11-28 04:34:30.296395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.226 [2024-11-28 04:34:30.296503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.296534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.296639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.296735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.296760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.296886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.297230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.297522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.297778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.297937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.298114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.298209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.298237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.298392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.298546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.298588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.298692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.298799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.298825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.298995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.299127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.299170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.299318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.299538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.299565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.299696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.299796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.299839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.299974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.300076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.300118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.300240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.300346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.300371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.300559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.300713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.300739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.300924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.301063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.301088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.301245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.301381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.301409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.301553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.301710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.301735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.301886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.302195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.302539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.302807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.302960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.303130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.303306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.303331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.303487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.303641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.303671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.303807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.303977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.304003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.304101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.304222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.304248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.304379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.304536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.304565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.304705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.304849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.304901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.305040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.305185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.305227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.227 qpair failed and we were unable to recover it. 00:27:53.227 [2024-11-28 04:34:30.305348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.227 [2024-11-28 04:34:30.305483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.305521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.305680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.305861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.305889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.306051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.306177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.306203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.306307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.306458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.306488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.306658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.306782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.306808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.306968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.307124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.307152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.307338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.307463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.307488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.307701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.307886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.307912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.308081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.308204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.308245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.308369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.308487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.308515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.308679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.308821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.308849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.308996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.309132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.309160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.309309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.309472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.309515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.309647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.309764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.309792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.309957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.310105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.310133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.310275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.310420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.310448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.310633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.310766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.310791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.310949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.311136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.311161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.311284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.311397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.311422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.311606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.311748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.311776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.311901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.312025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.312051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.312210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.312345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.312371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.312538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.312643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.312669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.312796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.312978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.313006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.313161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.313318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.313343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.313530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.313682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.313708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.313861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.313990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.314020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.314198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.314373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.314398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.314542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.314700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.314741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.228 qpair failed and we were unable to recover it. 00:27:53.228 [2024-11-28 04:34:30.314855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.228 [2024-11-28 04:34:30.315000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.315028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.315132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.315291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.315317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.315456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.315595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.315622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.315745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.315845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.315870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.316027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.316143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.316171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.316361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.316474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.316499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.316645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.316778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.316803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.316953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.317236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.317518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.317807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.317993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.318168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.318298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.318323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.318459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.318618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.318644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.318778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.318964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.318993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.319162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.319336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.319362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.319532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.319662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.319687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.319792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.319896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.319923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.320045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.320196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.320231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.320391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.320514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.320545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.320681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.320784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.320819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.320971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.321120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.321148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.321287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.321428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.321458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.321631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.321777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.321805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.321924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.322053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.322077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.322199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.322393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.322419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.229 qpair failed and we were unable to recover it. 00:27:53.229 [2024-11-28 04:34:30.322571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 4018358 Killed "${NVMF_APP[@]}" "$@" 00:27:53.229 [2024-11-28 04:34:30.322683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.229 [2024-11-28 04:34:30.322709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.322816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.322944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:53.230 [2024-11-28 04:34:30.322969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.323095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:53.230 [2024-11-28 04:34:30.323192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.323217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 04:34:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:53.230 [2024-11-28 04:34:30.323349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:53.230 [2024-11-28 04:34:30.323450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.323477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 04:34:30 -- common/autotest_common.sh@10 -- # set +x 00:27:53.230 [2024-11-28 04:34:30.323621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.323755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.323781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.323894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.323989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.324015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.324147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.324268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.324293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.324449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.324574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.324603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.324749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.324861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.324889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.325053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.325160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.325186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.325329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.325552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.325599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.325718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.325878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.325906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.326029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.326160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.326186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.326321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.326419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.326444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.326552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.326653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.326679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.326817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- nvmf/common.sh@469 -- # nvmfpid=4019027 00:27:53.230 [2024-11-28 04:34:30.326930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.326956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 04:34:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 04:34:30 -- nvmf/common.sh@470 -- # waitforlisten 4019027 00:27:53.230 [2024-11-28 04:34:30.327171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- common/autotest_common.sh@829 -- # '[' -z 4019027 ']' 00:27:53.230 [2024-11-28 04:34:30.327292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.327317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 04:34:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:53.230 [2024-11-28 04:34:30.327426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:53.230 [2024-11-28 04:34:30.327575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:53.230 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:53.230 [2024-11-28 04:34:30.327601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.327710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 04:34:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:53.230 [2024-11-28 04:34:30.327817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.327843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 04:34:30 -- common/autotest_common.sh@10 -- # set +x 00:27:53.230 [2024-11-28 04:34:30.327970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.328228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.328493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.328774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.328973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.329093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.329211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.329240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.329349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.329489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.329537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.329675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.329815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.329845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.230 qpair failed and we were unable to recover it. 00:27:53.230 [2024-11-28 04:34:30.329942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.230 [2024-11-28 04:34:30.330090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.330116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.330247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.330350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.330375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.330509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.330652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.330678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.330832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.330946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.330974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.331101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.331236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.331261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.331359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.331507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.331545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.331706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.331848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.331875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.332030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.332199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.332225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.332359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.332463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.332488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.332608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.332741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.332766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.332901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.333057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.333083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.333234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.333348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.333375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.333491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.333675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.333701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.333804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.333996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.334025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.334166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.334327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.334353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.334455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.334564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.334591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.334697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.334817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.334842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.334968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.335267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.335548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.335817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.335970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.336104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.336249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.336277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.336429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.336557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.336584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.336692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.336794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.336820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.336919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.337181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.337464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.337738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.337874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.338028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.338181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.231 [2024-11-28 04:34:30.338222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.231 qpair failed and we were unable to recover it. 00:27:53.231 [2024-11-28 04:34:30.338393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.338538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.338565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.338666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.339491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.339545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.339696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.339836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.339862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.340014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.340106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.340132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.340296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.340433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.340460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.340589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.340729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.340756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.340905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.341188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.341557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.341832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.341997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.342122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.342256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.342283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.342407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.342536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.342562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.342665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.342771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.342797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.342953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.343225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.343487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.343734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.343948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.344077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.344229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.344255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.344361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.344475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.344502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.344633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.344733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.344759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.344888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.345059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.345084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.345190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.345308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.345334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.345467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.346226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.346257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.346413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.347247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.347503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.347765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.347954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.348085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.348193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.348218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.348375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.348483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.232 [2024-11-28 04:34:30.348508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.232 qpair failed and we were unable to recover it. 00:27:53.232 [2024-11-28 04:34:30.348619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.348722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.348747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.348854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.348958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.348983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.349112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.349216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.349241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.349353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.349450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.349480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.349623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.349736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.349762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.349857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.349988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.350014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.350793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.350981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.351009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.351884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.352042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.352069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.352177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.352324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.352360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.352597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.352719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.352751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.352924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.353180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.353442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.353684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.353808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.353923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.354199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.354495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.354729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.354898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.355002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.355256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.355546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.355785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.355943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.356072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.356175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.356200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.356331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.356461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.356486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.356602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.356703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.356729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.356868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.357134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.357356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.357647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.233 [2024-11-28 04:34:30.357780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.233 qpair failed and we were unable to recover it. 00:27:53.233 [2024-11-28 04:34:30.357894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.358152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.358414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.358659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.358788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.358924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.359287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.359538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.359762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.359943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.360044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.360318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.360562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.360791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.360939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.361039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.361201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.361227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.361387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.361506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.361547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.361652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.361750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.361775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.361886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.361983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.362133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.362394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.362635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.362878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.362999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.363125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.363248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.363274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.363417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.363559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.363585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.363694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.363814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.363847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.363940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.364065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.364091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.364215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.364312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.364338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.364467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.364580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.234 [2024-11-28 04:34:30.364610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.234 qpair failed and we were unable to recover it. 00:27:53.234 [2024-11-28 04:34:30.364717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.364815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.364840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.364938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.365198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.365459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.365758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.365908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.366037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.366271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.366565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.366832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.366984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.367084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.367179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.367204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.367338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.367477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.367503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.367632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.367762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.367787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.367904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.368165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.368406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.368711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.368837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.368949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.369206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.369422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.369645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.369884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.369983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.370008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.370111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.370270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.370295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.370435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.370576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.370602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.370755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.370861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.370886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.370987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.371232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.371463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:53.235 [2024-11-28 04:34:30.371584] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:53.235 [2024-11-28 04:34:30.371600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.371731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.235 [2024-11-28 04:34:30.371859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.235 qpair failed and we were unable to recover it. 00:27:53.235 [2024-11-28 04:34:30.371966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.372204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.372443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.372684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.372898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.372991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.373115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.373366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.373637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.373889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.373983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.374008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.374105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.374216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.374241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.374369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.374478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.374505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.374661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.374788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.374818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.374945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.375200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.375501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.375756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.375890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.375993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.376295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.376521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.376760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.376886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.376981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.377293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.377587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.377817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.377941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.378045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.378294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.378531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.378750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.378888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.378984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.379081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.236 [2024-11-28 04:34:30.379106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.236 qpair failed and we were unable to recover it. 00:27:53.236 [2024-11-28 04:34:30.379246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.379403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.379428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.379554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.379674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.379699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.379808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.379940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.379966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.380100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.380221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.380246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.380387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.380543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.380570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.380698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.380798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.380825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.380984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.381207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.381488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.381822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.381949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.382050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.382338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.382577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.382832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.382987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.383120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.383358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.383604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.383820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.383941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.384073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.384344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.384609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.384833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.384960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.385070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.385359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.385594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.385830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.385961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.386089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.386242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.386267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.386398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.386505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.386538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.386651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.386757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.237 [2024-11-28 04:34:30.386783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.237 qpair failed and we were unable to recover it. 00:27:53.237 [2024-11-28 04:34:30.386918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.387199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.387451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.387697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.387855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.387988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.388285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.388504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.388749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.388877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.389004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.389158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.389184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.389346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.389474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.389498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.389635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.389736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.389762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.389873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.389976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.390001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.390097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.390251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.390276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.390430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.390567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.390593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.390695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.390796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.390821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.390925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.391155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.391417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.391662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.391817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.391915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.392190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.392448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.392722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.392856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.392984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.393117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.393142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.393241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.393352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.393377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.393507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.393611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.238 [2024-11-28 04:34:30.393637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.238 qpair failed and we were unable to recover it. 00:27:53.238 [2024-11-28 04:34:30.393741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.393878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.393904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.394028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.394289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.394515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.394754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.394887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.394983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.395240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.395456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.395695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.395822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.395931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.396187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.396439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.396684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.396818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.396913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.397178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.397432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.397727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.397851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.397990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.398247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.398497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.398741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.398893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.398992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.399208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.399474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.399757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.399883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.400024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.400278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.400514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.400802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.239 [2024-11-28 04:34:30.400949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.239 qpair failed and we were unable to recover it. 00:27:53.239 [2024-11-28 04:34:30.401077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.401204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.401229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.401330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.401464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.401489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.401621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.401728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.401753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.401852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.401976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.402002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.402136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.402229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.402255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.402391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.402549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.402576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.402678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.402777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.402802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.402949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.403232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.403472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.403738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.403862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.403999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.404242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.404505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.404768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.404894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.405000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.405221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.405511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.405744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.405897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.405991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.406272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.406551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.406862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.406989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.407120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.407250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.407275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.407375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.407474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.407499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.407607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.407757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.407783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.407889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.408021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.408047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.408163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.408291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.408316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.240 [2024-11-28 04:34:30.408449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.408554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.240 [2024-11-28 04:34:30.408579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.240 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.408706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.408802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.408827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.408964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.409089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.409115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.409209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.409310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.409336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.409468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 EAL: No free 2048 kB hugepages reported on node 1 00:27:53.241 [2024-11-28 04:34:30.409621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.409647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.409799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.409894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.409919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.410055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.410286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.410509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.410797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.410976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.411096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.411317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.411604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.411861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.411984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.412116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.412224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.412249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.412375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.412474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.412500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.412636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.412762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.412788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.412897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.413160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.413411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.413649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.413803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.413948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.414237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.414493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.414780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.414903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.415034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.415163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.415187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.415312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.415439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.415463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.415596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.415699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.415725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.415851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.415985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.416010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.241 qpair failed and we were unable to recover it. 00:27:53.241 [2024-11-28 04:34:30.416137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.416265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.241 [2024-11-28 04:34:30.416291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.416388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.416511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.416542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.416657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.416758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.416783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.416938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.417195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.417452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.417686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.417814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.417920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.418169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.418446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.418695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.418847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.418972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.419245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.419553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.419846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.419994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.420126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.420263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.420288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.420437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.420536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.420561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.420717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.420814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.420838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.420966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.421195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.421462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.421692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.421844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.421949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.422252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.422512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.422774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.422902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.423031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.423155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.423180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.423307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.423465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.423490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.423661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.423820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.423845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.242 qpair failed and we were unable to recover it. 00:27:53.242 [2024-11-28 04:34:30.423954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.242 [2024-11-28 04:34:30.424048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.424074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.424178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.424274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.424299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.424432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.424569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.424595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.424699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.424801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.424825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.424930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.425184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.425444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.425736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.425864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.425968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.426234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.426453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.426691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.426802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.426954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.427223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.427454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.427741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.427922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.428021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.428326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.428582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.428809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.428986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.429080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.429212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.429237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.429369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.429499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.429530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.429661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.429790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.429814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.429915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.430008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.430033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.430159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.430320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.430344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.430448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.430564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.243 [2024-11-28 04:34:30.430589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.243 qpair failed and we were unable to recover it. 00:27:53.243 [2024-11-28 04:34:30.430730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.430857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.430881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.430986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.431273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.431535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.431789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.431915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.432012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.432279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.432583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.432805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.432954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.433086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.433247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.433272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.433382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.433507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.433562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.433697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.433794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.433830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.433934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.434206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.434471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.434768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.434917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.435044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.435310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.435542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.435793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.435948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.436048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.436301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.436574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.436840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.436990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.437117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.437205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.437230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.437331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.437458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.437484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.437634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.437732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.437759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.437886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.437976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.438002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.244 qpair failed and we were unable to recover it. 00:27:53.244 [2024-11-28 04:34:30.438133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.244 [2024-11-28 04:34:30.438234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.438261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.438367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.438469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.438494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.438615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.438707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.438733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.438829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.438948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.438977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.439081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.439184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.439209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.439336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.439469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.439494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.439660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.439789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.439813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.439913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.440151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.440406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.440669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.440801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.440924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.441181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.441466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.441725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.441848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.441952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.442199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.442536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.442802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.442923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.443024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.443175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.443200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.443275] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:53.245 [2024-11-28 04:34:30.443328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.443455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.443479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.443583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.443736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.443760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.443862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.443997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.444022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.444127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.444259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.444284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.444409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.444548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.444575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.444673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.444779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.444804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.444903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.445031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.445058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.445194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.445317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.445342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.445470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.445597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.445623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.245 qpair failed and we were unable to recover it. 00:27:53.245 [2024-11-28 04:34:30.445718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.245 [2024-11-28 04:34:30.445852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.445878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.446003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.446292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.446519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.446756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.446905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.447044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.447283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.447504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.447761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.447909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.448008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.448136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.448161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.448317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.448415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.448440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.448599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.448708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.448734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.448850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.449189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.449491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.449751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.449910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.450040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.450183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.450208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.450313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.450444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.450469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.450592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.450722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.450748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.450855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.450987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.451012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.451142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.451238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.451264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.451390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.451506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.451539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.451668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.451762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.451787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.451908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.452148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.452397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.452663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.452812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.452943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.453041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.453066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.453198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.453310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.453334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.246 qpair failed and we were unable to recover it. 00:27:53.246 [2024-11-28 04:34:30.453431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.246 [2024-11-28 04:34:30.453538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.453563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.453673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.453832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.453856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.453978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.454267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.454574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.454804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.454955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.455052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.455178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.455207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.455334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.455467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.455492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.455654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.455781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.455806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.455902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.456161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.456447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.456739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.456893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.457022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.457146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.457170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.457268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.457440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.457465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.457627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.457762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.457788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.457892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.457989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.458015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.458151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.458253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.458278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.458383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.458541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.458567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.458698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.458849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.458875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.459008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.459267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.459500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.459816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.459947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.460077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.460183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.460207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.460335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.460463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.460487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.460626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.460736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.460761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.460866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.460977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.247 [2024-11-28 04:34:30.461002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.247 qpair failed and we were unable to recover it. 00:27:53.247 [2024-11-28 04:34:30.461096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.461247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.461272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.461398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.461537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.461562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.461688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.461840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.461865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.461997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.462273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.462539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.462804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.462983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.463089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.463188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.463213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.463372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.463512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.463583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.463720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.463825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.463850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.463954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.464211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.464539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.464772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.464926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.465031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.465283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.465568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.465840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.465994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.466123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.466230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.466255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.466380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.466508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.466542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.466649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.466748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.466773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.466870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.467187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.467413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.467711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.467844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.467997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.468129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.468154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.248 [2024-11-28 04:34:30.468249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.468401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.248 [2024-11-28 04:34:30.468427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.248 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.468522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.468632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.468658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.468810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.468928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.468954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.469085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.469214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.469239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.469369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.469472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.469498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.469636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.469773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.469799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.469934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.470168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.470398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.470663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.470804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.470902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.471180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.471434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.471684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.471839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.471980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.472236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.472489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.472712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.472835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.472933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.473190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.473498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.473761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.473911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.474065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.474167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.474191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.474317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.474471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.474495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.474640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.474739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.474764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.474918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.475160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.475430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.475712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.475834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.249 [2024-11-28 04:34:30.475940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.476092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.249 [2024-11-28 04:34:30.476117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.249 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.476271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.476370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.476396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.476532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.476637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.476662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.476762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.476898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.476923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.477053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.477315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.477574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.477812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.477942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.478067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.478323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.478564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.478823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.478975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.479110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.479221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.479245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.479347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.479452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.479476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.479626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.479760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.479785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.479915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.480139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.480427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.480689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.480816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.480979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.481256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.481572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.481827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.481954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.482049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.482274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.482520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.482776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.482900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.483026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.483185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.483210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.483365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.483516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.483549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.250 [2024-11-28 04:34:30.483682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.483786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.250 [2024-11-28 04:34:30.483810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.250 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.483910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.484158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.484427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.484703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.484845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.484974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.485074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.485100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.485221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.485357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.485382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.485516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.485681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.485706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.485834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.485990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.486015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.486116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.486240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.486265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.486396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.486523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.486556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.486656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.486788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.486814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.486912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.487174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.487448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.487700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.487881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.487975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.488229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.488458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.488745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.488868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.489003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.489246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.489509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.489763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.489944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.490045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.490297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.490556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.490801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.490965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.491069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.491193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.491218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.251 [2024-11-28 04:34:30.491325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.492200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.251 [2024-11-28 04:34:30.492232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.251 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.492350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.492503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.492547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.492663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.492768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.492794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.492923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.493215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.493490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.493784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.493911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.494048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.494186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.494211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.494338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.494465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.494495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.494616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.494743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.494768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.494935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.495196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.495460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.495784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.495958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.496082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.496181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.496206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.496327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.496486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.496520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.496657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.496763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.496789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.496923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.497138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.497398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.497662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.497795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.497933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.498184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.498447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.498737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.498862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.498979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.499083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.499108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.252 qpair failed and we were unable to recover it. 00:27:53.252 [2024-11-28 04:34:30.499233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.499362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.252 [2024-11-28 04:34:30.499386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.253 qpair failed and we were unable to recover it. 00:27:53.253 [2024-11-28 04:34:30.499512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.499619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.499644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.253 qpair failed and we were unable to recover it. 00:27:53.253 [2024-11-28 04:34:30.499746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.499913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.499938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.253 qpair failed and we were unable to recover it. 00:27:53.253 [2024-11-28 04:34:30.500047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.500176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.500200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.253 qpair failed and we were unable to recover it. 00:27:53.253 [2024-11-28 04:34:30.500311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.500414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.253 [2024-11-28 04:34:30.500439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.253 qpair failed and we were unable to recover it. 00:27:53.253 [2024-11-28 04:34:30.500568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.500666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.500691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.553 qpair failed and we were unable to recover it. 00:27:53.553 [2024-11-28 04:34:30.500800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.500938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.500963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.553 qpair failed and we were unable to recover it. 00:27:53.553 [2024-11-28 04:34:30.501072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.501172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.501197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.553 qpair failed and we were unable to recover it. 00:27:53.553 [2024-11-28 04:34:30.501309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.501470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.501495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.553 qpair failed and we were unable to recover it. 00:27:53.553 [2024-11-28 04:34:30.501672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.553 [2024-11-28 04:34:30.501799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.501845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.502007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.502133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.502168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.502328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.502485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.502540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.502675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.502839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.502873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.503012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.503146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.503171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.503302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.503404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.503429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.503607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.503741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.503771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.503899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.504136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.504350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.504624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.504879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.504986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.505126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.505389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.505634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.505867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.505993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.506115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.506358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.506612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.506872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.506990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.507122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.507261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.507285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.507387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.507515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.507549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.507692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.507787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.507812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.507922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.508211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.508567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.554 qpair failed and we were unable to recover it. 00:27:53.554 [2024-11-28 04:34:30.508821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.554 [2024-11-28 04:34:30.508952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.509058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.509315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.509556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.509786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.509919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.510016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.510269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.510551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.510789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.510955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.511058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.511341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.511609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.511869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.511991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.512087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.512191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.512216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.512345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.512453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.512478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.512600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.512699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.512725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.512883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.512980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.513005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.513130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.513237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.513263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.513361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.513495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.513569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.513709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.513820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.513845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.513947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.514229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.514514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.514816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.514972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.515080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.515207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.515233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.515364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.515497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.515532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.515666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.515761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.515786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.555 qpair failed and we were unable to recover it. 00:27:53.555 [2024-11-28 04:34:30.515880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.555 [2024-11-28 04:34:30.515977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.516002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.516097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.516227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.516253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.516381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.516486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.516513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.516658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.516792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.516818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.516920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.517181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.517471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.517741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.517867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.518005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.518291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.518609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.518832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.518957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.519048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.519334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.519583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.519809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.519965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.520122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.520248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.520274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.520402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.520511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.520560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.520689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.520825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.520850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.520949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.521220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.521473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.521743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.521870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.521969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.522230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.522488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.522704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.556 [2024-11-28 04:34:30.522849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.556 qpair failed and we were unable to recover it. 00:27:53.556 [2024-11-28 04:34:30.522949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.523234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.523488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.523724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.523846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.523952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.524230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.524482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.524769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.524904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.525041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.525295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.525563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.525809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.525937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.526036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.526278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.526560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.526808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.526958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.527093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.527205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.527230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.527359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.527514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.527550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.527655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.527816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.527842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.527972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.528233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.528542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.528771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.528929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.529083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.529334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.529592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.557 [2024-11-28 04:34:30.529858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.557 [2024-11-28 04:34:30.529984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.557 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.530114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.530204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.530230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.530357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.530486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.530512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.530651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.530774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.530800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.530917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.531201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.531486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.531745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.531879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.531985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.532092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.532119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.532264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.532366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.532392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.532514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.532664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.532698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.532852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.532978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.533004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.533132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.533255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.533280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.533408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.533504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.533538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.533648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.533767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.533793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.533918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.534191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.534406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.534667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.534817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.534915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.535199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.535484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.535763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.535888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.536042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.536196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.558 [2024-11-28 04:34:30.536222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.558 qpair failed and we were unable to recover it. 00:27:53.558 [2024-11-28 04:34:30.536352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.536453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.536479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.536627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.536732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.536758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.536885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.537145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.537424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.537711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.537833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.537988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.538116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.538141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.538272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.538402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.538427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.538563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.538680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.538706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.538831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.538994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.539020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.539140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.539243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.539268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.539367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.539494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.539519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.539662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.539768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.539794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.539897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.540144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.540401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.540661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.540789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.540886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.541176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.541202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.541328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.541430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.541455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.541589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.541711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.541736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.541870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.541994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.542019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.542145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.542270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.542295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.542393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.542519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.542552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.542684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.542788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.542813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.542921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.543135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.543405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.543687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.543810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.559 qpair failed and we were unable to recover it. 00:27:53.559 [2024-11-28 04:34:30.543932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.544036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.559 [2024-11-28 04:34:30.544062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.544192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.544292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.544317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.544451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.544575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.544601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.544726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.544887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.544913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.545071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.545292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.545517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.545786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.545939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.546040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.546142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.546167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.546294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.546449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.546478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.546623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.546723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.546747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.546870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.546980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.547006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.547160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.547265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.547291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.547396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.547550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.547576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.547682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.547809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.547835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.547940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.548230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.548437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.548734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.548864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.548953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.549238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.549520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.549836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.549994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.550124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.550223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.550248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.550382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.550482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.550507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.550614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.550719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.550746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.550878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.550990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.551015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.551116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.551244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.551272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.551403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.551504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.551538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.551642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.551772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.551798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.551934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.552035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.552061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.560 qpair failed and we were unable to recover it. 00:27:53.560 [2024-11-28 04:34:30.552165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.552265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.560 [2024-11-28 04:34:30.552290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.552391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.552482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.552507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.552668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.552795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.552821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.552922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.553208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.553493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.553803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.553931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.554083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.554236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.554261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.554391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.554547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.554573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.554710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.554832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.554858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.554960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.555277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.555522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.555780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.555906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.556024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.556250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.556535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.556790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.556956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.557054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.557177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.557202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.557333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.557459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.557488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.557595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.557721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.557746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.557921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.558183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.558470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.561 [2024-11-28 04:34:30.558707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.561 [2024-11-28 04:34:30.558825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.561 qpair failed and we were unable to recover it. 00:27:53.565 [2024-11-28 04:34:30.558930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.565 qpair failed and we were unable to recover it. 00:27:53.565 [2024-11-28 04:34:30.559147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559144] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:53.565 [2024-11-28 04:34:30.559248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with[2024-11-28 04:34:30.559271] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:53.565 addr=10.0.0.2, port=4420 00:27:53.565 qpair failed and we were unable to recover it. 00:27:53.565 [2024-11-28 04:34:30.559292] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:53.565 [2024-11-28 04:34:30.559305] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:53.565 [2024-11-28 04:34:30.559411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:53.565 [2024-11-28 04:34:30.559430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:53.565 [2024-11-28 04:34:30.559508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with[2024-11-28 04:34:30.559457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:53.565 addr=10.0.0.2, port=4420 00:27:53.565 [2024-11-28 04:34:30.559461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:53.565 qpair failed and we were unable to recover it. 00:27:53.565 [2024-11-28 04:34:30.559656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.559788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.565 qpair failed and we were unable to recover it. 00:27:53.565 [2024-11-28 04:34:30.559891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.560017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.560043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.565 qpair failed and we were unable to recover it. 00:27:53.565 [2024-11-28 04:34:30.560148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.565 [2024-11-28 04:34:30.560242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.560267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.560407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.560514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.560569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.560671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.560769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.560793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.560925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.561147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.561399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.561623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.561873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.561996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.562021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.562127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.562219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.562249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.562346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.562475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.562500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.562680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.562809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.562834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.562938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.563187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.563412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.563667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.563886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.563985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.564011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.564112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.564223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.564248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.564367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.564500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.564532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.564634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.564738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.564764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.564898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.565132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.565370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.565645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.565762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.565903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.566149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.566403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.566649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.566903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.566993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.567018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.567114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.567248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.567274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.567404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.567560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.567586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.567685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.567781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.567806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.567908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.568032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.568056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.568158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.568264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.568289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.566 qpair failed and we were unable to recover it. 00:27:53.566 [2024-11-28 04:34:30.568419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.566 [2024-11-28 04:34:30.568519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.568550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.568649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.568752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.568776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.568872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.568972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.568997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.569128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.569277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.569302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.569426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.569535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.569561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.569667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.569774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.569800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.569895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.569991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.570017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.570113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.570234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.570259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.570388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.570558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.570584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.570690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.570794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.570818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.570975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.571196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.571458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.571698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.571822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.571946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.572162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.572451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.572686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.572806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.572915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.573184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.573436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.573693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.573814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.573919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.574130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.574374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.574641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.574767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.574910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.575195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.575409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.575636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.575753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.575923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.576151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.576391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.576650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.576881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.576980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.577004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.577104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.577205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.577230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.577362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.577459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.577485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.577542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf80600 (9): Bad file descriptor 00:27:53.567 [2024-11-28 04:34:30.577711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.577846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.577875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.577977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.578072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.578099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.578205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.578311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.578338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.567 [2024-11-28 04:34:30.578462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.578605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.567 [2024-11-28 04:34:30.578632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.567 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.578730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.578888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.578915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.579070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.579307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.579579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.579818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.579974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.580085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.580187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.580214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.580340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.580439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.580466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.580598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.580694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.580721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.580854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.580977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.581096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.581318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.581566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.581788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.581925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.582034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.582285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.582539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.582797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.582969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.583070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.583192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.583218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.583344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.583442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.583468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.583603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.583734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.583760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.583877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.584129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.584354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.584587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.584815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.584934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.585043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.585317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.585601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.585837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.585989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.586086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.586319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.586595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.586852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.586999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.587100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.587206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.587234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.587357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.587452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.587479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.587635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.587762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.587787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.587888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.587979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.588005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.588130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.588263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.588289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.588415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.588550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.588578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.588683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.588776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.588802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.588940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.589070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.589095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.568 qpair failed and we were unable to recover it. 00:27:53.568 [2024-11-28 04:34:30.589224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.568 [2024-11-28 04:34:30.589348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.589374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.589466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.589632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.589659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.589753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.589862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.589887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.589984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.590282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.590508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.590783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.590908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.591014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.591230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.591478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.591738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.591886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.591976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.592219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.592449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.592711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.592861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.592961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.593205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.593458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.593695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.593827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.593952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.594212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.594428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.594686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.594812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.594952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.595228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.595505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.595755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.595890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.596031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.596271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.596487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.596723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.596845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.596942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.597162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.597381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.597627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.597853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.597980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.598108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.598324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.598563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.598792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.598950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.599046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.599151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.599176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.569 qpair failed and we were unable to recover it. 00:27:53.569 [2024-11-28 04:34:30.599276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.599376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.569 [2024-11-28 04:34:30.599402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.599505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.599632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.599658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.599762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.599890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.599916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.600015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.600276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.600500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.600736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.600869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.600970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.601198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.601448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.601721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.601855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.601956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.602210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.602425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.602656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.602781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.602918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.603149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.603380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.603598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.603851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.603970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.604066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.604286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.604565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.604788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.604919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.605021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.605240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.605483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.605712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.605846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.605950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.606158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.606396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.606660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.606879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.606981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.607005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.607100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.607226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.607250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.607408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.607508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.607552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.607651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.607754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.607780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.607909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.608007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.608032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.608122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.608218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.570 [2024-11-28 04:34:30.608244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.570 qpair failed and we were unable to recover it. 00:27:53.570 [2024-11-28 04:34:30.608373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.608472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.608498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.608614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.608711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.608737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.608841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.608999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.609128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.609358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.609627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.609853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.609982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.610107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.610331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.610559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.610808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.610929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.611035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.611280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.611568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.611829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.611981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.612103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.612363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.612605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.612830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.612995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.613116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.613339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.613563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.613800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.613953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.614046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.614291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.614532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.614742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.614862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.614973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.615228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.615445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.615678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.615831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.615962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.616177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.616431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.616681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.616804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.616938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.617187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.617445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.617699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.617814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.617937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.618153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.618445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.571 [2024-11-28 04:34:30.618727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.571 [2024-11-28 04:34:30.618855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.571 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.618983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.619257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.619467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.619690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.619847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.619955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.620193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.620412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.620676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.620806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.620911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.621135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.621412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.621667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.621894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.621998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.622146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.622375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.622603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.622847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.622975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.623103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.623209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.623234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.623364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.623459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.623484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.623619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.623744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.623770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.623881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.623979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.624006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.624144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.624306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.624332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.624429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.624520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.624568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.624673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.624804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.624829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.624934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.625192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.625408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.625638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.625786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.625888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.626172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.626419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.626661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.626809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.626911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.627176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.627431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.627703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.627830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.627933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.628163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.628387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.628667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.628823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.628944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.629076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.629101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.572 qpair failed and we were unable to recover it. 00:27:53.572 [2024-11-28 04:34:30.629205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.629327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.572 [2024-11-28 04:34:30.629352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.629482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.629603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.629628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.629726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.629852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.629878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.629983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.630214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.630435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.630689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.630838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.630945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.631200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.631451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.631696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.631847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.631942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.632213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.632462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.632720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.632856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.632967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.633194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.633510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.633775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.633905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.634010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.634281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.634558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.634804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.634930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.635037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.635279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.635500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.635750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.635914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.636045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.636300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.636568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.636788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.636954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.637046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.637285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.637567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.637786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.637912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.638013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.638112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.638137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.638259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.638358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.638383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.573 qpair failed and we were unable to recover it. 00:27:53.573 [2024-11-28 04:34:30.638483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.638617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.573 [2024-11-28 04:34:30.638643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.638743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.638873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.638899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.639006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.639235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.639514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.639770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.639896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.640001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.640299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.640578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.640841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.640963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.641097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.641317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.641569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.641821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.641968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.642072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.642302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.642563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.642821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.642945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.643074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.643318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.643541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.643782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.643945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.644043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.644264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.644517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.644819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.644943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.645046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.645298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.645516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.645749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.645884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.646007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.646252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.646466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.646687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.646839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.646944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.647193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.647444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.647703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.647822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.647924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.648157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.648407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.648644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.648787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.574 qpair failed and we were unable to recover it. 00:27:53.574 [2024-11-28 04:34:30.648895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.574 [2024-11-28 04:34:30.649015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.649040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.649163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.649316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.649342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.649441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.649562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.649588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.649684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.649787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.649812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.649939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.650154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.650367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.650632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.650867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.650989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.651092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.651308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.651534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.651817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.651951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.652090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.652313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.652591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.652841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.652998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.653135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.653354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.653587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.653872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.653994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.654099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.654341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.654567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.654811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.654941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.655073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.655198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.655224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.655347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.655470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.655496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.655684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.655797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.655830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.655936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.656174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.656402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.656669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.656799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.656924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.657155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.657381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.657628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.657859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.657980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.658083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.658335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.658588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.658849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.658997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.659128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.659225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.659250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.575 qpair failed and we were unable to recover it. 00:27:53.575 [2024-11-28 04:34:30.659370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.575 [2024-11-28 04:34:30.659468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.659493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.659597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.659703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.659729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.659824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.659923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.659948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.660055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.660307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.660571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.660793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.660945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.661044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.661293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.661561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.661780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.661899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.662007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.662289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.662515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.662760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.662911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.663037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.663274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.663511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.663756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.663920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.664019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.664306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.664560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.664820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.664965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.665063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.665283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.665531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.665769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.665899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.666002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.666258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.666538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.666760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.666912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.667013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.667111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.667136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.667232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.667325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.667351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.667477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.667575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.667600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.576 qpair failed and we were unable to recover it. 00:27:53.576 [2024-11-28 04:34:30.667699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.576 [2024-11-28 04:34:30.667792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.667818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.667945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.668173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.668419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.668712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.668837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.668933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.669176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.669393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.669648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.669775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.669909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.670191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.670423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.670696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.670875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.670983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.671235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.671464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.671746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.671928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.672052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.672309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.672541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.672764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.672932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.673026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.673258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.673520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.673763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.673915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.674027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.674279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.674539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.674748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.674905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.674997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.675241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.675485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.675732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.675862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.675991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.676270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.676537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.676766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.676887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.677010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.677329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.677602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.677827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.677951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.577 [2024-11-28 04:34:30.678078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.678199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.577 [2024-11-28 04:34:30.678224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.577 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.678319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.678417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.678443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.678550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.678680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.678706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.678826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.678922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.678947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.679081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.679331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.679588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.679826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.679957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.680062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.680333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.680596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.680848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.680975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.681085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.681316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.681586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.681804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.681923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.682024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.682232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.682452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.682707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.682831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.682935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.683184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.683454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.683736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.683857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.683958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.684201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.684435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.684659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.684875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.684997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.685090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.685319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.685544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.685792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.685920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.686043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.686292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.686498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.686715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.686834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.686930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.687153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.687368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.687590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.687809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.578 [2024-11-28 04:34:30.687971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.578 qpair failed and we were unable to recover it. 00:27:53.578 [2024-11-28 04:34:30.688074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.688331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.688582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.688825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.688974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.689070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.689294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.689536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.689810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.689936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.690064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.690296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.690513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.690781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.690904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.691005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.691250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.691463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.691717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.691905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.692008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.692219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.692435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.692724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.692875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.692997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.693224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.693471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.693722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.693852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.693950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.694200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.694415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.694652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.694829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.694965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.695230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.695450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.695683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.695812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.695902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.696157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.696386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.696620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.696892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.696991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.697018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.579 qpair failed and we were unable to recover it. 00:27:53.579 [2024-11-28 04:34:30.697112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.579 [2024-11-28 04:34:30.697222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.697248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.697346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.697440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.697466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.697572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.697667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.697693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.697812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.697908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.697938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.698064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.698298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.698547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.698776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.698894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.698984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.699264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.699514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.699783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.699899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.699989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.700278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.700534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.700784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.700911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.701033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.701283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.701559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.701826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.701946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.702045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.702269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.702532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.702760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.702890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.703021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.703278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.703519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.703736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.703857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.703958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.704198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.704456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.704702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.704818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.704909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.705131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.705417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.705710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.705841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.705936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.706202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.706421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.706737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.706860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.706962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.707059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.707086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.580 qpair failed and we were unable to recover it. 00:27:53.580 [2024-11-28 04:34:30.707187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.707280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.580 [2024-11-28 04:34:30.707307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.707407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.707534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.707560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.707658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.707755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.707781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.707889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.708225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.708481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.708709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.708830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.708925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.709157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.709413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.709643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.709877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.709976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.710097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.710350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.710607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.710898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.710994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.711148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.711404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.711636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.711859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.711984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.712108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.712328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.712580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.712809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.712941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.713068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.713297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.713511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.713750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.713868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.713965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.714236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.714452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.714700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.714879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.714977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.715235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.715461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.715705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.715857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.715957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.716204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.716455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.716671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.581 [2024-11-28 04:34:30.716796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.581 qpair failed and we were unable to recover it. 00:27:53.581 [2024-11-28 04:34:30.716893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.716991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.717109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.717334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.717604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.717856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.717979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.718105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.718392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.718613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.718868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.718990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.719087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.719358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.719588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.719845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.719972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.720080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.720319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.720553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.720799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.720956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.721086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.721301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.721558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.721835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.721963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.722094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.722317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.722579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.722803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.722963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.723070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.723346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.723594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.723845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.723966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.724063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.724319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.724532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.724755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.724908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.725032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.725307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.725569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.725796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.725925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.582 qpair failed and we were unable to recover it. 00:27:53.582 [2024-11-28 04:34:30.726033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.726130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.582 [2024-11-28 04:34:30.726156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.726284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.726414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.726439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.726546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.726641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.726667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.726788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.726903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.726930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.727066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.727309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.727578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.727836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.727952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.728046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.728275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.728546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.728799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.728953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.729056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.729304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.729584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.729808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.729934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.730024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.730339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.730574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.730816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.730937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.731030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.731308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.731535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.731809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.731935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.732035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.732290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.732538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.732774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.732904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.733014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.733241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.733502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.733802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.733923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.734023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.734248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.734520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.734751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.734906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.735001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.735260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.735546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.735777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.735937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.736033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.736140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.736166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.583 qpair failed and we were unable to recover it. 00:27:53.583 [2024-11-28 04:34:30.736264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.583 [2024-11-28 04:34:30.736365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.736392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.736490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.736595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.736623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.736723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.736823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.736848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.736974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.737196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.737409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.737673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.737819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.737906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.738157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.738425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.738678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.738897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.738987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.739109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.739366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.739631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.739858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.739978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.740111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.740324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.740565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.740777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.740902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.740998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.741243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.741466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.741716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.741839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.741931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.742203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.742518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.742743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.742865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.742963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.743210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.743431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.743699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.743821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.743947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.744160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.744420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.744696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.744833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.744938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.745179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.745458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.745710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.745869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.745961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.746062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.746086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.584 [2024-11-28 04:34:30.746192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.746322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.584 [2024-11-28 04:34:30.746347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.584 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.746438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.746537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.746578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.746692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.746820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.746846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.746975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.747219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.747449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.747711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.747867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.747960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.748239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.748483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.748721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.748845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.748939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.749191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.749451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.749729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.749856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.749961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.750231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.750492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.750726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.750846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.750941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.751198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.751420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.751669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.751808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.751940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.752166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.752418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.752671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.752818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.752913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.753164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.753419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.753645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.753862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.753981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.585 [2024-11-28 04:34:30.754103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.754209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.585 [2024-11-28 04:34:30.754235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.585 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.754368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.754460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.754486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.754606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.754704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.754730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.754866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.754963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.754989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.755117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.755238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.755264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.755366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.755487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.755514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.755629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.755725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.755750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.755911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.756005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.756031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.756130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.756264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.756290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-28 04:34:30.756419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.588 [2024-11-28 04:34:30.756511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.756544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.756679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.756801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.756826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.756930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.757159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.757417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.757665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.757821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.757922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.758145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.758384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.758620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.758872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.758992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.759092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.759344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.759597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.759855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.759975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.760073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.760327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.760550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.760792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.760916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.761016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.761240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.761511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.761736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.761858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.761959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.762207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.762429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.762686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.762839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.762939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.763187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.763397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.763659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.763782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.763879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.764127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.764370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.764612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.764846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.589 [2024-11-28 04:34:30.764969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.589 qpair failed and we were unable to recover it. 00:27:53.589 [2024-11-28 04:34:30.765085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.765306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.765548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.765774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.765900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.766009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.766238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.766450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.766679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.766830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.766963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.767188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.767433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.767658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.767877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.767994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.768092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.768366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.768651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.768862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.768990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.769122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.769349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.769623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.769860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.769984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.770085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.770309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.770533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.770760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.770883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.771006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.771226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.771460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.771705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.771872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.771977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.772255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.772476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.772727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.772854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.773005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.773234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.773512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.773735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.773850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.773952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.774175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.774432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.774663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.590 qpair failed and we were unable to recover it. 00:27:53.590 [2024-11-28 04:34:30.774888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.774976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.590 [2024-11-28 04:34:30.775000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.775106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.775323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.775552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.775788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.775965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.776057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.776277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.776494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.776742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.776865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.776992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.777214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.777460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.777698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.777829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.777928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.778177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.778431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.778687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.778814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.778938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.779169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.779438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.779668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.779797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.779887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.780127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.780345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.780568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.780786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.780906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.781009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.781263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.781473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.781712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.781863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.781956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.782258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.782499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.782756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.782874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.782970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.783221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.783462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.783681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.783808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.783940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.784202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.784479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.784708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.784859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.591 qpair failed and we were unable to recover it. 00:27:53.591 [2024-11-28 04:34:30.784980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.591 [2024-11-28 04:34:30.785071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.785096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.785206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.785307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.785332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.785434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.785564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.785589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.785691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.785788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.785813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.785905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.786153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.786421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.786680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.786801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.786902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.787205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.787419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.787641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.787797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.787903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.788142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.788362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.788574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.788806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.788926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.789061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.789295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.789546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.789769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.789890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.790019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.790238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.790492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.790760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.790874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.791007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.791218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.791472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.791703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.791827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.791921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.792161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.792376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.792612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.792847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.792974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.793070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.793355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.793620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.592 [2024-11-28 04:34:30.793836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.592 [2024-11-28 04:34:30.793966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.592 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.794063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.794305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.794537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.794757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.794873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.794976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.795276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.795583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.795812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.795936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.796039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.796254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.796505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.796738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.796891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.796991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.797240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.797467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.797699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.797829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.797929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.798169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.798383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.798619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.798844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.798986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.799088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.799363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.799607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.799835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.799963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.800068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.800316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.800541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.800754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.800881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.800978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.801226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.801447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.801657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.801888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.801980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.802103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.802319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.802548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.802786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.802916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.803013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.803228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.803456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.803726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.593 [2024-11-28 04:34:30.803843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.593 qpair failed and we were unable to recover it. 00:27:53.593 [2024-11-28 04:34:30.803939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.804160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.804426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.804649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.804873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.804997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.805022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.805151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.805247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.805271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.805420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.805515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.805554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.805664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.805763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.805788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.805915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.806148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.806369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.806621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.806850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.806977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.807105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.807324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.807543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.807760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.807882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.807975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.808215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.808467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.808691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.808807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.808932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.809164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.809403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.809622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.809858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.809986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.810111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.810352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.810569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.810789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.810933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.811061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.811276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.811521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.811743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.811860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.811958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.812186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.812405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.812641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.812860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.812990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.813016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.813149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.813250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.813276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.813373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.813470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.813496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.594 qpair failed and we were unable to recover it. 00:27:53.594 [2024-11-28 04:34:30.813609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.594 [2024-11-28 04:34:30.813733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.813758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.813861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.813960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.813985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.814081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.814309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.814533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.814754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.814881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.814990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.815216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.815500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.815746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.815874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.815973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.816182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.816421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.816684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.816811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.816909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.817127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.817373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.817631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.817759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.817863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.818158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.818382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.818631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.818857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.818972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.819064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.819277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.819520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.819738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.819860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.819958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.820186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.820414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.820644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.820799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.820927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.821160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.821405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.821657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.821777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.821909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.822158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.822379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.595 [2024-11-28 04:34:30.822647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.595 [2024-11-28 04:34:30.822774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.595 qpair failed and we were unable to recover it. 00:27:53.596 [2024-11-28 04:34:30.822879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.596 [2024-11-28 04:34:30.822982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.596 [2024-11-28 04:34:30.823007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.596 qpair failed and we were unable to recover it. 00:27:53.596 [2024-11-28 04:34:30.823105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.823197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.823222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.823335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.823457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.823481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.823632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.823729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.823755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.823856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.824129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.824348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.824595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.824856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.824984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.825086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.825349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.825582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.825841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.825988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.826083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.826325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.826601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.826819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.826943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.827040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.827266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.827513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.827765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.827888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.827988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.828203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.828451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.828681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.828894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.828987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.829012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.829103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.829192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.829217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.829320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.829417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.829442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.881 qpair failed and we were unable to recover it. 00:27:53.881 [2024-11-28 04:34:30.829541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.881 [2024-11-28 04:34:30.829645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.829671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.829774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.829875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.829900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.829999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.830255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.830463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.830708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.830824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.830913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.831151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.831410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.831657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.831905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.831998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.832023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.832148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.832270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.832296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.832398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.832504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.832537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.832653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.832780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.832806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.832906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.833124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.833374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.833598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.833812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.833930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.834033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.834249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.834504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.834799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.834946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.835052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.835302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.835577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.835831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.835948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.836076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.836174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.836198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.836297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.836396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.836422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.882 qpair failed and we were unable to recover it. 00:27:53.882 [2024-11-28 04:34:30.836523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.882 [2024-11-28 04:34:30.836625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.836650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.836781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.836904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.836930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.837029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.837260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.837476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.837730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.837879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.837975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.838191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.838405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.838664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.838884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.838980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.839099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.839355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.839578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.839833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.839958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.840059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.840277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.840494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.840726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.840841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.840934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.841188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.841431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.841686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.841810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.841934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.842187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.842403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.842691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.842816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.842920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.843041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.843066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.843212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.843309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.883 [2024-11-28 04:34:30.843334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.883 qpair failed and we were unable to recover it. 00:27:53.883 [2024-11-28 04:34:30.843433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.843560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.843586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.843686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.843782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.843807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.843899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.844125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.844348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.844569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.844795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.844970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.845066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.845284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.845510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.845763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.845911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.846006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.846229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.846440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.846718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.846841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.846965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.847179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.847412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.847643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.847852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.847982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.848136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.848361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.848611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.848837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.848959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.849081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.849300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.849549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.849787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.849910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.850012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.850130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.884 [2024-11-28 04:34:30.850155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.884 qpair failed and we were unable to recover it. 00:27:53.884 [2024-11-28 04:34:30.850281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.850380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.850406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.850538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.850645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.850672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.850766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.850894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.850919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.851047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.851273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.851496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.851752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.851875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.851971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.852227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.852482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.852705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.852881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.852979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.853246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.853532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.853762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.853913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.854038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.854290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.854563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.854790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.854919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.855011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.855257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.855467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.855703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.855825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.855935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.856055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.856079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.885 [2024-11-28 04:34:30.856202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.856294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.885 [2024-11-28 04:34:30.856319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.885 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.856447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.856546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.856571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.856702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.856803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.856827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.856932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.857144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.857358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.857604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.857872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.857978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.858141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.858391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.858637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.858870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.858992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.859096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.859311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.859534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.859797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.859920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.860026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.860250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.860495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.860731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.860856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.860980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.861258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.861481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.861727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.861849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.861945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.862258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.862495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.862787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.862910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.863009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.863137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.863162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.886 [2024-11-28 04:34:30.863266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.863418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.886 [2024-11-28 04:34:30.863444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.886 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.863574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.863702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.863727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.863823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.863949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.863976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.864074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.864329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.864560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.864837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.864956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.865084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.865296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.865542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.865765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.865887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.865985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.866281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.866496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.866780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.866908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.867017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.867254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.867503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.867746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.867920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.868022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.868246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.868500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.868744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.868893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.869022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.869275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.869490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.869751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.869885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.869976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.870105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.870129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.870259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.870348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.870372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.887 qpair failed and we were unable to recover it. 00:27:53.887 [2024-11-28 04:34:30.870508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.870624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.887 [2024-11-28 04:34:30.870649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.870753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.870851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.870877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.870979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.871208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.871439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.871660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.871841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.871938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.872220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.872473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.872694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.872820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.872917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.873133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.873334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.873596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.873818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.873946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.874048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.874282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.874548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.874786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.874911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.875036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.875260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.875467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.875700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.875848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.875941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.876160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.876410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.876670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.876823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.876922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.877052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.877076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.877184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.877305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.877331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.888 qpair failed and we were unable to recover it. 00:27:53.888 [2024-11-28 04:34:30.877429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.877532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.888 [2024-11-28 04:34:30.877557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.877663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.877761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.877788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.877912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.878214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.878431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.878690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.878819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.878916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.879193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.879461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.879733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.879848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.880009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.880257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.880538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.880793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.880923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.881020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.881231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.881453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.881728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.881852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.881957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.882164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.882424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.882701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.882823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.882929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.883141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.883354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.883604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.883814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.883938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.884040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.884145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.884170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.884275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.884371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.884395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.889 qpair failed and we were unable to recover it. 00:27:53.889 [2024-11-28 04:34:30.884490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.884590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.889 [2024-11-28 04:34:30.884620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.884714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.884804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.884829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.884931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.885183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.885428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.885665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.885892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.885992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.886119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.886346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.886566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.886819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.886954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.887108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.887332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.887644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.887851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.887968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.888092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.888307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.888552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.888787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.888914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.889051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.889300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.889553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.889776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.889917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.890022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.890119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.890143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.890249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.890374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.890399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.890501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.890634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.890659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.890 qpair failed and we were unable to recover it. 00:27:53.890 [2024-11-28 04:34:30.890758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.890 [2024-11-28 04:34:30.890887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.890911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.891020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.891269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.891541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.891773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.891908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.892045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.892262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.892510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.892750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.892912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.893012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.893257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.893511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.893754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.893882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.894002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.894226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.894449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.894665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.894811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.894903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.895212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.895429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.895663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.895839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.891 qpair failed and we were unable to recover it. 00:27:53.891 [2024-11-28 04:34:30.895936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.891 [2024-11-28 04:34:30.896058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.896083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.896207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.896305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.896329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.896422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.896549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.896581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.896673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.896816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.896840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.896974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.897202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.897453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.897666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.897785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.897881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.898133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.898353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.898581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.898809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.898930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.899021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.899263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.899489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.899759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.899905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.900004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.900104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.900130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.900229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.900356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.892 [2024-11-28 04:34:30.900381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.892 qpair failed and we were unable to recover it. 00:27:53.892 [2024-11-28 04:34:30.900507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.900618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.900645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.900746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.900881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.900906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.901002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.901224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.901442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.901700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.901827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.901933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.902181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.902405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.902635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.902891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.902986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.903109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.903334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.903592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.903872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.903982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.904130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.904357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.904564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.904804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.893 [2024-11-28 04:34:30.904950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.893 qpair failed and we were unable to recover it. 00:27:53.893 [2024-11-28 04:34:30.905041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.905324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.905539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.905799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.905924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.906021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.906245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.906478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.906707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.906865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.906971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.907222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.907447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.907736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.907859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.907986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.908213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.908454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.908695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.908815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.908925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.909055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.909080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.909176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.909273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.909303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.894 qpair failed and we were unable to recover it. 00:27:53.894 [2024-11-28 04:34:30.909407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.894 [2024-11-28 04:34:30.909538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.909564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.909663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.909755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.909780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.909902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.910127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.910382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.910655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.910809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.910937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.911165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.911485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.911709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.911866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.911970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.912214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.912435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.912657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.912780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.912907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.913123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.913352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.913611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.913836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.913971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.895 qpair failed and we were unable to recover it. 00:27:53.895 [2024-11-28 04:34:30.914070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.895 [2024-11-28 04:34:30.914162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.914187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.914301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.914397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.914422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.914556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.914658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.914684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.914791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.914898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.914923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.915014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.915290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.915495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.915756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.915879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.916001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.916220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.916472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.916699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.916825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.916959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.917186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.917451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.917703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.917852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.917956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.918227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.918438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.918695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.918852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.918949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.919198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.919456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.896 [2024-11-28 04:34:30.919747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.896 [2024-11-28 04:34:30.919874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.896 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.919975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.920196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.920429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.920659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.920782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.920877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.921128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.921370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.921603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.921844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.921998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.922118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.922367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.922621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.922838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.922990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.923087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.923376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.923602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.923814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.923937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.924060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.924292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.924546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.924764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.924948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.925045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.925289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.925542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.925764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.925887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.926019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.926171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.926196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.926300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.926431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.926456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.926557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.926656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.926686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.897 qpair failed and we were unable to recover it. 00:27:53.897 [2024-11-28 04:34:30.926789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.897 [2024-11-28 04:34:30.926916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.926942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.927067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.927322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.927571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.927792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.927946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.928051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.928307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.928554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.928802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.928920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.929023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.929315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.929569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.929813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.929929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.930052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.930274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.930503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.930741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.930865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.930990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.931228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.931441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.931677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.931832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.931959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.932222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.932470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.932706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.932824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.932929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.933053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.933077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.933203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.933307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.933332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.933461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.933557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.933583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.898 qpair failed and we were unable to recover it. 00:27:53.898 [2024-11-28 04:34:30.933709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.898 [2024-11-28 04:34:30.933802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.933827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.933924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.934210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.934428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.934680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.934902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.934999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.935122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.935372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.935630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.935849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.935976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.936106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.936323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.936549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.936797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.936959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.937063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.937319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.937574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.937801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.937925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.938033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.938316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.938553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.938767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.938917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.939052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.939265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.939518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.939746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.939865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.939964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.940061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.940085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.940173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.940262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.940286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.940416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.940545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.940570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.899 qpair failed and we were unable to recover it. 00:27:53.899 [2024-11-28 04:34:30.940669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.899 [2024-11-28 04:34:30.940763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.940787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.940889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.941163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.941432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.941656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.941807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.941906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.942158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.942373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.942611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.942864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.942989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.943089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.943340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.943576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.943825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.943949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.944045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.944271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.944531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.944787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.944905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.945061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.945269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.945575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.945821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.945945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.946046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.946269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.946495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.946745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.946893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.946994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.947088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.947115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.947222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.947345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.947370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.900 qpair failed and we were unable to recover it. 00:27:53.900 [2024-11-28 04:34:30.947462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.947586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.900 [2024-11-28 04:34:30.947613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.947711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.947796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.947822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.947922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.948198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.948416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.948639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.948892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.948985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.949011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.949164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.949252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.949276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.949398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.949485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.949509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.949613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.949763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.949789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.949886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.950128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.950402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.950667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.950825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.950915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.951135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.951383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.951666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.951890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.951983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.952101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.952343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.952564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.952816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.952943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.953042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.953136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.953161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.953291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.953414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.953439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.953577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.953680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.901 [2024-11-28 04:34:30.953705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.901 qpair failed and we were unable to recover it. 00:27:53.901 [2024-11-28 04:34:30.953796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.953899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.953924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.954050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.954253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.954509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.954766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.954916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.955017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.955269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.955519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.955801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.955951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.956074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.956310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.956561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.956820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.956975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.957070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.957303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.957550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.957772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.957898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.958021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.958233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.958534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.958752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.958869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.958959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.959184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.959406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.959635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.959789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.959891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.960159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.960396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.902 qpair failed and we were unable to recover it. 00:27:53.902 [2024-11-28 04:34:30.960655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.902 [2024-11-28 04:34:30.960778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.960874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.960968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.960998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.961119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.961399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.961620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.961868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.961990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.962090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.962353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.962593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.962839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.962964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.963094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.963352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.963621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.963878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.963998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.964094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.964347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.964593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.964827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.964980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.965103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.965321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.965567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.965815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.965967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.966070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.966296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.966550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.966773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.966892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.966993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.967117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.967141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.967235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.967335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.967361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.967486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.967582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.967607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.903 qpair failed and we were unable to recover it. 00:27:53.903 [2024-11-28 04:34:30.967703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.903 [2024-11-28 04:34:30.967796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.967822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.967916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.968171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.968401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.968632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.968847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.968969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.969061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.969316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.969567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.969820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.969935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.970062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.970290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.970518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.970789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.970907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.971001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.971213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.971460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.971709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.971836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.971937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.972208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.972451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.972669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.972787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.972878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.973137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.973382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.973637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.973885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.973985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.974010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.974107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.974197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.974222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.974348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.974476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.904 [2024-11-28 04:34:30.974501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.904 qpair failed and we were unable to recover it. 00:27:53.904 [2024-11-28 04:34:30.974613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.974741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.974766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.974866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.974983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.975111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.975330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.975618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.975878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.975998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.976024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.976153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.976273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.976297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.976398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.976491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.976517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.976628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.976761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.976786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.976913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.977156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.977410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.977633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.977758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.977882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.978199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.978439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.978674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.978801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.978908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.979150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.979407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.979635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.979880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.979999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.980099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.980337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.980571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.980795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.905 [2024-11-28 04:34:30.980971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.905 qpair failed and we were unable to recover it. 00:27:53.905 [2024-11-28 04:34:30.981074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.981283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.981523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.981751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.981927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.982017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.982220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.982483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.982734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.982860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.982961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.983232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.983476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.983720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.983895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.983993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.984229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.984441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.984668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.984825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.984929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.985181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.985412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.985674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.985827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.985951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.986174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.986416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.986687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.986831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.986925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.987154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.987365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.987660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.987778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.906 qpair failed and we were unable to recover it. 00:27:53.906 [2024-11-28 04:34:30.987924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.906 [2024-11-28 04:34:30.988095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.988124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.988231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.988330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.988356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.988453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.988554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.988581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.988706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.988813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.988840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.988936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.989172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.989395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.989622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.989873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.989977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.990126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.990370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.990605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.990829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.990952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.991048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.991326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.991560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.991787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.991915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.992048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.992262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.992501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.992812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.992950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.993060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.993315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.993555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.993780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.993933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.994033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.994257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.994477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.994736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.994863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.907 qpair failed and we were unable to recover it. 00:27:53.907 [2024-11-28 04:34:30.994955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.907 [2024-11-28 04:34:30.995080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.995107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.995236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.995394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.995420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.995521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.995629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.995655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.995757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.995859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.995887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.995993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.996270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.996483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.996700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.996855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.996982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.997254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.997467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.997724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.997907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.998002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.998257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.998478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.998706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.998834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.998942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.999195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.999442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.999674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:30.999825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:30.999922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.000176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.000397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.000637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.000864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.000973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.001100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.001349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.001596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.908 qpair failed and we were unable to recover it. 00:27:53.908 [2024-11-28 04:34:31.001852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.001995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.908 [2024-11-28 04:34:31.002025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.002134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.002365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.002611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.002857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.002983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.003086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.003318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.003617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.003843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.003967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.004067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.004328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.004560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.004844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.004996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.005130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.005350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.005580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.005834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.005956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.006061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.006288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.006593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.006848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.006970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.007073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.007324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.007560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.007799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.007926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.008058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.008294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.008517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.008758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.909 [2024-11-28 04:34:31.008918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.909 qpair failed and we were unable to recover it. 00:27:53.909 [2024-11-28 04:34:31.009023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.009279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.009493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.009754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.009926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.010031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.010311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.010563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.010814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.010961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.011056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.011302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.011536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.011806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.011929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.012031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.012289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.012510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.012785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.012910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.013009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.013262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.013495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.013742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.013861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.013960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.014173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.014395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.014634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.014786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.014912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.015032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.015058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.015161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.015265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.015291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.910 qpair failed and we were unable to recover it. 00:27:53.910 [2024-11-28 04:34:31.015425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.910 [2024-11-28 04:34:31.015513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.015557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.015651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.015750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.015777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.015878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.015978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.016100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.016350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.016582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.016811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.016928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.017048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.017288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.017547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.017774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.017924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.018015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.018291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.018549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.018795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.018947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.019040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.019298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.019557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.019794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.019946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.020055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.020271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.020495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.020758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.020893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.021037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.021253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.021474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.021722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.021873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.021968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.022072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.022098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.911 [2024-11-28 04:34:31.022195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.022299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.911 [2024-11-28 04:34:31.022325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.911 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.022426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.022523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.022554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.022658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.022757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.022783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.022883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.022985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.023107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.023365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.023639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.023875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.023999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.024096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.024227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.024253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.024377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.024510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.024543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.024636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.024726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.024752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.024896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.025140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.025389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.025618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.025872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.025998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.026143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.026381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.026613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.026866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.026985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.027083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.027313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.027561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.027804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.027925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.028057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.028281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.028537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.028788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.028938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.029068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.029172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.029197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.912 qpair failed and we were unable to recover it. 00:27:53.912 [2024-11-28 04:34:31.029295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.029390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.912 [2024-11-28 04:34:31.029415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.029514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.029615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.029641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.029745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.029842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.029868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.029966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.030216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.030442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.030682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.030800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.030927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.031181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.031409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.031647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.031772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.031904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.032117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.032377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.032605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.032888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.032987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.033136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.033382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.033609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.033864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.033981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.034107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.034261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.034287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.034388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.034519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.034552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.034686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.034794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.034821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.034920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.035139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.035402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.035644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.035857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.035977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.913 [2024-11-28 04:34:31.036078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.036204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.913 [2024-11-28 04:34:31.036229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.913 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.036327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.036460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.036486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.036615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.036744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.036771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.036927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.037157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.037418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.037698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.037859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.037962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.038199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.038459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.038685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.038838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.038959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.039215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.039451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.039674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.039830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.039927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.040157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.040383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.040666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.040799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.040927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.041145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.041427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.041703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.041828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.041931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.042185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.042428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.914 qpair failed and we were unable to recover it. 00:27:53.914 [2024-11-28 04:34:31.042675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.914 [2024-11-28 04:34:31.042799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.042894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.042990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.043016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.043140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.043266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.043292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.043419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.043520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.043561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.043667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.043768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.043794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.043919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.044148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.044423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.044652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.044813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.044911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.045163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.045410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.045643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.045860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.045981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.046130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.046389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.046620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.046841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.046967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.047074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.047326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.047581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.047838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.047992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.048086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.048327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.048555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.048809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.048937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.049069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.049199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.049226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.049322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.049448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.049474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.049574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.049675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.049701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.915 qpair failed and we were unable to recover it. 00:27:53.915 [2024-11-28 04:34:31.049804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.915 [2024-11-28 04:34:31.049898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.049925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.050025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.050248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.050490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.050730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.050854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.050952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.051208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.051484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.051757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.051881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.051990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.052217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.052466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.052686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.052837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.052934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.053185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.053404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.053661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.053809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.053940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.054196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.054416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.054690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.054808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.054912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.055163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.055385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.055676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.055802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.055930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.056155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.056406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.056705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.916 [2024-11-28 04:34:31.056825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.916 qpair failed and we were unable to recover it. 00:27:53.916 [2024-11-28 04:34:31.056948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.057162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.057375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.057628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.057803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.057905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.058131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.058359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.058630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.058886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.058989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.059118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.059368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.059619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.059856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.059978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.060098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.060376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.060649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.060865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.060997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.061117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.061362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.061629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.061844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.061971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.062129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.062342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.062585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.062813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.062965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.063062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.063307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.063586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.917 [2024-11-28 04:34:31.063833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.917 [2024-11-28 04:34:31.063963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.917 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.064087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.064338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.064577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.064832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.064984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.065074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.065333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.065574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.065828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.065950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.066052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.066298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.066560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.066801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.066921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.067024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.067287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.067504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.067733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.067922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.068024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.068244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.068519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.068744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.068866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.068971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.069219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.069438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.069672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.069821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.069944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.070185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.070412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.070649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.070777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.918 qpair failed and we were unable to recover it. 00:27:53.918 [2024-11-28 04:34:31.070905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.071033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.918 [2024-11-28 04:34:31.071060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.071182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.071283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.071308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.071429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.071552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.071579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.071681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.071774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.071800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.071895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.072145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.072387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.072678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.072834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.072961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.073183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.073409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.073649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.073785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.073886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.074135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.074388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.074676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.074797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.074902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.075178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.075416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.075673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.075800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.075918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.076179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.076451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.076759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.076903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.077066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.077165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.077196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.077295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.077394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.077420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.919 [2024-11-28 04:34:31.077521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.077633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.919 [2024-11-28 04:34:31.077659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.919 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.077784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.077913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.077939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.078038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.078256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.078508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.078744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.078890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.078989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.079237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.079507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.079752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.079878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.079976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.080192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.080419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.080648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.080801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.080924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.081164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.081445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.081673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.081791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.081919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.082208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.082451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.082676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.082803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.082926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.083145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.083422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.083646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.083866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.083994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.084118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.084360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.084597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.084823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.084942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.920 qpair failed and we were unable to recover it. 00:27:53.920 [2024-11-28 04:34:31.085041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.920 [2024-11-28 04:34:31.085148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.085174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.085271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.085360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.085387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.085507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.085636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.085662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.085765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.085918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.085944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.086050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.086272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.086541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.086762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.086877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.086977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.087229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.087503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.087729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.087884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.088012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.088237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.088519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.088747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.088863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.088965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.089192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.089420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.089658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.089777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.089905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.090138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.090355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.090600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.090844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.090985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.091109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.091348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.091581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.091820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.091945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.092041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.092133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.092158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.092254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.092373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.092398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.921 qpair failed and we were unable to recover it. 00:27:53.921 [2024-11-28 04:34:31.092498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.921 [2024-11-28 04:34:31.092607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.092633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.092764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.092864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.092889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.092987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.093237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.093461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.093693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.093843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.093938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.094156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.094379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.094601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.094814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.094940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.095042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.095280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.095499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.095785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.095927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.096056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.096280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.096516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.096822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.096951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.097082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.097326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.097553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.097802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.097919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.098018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.098271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.098521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.098783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.098905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.099010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.099261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.099510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.099782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.922 [2024-11-28 04:34:31.099904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.922 qpair failed and we were unable to recover it. 00:27:53.922 [2024-11-28 04:34:31.099992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.100262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.100517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.100754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.100873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.100978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.101196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.101467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.101754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.101883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.101987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.102236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.102487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.102738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.102859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.102982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.103205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.103467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.103724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.103875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.103978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.104239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f0000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.104497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.104734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.104881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.104982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.105189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.105400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.105655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.105886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.105983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.106010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.106133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.106227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.106253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.106354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.106451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.106476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.106577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.106682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.923 [2024-11-28 04:34:31.106707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.923 qpair failed and we were unable to recover it. 00:27:53.923 [2024-11-28 04:34:31.106802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.106903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.106929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.107026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.107279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.107534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.107790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.107943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.108073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.108295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.108529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.108748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.108880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.108983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.109204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.109452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.109678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.109899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.109999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.110024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.110121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.110245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.110270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.110379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.110495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.110532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.110670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.110766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.110792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.110917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.111192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.111443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.111690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.111817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.111938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.112160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.112405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.112657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.112869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.112990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.113087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.113307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.113519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.113775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.113904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.114008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.114105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.114129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.114233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.114320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.114344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.114443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.114538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.114564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.924 qpair failed and we were unable to recover it. 00:27:53.924 [2024-11-28 04:34:31.114677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.924 [2024-11-28 04:34:31.114783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.114812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.114946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.115200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.115451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.115703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.115836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.115931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.116192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.116441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.116692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.116807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.116929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.117186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.117431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.117651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.117861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.117986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.118094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.118301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.118572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.118795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.118946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.119075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.119306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.119522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.119843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.119969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.120092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.120314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.120554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.120786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.120931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.121030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.121260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.121515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.121768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.121882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.122014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.122303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.122515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.122768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.925 [2024-11-28 04:34:31.122921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.925 qpair failed and we were unable to recover it. 00:27:53.925 [2024-11-28 04:34:31.123018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.123270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.123531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.123746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.123898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.123991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.124216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.124455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.124684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.124838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.124963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.125203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.125479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.125754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.125872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.125972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.126223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.126450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.126685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.126806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.126905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.127131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.127374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.127634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.127870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.127988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.128013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.128134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.128253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.128278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.128411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.128538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.128564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.128659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.128756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.128781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.128914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.129171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.129447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.129702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.129824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.129921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.130147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.130388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.130610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.130839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.130975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.131003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.926 qpair failed and we were unable to recover it. 00:27:53.926 [2024-11-28 04:34:31.131136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.131238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.926 [2024-11-28 04:34:31.131262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.131353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.131447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.131472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.131569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.131703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.131728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.131859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.131980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.132102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.132345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.132574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.132798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.132954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.133049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.133261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.133515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.133744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.133866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.133965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.134266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.134532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.134766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.134894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.135027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.135282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.135565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.135838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.135965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.136063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.136279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.136520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.136744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.136864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.136962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.137208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.137453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.137680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.137803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.137903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.138066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.138091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.138194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.138296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.138320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.927 qpair failed and we were unable to recover it. 00:27:53.927 [2024-11-28 04:34:31.138424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.138530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.927 [2024-11-28 04:34:31.138555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.138650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.138779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.138803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.138926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.139170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.139397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.139654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.139872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.139976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.140130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.140360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.140572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.140801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.140955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.141046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.141264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.141511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.141763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.141886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.141986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.142236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.142455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.142679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.142794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.142922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.143154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.143429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.143671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.143803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.143933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.144144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.144367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.144594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.144845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.144990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.145087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.145328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.145589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.145846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.145969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.146089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.146377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.146594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.146852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.146970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.928 [2024-11-28 04:34:31.147069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.147161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.928 [2024-11-28 04:34:31.147187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.928 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.147319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.147421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.147447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.147544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.147638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.147663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.147755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.147882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.147907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.148031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.148296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.148578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.148832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.148954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.149082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.149333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.149596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.149834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.149955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.150044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.150138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.150162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.150318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.150439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.150464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.150590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.150739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.150768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.150909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.151156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.151370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.151593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.151815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.151937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.152065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.152314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.152562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.152774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.152894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.153027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.153242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.153499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.153737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.153863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.153990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.154205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.154464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.154692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.154837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.154957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.155186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.155410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.155673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.155816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.155981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.156236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.156489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.156753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.156910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.157003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.157229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.157446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.157701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.157826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.157925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.158193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.158476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.158704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.158820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.158922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.159176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.159457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.159703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.159859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.159962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.160225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.160443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.160702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.929 [2024-11-28 04:34:31.160827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.929 qpair failed and we were unable to recover it. 00:27:53.929 [2024-11-28 04:34:31.160933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.161184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.161401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.161639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.161869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.161977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.162106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.162350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.162568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.162800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.162923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.163033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.163267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.163495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.163767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.163923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:53.930 [2024-11-28 04:34:31.164051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.164155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:53.930 [2024-11-28 04:34:31.164181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:53.930 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.164289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.164416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.164441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.164553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.164649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.164675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.164778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.164899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.164924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.165056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.165277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.165543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.165778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.165900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.165995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.166240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.166453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.166701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.166822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.166946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.167045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.167070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.167168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.167272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.167296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-28 04:34:31.167389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-28 04:34:31.167505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.167542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.167637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.167741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.167766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.167863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.167991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.168020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.168170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.168268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.168293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.168405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.168537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.168562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.168665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.168799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.168824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.168923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.169179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.169398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.169643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.169790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.169912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.170124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.170377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.170604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.170826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.170951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.171069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.171362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.171627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.171871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.171993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.172096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.172193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.172220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.172323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.172444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.172469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-28 04:34:31.172569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-28 04:34:31.172665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.172690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.172787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.172875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.172901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.173002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.173243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.173499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.173730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.173882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.173983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.174201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.174451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.174675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.174824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.174951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.175181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.175407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.175668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.175794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.175886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.176185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.176444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.176692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.176850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.176952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.177228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.177484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.177738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-28 04:34:31.177891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-28 04:34:31.178015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.178304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.178552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.178766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.178886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.178981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.179242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.179519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.179773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.179894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.180027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.180253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.180466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.180718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.180834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.180924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.181170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.181413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.181654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.181885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.181975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.182119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.182341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.182602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.182880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.182977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.183002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.183096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.183195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-28 04:34:31.183220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-28 04:34:31.183351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.183478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.183503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.183616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.183705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.183731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.183831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.183953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.183978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.184079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.184305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.184537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.184757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.184876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.184967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.185241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.185502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.185740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.185894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.186019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.186287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.186560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.186808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.186930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.187028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.187269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.187585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.187807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.187935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.188025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.188122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.188147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-28 04:34:31.188240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.188338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-28 04:34:31.188364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.188463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.188564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.188590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.188720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.188813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.188838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.188939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.189185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.189457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.189735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.189864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.189961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.190192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.190468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.190692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.190848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.190944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.191194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.191471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.191722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.191834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.191924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.192148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.192392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.192618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.192856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.192982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.193006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.193103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.193198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.193224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.193317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.193442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.193466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-28 04:34:31.193606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.193699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-28 04:34:31.193724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.193820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.193948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.193972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.194073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.194219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.194244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.194367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.194458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.194482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.194584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.194713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.194739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.194837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.194996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.195142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.195394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.195616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.195865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.195980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.196078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.196348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.196568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.196796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.196913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.197008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.197312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.197559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.197797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-28 04:34:31.197923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-28 04:34:31.198022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.198302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.198555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.198818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.198963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.199061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.199316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.199568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.199781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.199934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.200035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.200311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.200531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.200804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.200933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.201031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.201255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.201508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.201746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.201873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.201978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.202197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.202452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.202706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.202840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.202940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.203064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.203088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.203184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.203284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.203308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.203431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.203561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.203586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-28 04:34:31.203688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-28 04:34:31.203813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.203838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.203943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.204202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.204479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.204777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.204903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.205003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.205128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.205154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.205282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.205413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.205438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.205562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.205665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.205691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.205845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.205998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.206126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.206393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.206655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.206870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.206996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.207124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.207370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.207601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.207829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.207983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.208088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.208313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.208585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.208846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.208996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-28 04:34:31.209089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.209215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-28 04:34:31.209240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.209336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.209437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.209463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.209580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.209690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.209719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.209854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.209986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.210106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.210321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.210544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.210799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.210926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.211024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.211273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.211546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.211790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.211913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.212004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.212246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.212516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.212744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.212858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.212957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.213196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.213442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.213689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.213838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.213967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.214059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.214084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.214184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.214280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.214306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-28 04:34:31.214434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.214538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-28 04:34:31.214565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.214666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.214797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.214822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.214987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.215240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.215491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.215758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.215884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.215991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.216200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.216443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.216702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.216854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.216951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.217170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.217417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.217638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.217871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.217994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.218089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.218325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.218571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.218806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.218926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.219032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.219277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.219558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-28 04:34:31.219800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-28 04:34:31.219927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.220028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.220285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.220498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.220751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.220913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.221011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.221223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.221476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.221698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.221813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.221908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.222149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.222384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.222621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.222867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.222996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.223096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.223341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.223594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.223827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.223950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.224081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.224301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.224547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.224774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.224927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.225022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.225116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-28 04:34:31.225141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-28 04:34:31.225261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.225388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.225414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.225521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.225648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.225672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.225775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.225894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.225920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.226025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.226253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.226476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.226699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.226823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.226923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.227139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.227366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.227626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.227869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.227992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.228123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.228357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.228611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.228864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.228984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.229083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.229185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.229211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.229318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.229471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.229496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-28 04:34:31.229616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.229712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-28 04:34:31.229738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.229903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.230129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.230345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.230569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.230814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.230936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.231023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.231266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.231481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.231722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.231839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.231966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.232225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.232453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.232695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.232818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.232915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.233130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.233381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.233619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.233877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.233992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.234142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.234241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.234267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.234368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.234463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.234489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.234601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.234736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.234762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.234888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.234983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.235009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-28 04:34:31.235105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-28 04:34:31.235226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.235251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.235358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.235453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.235478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.235607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.235709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.235734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.235826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.235923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.235947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.236052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.236311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.236537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.236753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.236905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.237004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.237286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.237547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.237836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.237956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.238078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.238293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.238567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.238809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.238930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.239040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.239251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.239479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.239733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.239905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.240037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.240134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.240160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.240266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.240364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.240390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-28 04:34:31.240488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.240616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-28 04:34:31.240643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.240741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.240831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.240857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.240978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.241230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.241455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.241683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.241809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.241909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.242196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.242413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.242650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.242809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.242908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.243210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.243459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.243716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.243844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.243946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.244157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.244392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.244649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.244865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.244997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.245150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.245360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.245669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-28 04:34:31.245879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.245978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-28 04:34:31.246002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.246092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.246340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.246564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.246791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.246918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.247021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.247277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.247530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.247761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.247904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.248006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.248244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.248480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.248737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.248877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.248983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.249231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.249452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.249710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.249831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.249924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.250176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.250417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.250666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.250879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.250982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.251009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.251113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.251242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.251267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.251369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.251504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.251537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-28 04:34:31.251661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-28 04:34:31.251761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.251786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.251887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.252140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.252359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.252579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.252807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.252925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.253016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.253331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.253536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.253787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.253941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.254039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.254252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.254508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.254743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.254901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.255035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.255278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.255537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.255762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.255914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.256008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.256232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.256456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.256677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.256797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.256920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.257017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.257042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.228 qpair failed and we were unable to recover it. 00:27:54.228 [2024-11-28 04:34:31.257179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.228 [2024-11-28 04:34:31.257286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.257314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.257413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.257519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.257551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.257645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.257740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.257766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.257869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.257955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.257979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.258077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.258291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.258568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.258788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.258940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.259037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.259284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.259538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.259767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.259890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.260013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.260239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.260463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.260738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.260915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.261007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.261096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.261121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.261220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.261341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.229 [2024-11-28 04:34:31.261366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.229 qpair failed and we were unable to recover it. 00:27:54.229 [2024-11-28 04:34:31.261490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.261591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.261616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.261707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.261798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.261827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.261929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.262184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.262418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.262642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.262766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.262889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.263151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.263427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.263668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.263885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.263982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.264109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.264331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.264577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.264790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.264904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.265001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.265269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.265511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.265736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.265852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.265946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.266173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.266422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.230 qpair failed and we were unable to recover it. 00:27:54.230 [2024-11-28 04:34:31.266669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.230 [2024-11-28 04:34:31.266821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.266926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.267187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.267451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.267680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.267800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.267903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.268139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.268426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.268691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.268816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.268915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.269171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.269397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.269657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.269819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.269947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.270221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.270500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.270734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.270848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.270980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.271230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.271467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.271698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.271884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.231 [2024-11-28 04:34:31.272015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.272113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.231 [2024-11-28 04:34:31.272138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.231 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.272268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.272370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.272395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.272494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.272625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.272651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.272804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.272899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.272926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.273026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.273251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.273465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.273710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.273838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.273937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.274154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.274380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.274602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.274821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.274938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.275034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.275283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.275510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.275742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.275864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.275963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.276172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.276392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.276627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.276752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.276884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.277041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.277068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.232 qpair failed and we were unable to recover it. 00:27:54.232 [2024-11-28 04:34:31.277199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.232 [2024-11-28 04:34:31.277322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.277346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.277470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.277559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.277585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.277692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.277788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.277814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.277911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.278135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.278360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.278587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.278804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.278930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.279030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.279304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.279518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.279749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.279873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.279974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.280220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.280441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.280725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.280847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.280949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.281183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.281435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.281661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.281785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.281883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.282005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.282029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.282121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.282220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.282247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.233 qpair failed and we were unable to recover it. 00:27:54.233 [2024-11-28 04:34:31.282403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.233 [2024-11-28 04:34:31.282500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.282533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.282632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.282721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.282746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.282849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.282937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.282961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.283059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.283314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.283566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.283789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.283923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.284024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.284254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.284478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.284736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.284866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.284960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.285216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.285432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.285657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.285884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.285984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.286135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.286390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.286640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.286865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.286991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.287125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.287221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.287247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.287370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.287498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.287523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.287628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.287716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.234 [2024-11-28 04:34:31.287740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.234 qpair failed and we were unable to recover it. 00:27:54.234 [2024-11-28 04:34:31.287860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.287956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.287982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.288089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.288318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.288566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.288832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.288956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.289054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.289336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.289593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.289813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.289962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.290088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.290326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.290544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.290810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.290942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.291032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.291268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.291486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.291725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.291849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.235 qpair failed and we were unable to recover it. 00:27:54.235 [2024-11-28 04:34:31.291952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.235 [2024-11-28 04:34:31.292072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.292096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.292189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.292283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.292310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.292463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.292557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.292583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.292685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.292825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.292850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.292958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.293209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.293423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.293649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.293801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.293922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.294177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.294395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.294653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.294787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.294887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.295140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.295369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.295592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.295813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.295962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.296055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.296286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.296568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.296815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.296940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.297040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.297138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.236 [2024-11-28 04:34:31.297163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.236 qpair failed and we were unable to recover it. 00:27:54.236 [2024-11-28 04:34:31.297260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.297381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.297407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.297501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.297636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.297662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.297786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.297885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.297910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.298033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.298276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.298509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.298743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.298862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.298961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.299205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.299420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.299671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.299796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.299892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.300170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.300395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.300681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.300813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.300918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.301149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.301394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.301618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.301867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.301997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.302100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.302199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.302225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.302329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.302446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.302472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.302570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.302667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.237 [2024-11-28 04:34:31.302692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.237 qpair failed and we were unable to recover it. 00:27:54.237 [2024-11-28 04:34:31.302795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.302889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.302914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.303019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.303328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.303638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.303860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.303976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.304107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.304334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.304569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.304819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.304936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.305032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.305250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.305472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.305752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.305881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.305972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.306232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.306455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.306704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.306829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.306986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.307222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.307469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.307697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.307825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.307927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.308018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.308044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.308151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.308251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.308276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.238 [2024-11-28 04:34:31.308373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.308467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.238 [2024-11-28 04:34:31.308491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.238 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.308652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.308757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.308782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.308914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.309164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.309411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.309659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.309889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.309989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.310109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.310330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.310571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.310786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.310914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.311008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.311243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.311471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.311701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.311882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.311982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.312197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.312406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.312687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.312837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.312966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.313252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.313539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.313756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.313875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.239 qpair failed and we were unable to recover it. 00:27:54.239 [2024-11-28 04:34:31.313965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.239 [2024-11-28 04:34:31.314052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.314077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.314177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.314303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.314328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.314426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.314532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.314558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.314692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.314793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.314818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.314922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.315197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.315451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.315670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.315899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.315993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.316120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.316369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.316586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.316838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.316972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.317081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.317301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.317518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.317771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.317893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.317990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.318209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.318441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.318684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.318808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.318907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.319004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.319029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.240 qpair failed and we were unable to recover it. 00:27:54.240 [2024-11-28 04:34:31.319121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.240 [2024-11-28 04:34:31.319217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.319242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.319343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.319444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.319470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.319574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.319676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.319702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.319802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.319900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.319925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.320084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.320332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.320582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.320846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.320961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.321064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.321342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.321599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.321876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.321995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.322093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.322305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.322533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.322796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.322922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.323045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.323156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.323181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.323295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.323422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.241 [2024-11-28 04:34:31.323447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.241 qpair failed and we were unable to recover it. 00:27:54.241 [2024-11-28 04:34:31.323544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.323642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.323668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.323796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.323896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.323923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.324018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.324256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.324490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.324717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.324866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.324963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.325185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.325433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.325712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.325828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.325931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.326160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.326434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.326680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.326807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.326910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.327134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.327361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.327613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.327832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.327978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.328107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.328195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.328220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.328323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.328439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.328463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.242 qpair failed and we were unable to recover it. 00:27:54.242 [2024-11-28 04:34:31.328563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.242 [2024-11-28 04:34:31.328689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.328715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.328809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.328958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.328984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.329071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.329284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.329512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.329730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.329851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.329982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.330229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.330444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.330673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.330890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.330994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.331117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.331330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.331570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.331818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.331942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.332091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.332302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.332522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.332782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.332908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.333011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.333244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.333490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.333747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.333903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.243 qpair failed and we were unable to recover it. 00:27:54.243 [2024-11-28 04:34:31.334033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.243 [2024-11-28 04:34:31.334156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.334183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.334311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.334403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.334429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.334534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.334633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.334658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.334780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.334877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.334902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.335041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.335285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.335578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.335834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.335965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.336067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.336288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.336513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.336770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.336908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.337005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.337246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.337466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.337687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.337807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.337908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.338162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.338389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.338605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.338833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.338987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.339083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.339207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.339231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.339333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.339434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.244 [2024-11-28 04:34:31.339459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.244 qpair failed and we were unable to recover it. 00:27:54.244 [2024-11-28 04:34:31.339563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.339685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.339710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.339813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.339936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.339961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.340065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.340282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.340572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.340806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.340930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.341060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.341298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.341532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.341815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.341932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.342035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.342282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.342562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.342779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.342902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.343008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.343215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.343465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.343694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.343816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.343945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.344193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.344410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.245 [2024-11-28 04:34:31.344660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.245 [2024-11-28 04:34:31.344807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.245 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.344909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.345156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.345437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.345720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.345844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.345937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.346161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.346445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.346695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.346843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.346931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.347149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.347408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.347637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.347857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.347986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.348087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.348345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.348570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.348816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.348940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.349037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.349321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.349564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.349814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.349933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.350066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.350155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.246 [2024-11-28 04:34:31.350180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.246 qpair failed and we were unable to recover it. 00:27:54.246 [2024-11-28 04:34:31.350281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.350397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.350423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.350530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.350636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.350663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.350763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.350882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.350906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.351027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.351255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.351497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.351722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.351841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.351969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.352213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.352481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.352746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.352878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.352978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.353228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.353454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.353706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.353825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.353929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.354028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.354054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.354187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.354307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.354333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.354454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.354577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.354603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.247 qpair failed and we were unable to recover it. 00:27:54.247 [2024-11-28 04:34:31.354696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.247 [2024-11-28 04:34:31.354796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.354821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.354909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.355149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.355366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.355589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.355811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.355939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.356046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.356261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.356476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.356732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.356844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.356935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.357148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.357393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.357641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.357791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.357889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.358131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.358393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.358620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.358859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.358980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.359101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.359191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.359216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.359317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.359410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.359434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.248 [2024-11-28 04:34:31.359564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.359653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.248 [2024-11-28 04:34:31.359678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.248 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.359778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.359875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.359900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.359995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.360289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.360508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.360731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.360875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.360971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.361190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.361446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.361667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.361818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.361939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.362157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.362396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.362681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.362794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.362913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.363127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.363402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.363629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.363879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.363992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.364084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.364177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.364201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.364328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.364415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.364440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.364555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.364718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.364744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.249 qpair failed and we were unable to recover it. 00:27:54.249 [2024-11-28 04:34:31.364845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.249 [2024-11-28 04:34:31.364944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.364969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.365079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.365297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.365559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.365820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.365971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.366099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.366352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.366579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.366816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.366934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.367033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.367285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.367517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.367758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.367889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.367993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.368246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.368470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.368753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.368908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.369007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.369233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.369463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.369693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.369824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.250 qpair failed and we were unable to recover it. 00:27:54.250 [2024-11-28 04:34:31.369956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.370077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.250 [2024-11-28 04:34:31.370103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.370231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.370326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.370351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.370480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.370673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.370700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.370842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.370947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.370972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.371069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.371171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.371197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.371308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.371443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.371468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.371580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.371675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.371700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.372244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.372385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.372412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.372511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.372662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.372687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.372782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.372879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.372908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.373013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.373293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.373566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.373829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.373953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.374083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.374328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.374570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.374813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.374940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.375068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.375319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.375581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.375793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.375947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.251 qpair failed and we were unable to recover it. 00:27:54.251 [2024-11-28 04:34:31.376048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.251 [2024-11-28 04:34:31.376146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.376171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.376321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.376440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.376465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.376557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.376706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.376731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.376831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.376926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.376952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.377056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.377302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.377548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.377802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.377929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.378070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.378356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.378589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.378871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.378993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.379091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.379365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.379597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.379817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.379938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.380032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.380130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.380154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.380245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.380348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.380374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 04:34:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:54.252 [2024-11-28 04:34:31.380481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 04:34:31 -- common/autotest_common.sh@862 -- # return 0 00:27:54.252 [2024-11-28 04:34:31.380597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.380625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.380722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 04:34:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:54.252 [2024-11-28 04:34:31.380850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 04:34:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:54.252 [2024-11-28 04:34:31.380876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.380973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 04:34:31 -- common/autotest_common.sh@10 -- # set +x 00:27:54.252 [2024-11-28 04:34:31.381129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.381154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.381252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.381372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.381396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.252 qpair failed and we were unable to recover it. 00:27:54.252 [2024-11-28 04:34:31.381497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.252 [2024-11-28 04:34:31.381646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.381673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.381774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.381877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.381902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.382034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.382261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.382479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25f8000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.382777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.382918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.383022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.383273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.383533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.383765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.383920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.384017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.384253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.384471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.384711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.384829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.384962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.385201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.385509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.385752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.253 [2024-11-28 04:34:31.385896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.253 qpair failed and we were unable to recover it. 00:27:54.253 [2024-11-28 04:34:31.385993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.386246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.386479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.386782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.386933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.387032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.387312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.387535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.387828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.387961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.388064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.388309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.388545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.388767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.388891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.388994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.389278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.389536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.389758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.389885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.389983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.390204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.390456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.390714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.390886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.390987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.391116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.391143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.391244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.391374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.391400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.254 [2024-11-28 04:34:31.391495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.391603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.254 [2024-11-28 04:34:31.391629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.254 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.391730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.391854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.391879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.391970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.392198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.392459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.392687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.392817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.392922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.393147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.393434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.393699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.393832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.393962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.394188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.394440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.394727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.394864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.394973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.395223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.395457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.395717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.395864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.395988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.396251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.396505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.396736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.396868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.397004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.397097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.397122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.397224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.397355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.397380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.255 qpair failed and we were unable to recover it. 00:27:54.255 [2024-11-28 04:34:31.397484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.255 [2024-11-28 04:34:31.397594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.397621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.397730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.397835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.397865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.397969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.398208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.398504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.398789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.398922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.399029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.399277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.399501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.399782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.399935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.400063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.400284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.400517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.400787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.400941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.401069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.401299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.401583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.401840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.401970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.402099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.402203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.402229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.402328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.402431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.402457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.402557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.402713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.402738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.402871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 04:34:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:54.256 [2024-11-28 04:34:31.402975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 [2024-11-28 04:34:31.403001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.256 qpair failed and we were unable to recover it. 00:27:54.256 [2024-11-28 04:34:31.403126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.256 04:34:31 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:54.256 [2024-11-28 04:34:31.403222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.403247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 04:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:54.257 [2024-11-28 04:34:31.403375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 04:34:31 -- common/autotest_common.sh@10 -- # set +x 00:27:54.257 [2024-11-28 04:34:31.403474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.403500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.403625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.403716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.403741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.403841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.403960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.403988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.404092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.404355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.404611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.404855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.404982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.405084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.405345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.405573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.405805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.405920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.406053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.406261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.406509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.406745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.406865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.406963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.407207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.407442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.407706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.407860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.407988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.408214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.408474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.408711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.408843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.257 qpair failed and we were unable to recover it. 00:27:54.257 [2024-11-28 04:34:31.408940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.409033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.257 [2024-11-28 04:34:31.409058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.409159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.409282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.409307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.409401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.409502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.409539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.409674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.409777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.409803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.409898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.410166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.410425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.410690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.410821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.410928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.411153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.411456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.411715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.411860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.411960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.412186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.412441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.412682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.412843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.412944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.413160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.413424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.413671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.413821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.413930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.414030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.414056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.258 [2024-11-28 04:34:31.414183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.414309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.258 [2024-11-28 04:34:31.414337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.258 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.414433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.414584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.414612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.414716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.414819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.414845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.414941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.415230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.415472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.415744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.415865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.415967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.416201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.416432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.416722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.416863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.416996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.417284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.417516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.417792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.417928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.418057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.418317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.418581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.418845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.418997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.419125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.419232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.419257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.419422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.419516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.419547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.419666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.419765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.419791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.419927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.420177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.420413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.420677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.420797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.259 [2024-11-28 04:34:31.420925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.421022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.259 [2024-11-28 04:34:31.421047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.259 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.421174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.421303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.421328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.421463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.421611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.421637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.421745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.421853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.421880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.422010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.422327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.422580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.422811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.422949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.423048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.423288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.423540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.423827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.423984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.424116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.424218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.424244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.424372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.424504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.424537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.424672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.424831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.424856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.424963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.425188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.425470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.425695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.425823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.425926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.426180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.426443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.426662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.426820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.426946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.427193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.427454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.427706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.427844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.260 qpair failed and we were unable to recover it. 00:27:54.260 [2024-11-28 04:34:31.427948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 [2024-11-28 04:34:31.428044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.260 Malloc0 00:27:54.261 [2024-11-28 04:34:31.428070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.428196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.428323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.428356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 04:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.428467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 04:34:31 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:54.261 [2024-11-28 04:34:31.428602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.428630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 04:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:54.261 [2024-11-28 04:34:31.428735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.428868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 04:34:31 -- common/autotest_common.sh@10 -- # set +x 00:27:54.261 [2024-11-28 04:34:31.428894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.428994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.429231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.429486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.429751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.429891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.430018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.430243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.430476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.430746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.430879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.431012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.431262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.431501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.431750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431794] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:54.261 [2024-11-28 04:34:31.431879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.431904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.432005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.432259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.432485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.432776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.432906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.433031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.433263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.433486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.433772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.433903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.434037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.434139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.434165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.434292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.434413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.434439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.261 qpair failed and we were unable to recover it. 00:27:54.261 [2024-11-28 04:34:31.434576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.261 [2024-11-28 04:34:31.434676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.434701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.434797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.434930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.434956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.435056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.435304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.435559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.435827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.435955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.436063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.436319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.436552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.436794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.436920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.437049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.437303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.437536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.437778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.437902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.438003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.438275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.438501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.438770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.438899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.439021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.439304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.439577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.439832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.439988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.440127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 04:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:54.262 [2024-11-28 04:34:31.440238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.440266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 04:34:31 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:54.262 [2024-11-28 04:34:31.440371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 04:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:54.262 [2024-11-28 04:34:31.440497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.440530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 04:34:31 -- common/autotest_common.sh@10 -- # set +x 00:27:54.262 [2024-11-28 04:34:31.440652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.441868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.441924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.442042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.442169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.442196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.262 [2024-11-28 04:34:31.442323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.442431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.262 [2024-11-28 04:34:31.442456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.262 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.442564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.442672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.442698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.442831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.442935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.442961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.443059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.443354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.443585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.443829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.443957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.444065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.444292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.444532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.444800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.444918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.445023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.445249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.445467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.445720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.445849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.446002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.446262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.446521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.446757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.446896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.447001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.447258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.447511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.447779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.447905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.448015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 04:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:54.263 [2024-11-28 04:34:31.448110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.448136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 04:34:31 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:54.263 [2024-11-28 04:34:31.448243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 04:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:54.263 [2024-11-28 04:34:31.448379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.448404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 04:34:31 -- common/autotest_common.sh@10 -- # set +x 00:27:54.263 [2024-11-28 04:34:31.448537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.448642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.263 [2024-11-28 04:34:31.448667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.263 qpair failed and we were unable to recover it. 00:27:54.263 [2024-11-28 04:34:31.448799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.448895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.448922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.449013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.449282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.449535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.449769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.449889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.450014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.450293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.450501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.450738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.450868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.450966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.451196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.451445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.451666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.451891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.451991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.452151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.452378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.452648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.452866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.452978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.453133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.453234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.453259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.453364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.453457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.453483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.453606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.453741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.453766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.453891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.453994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.454019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.454136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.454267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.454296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.454400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.454521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.454553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.454649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.454780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.454806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.454919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.455144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.455397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.455629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 [2024-11-28 04:34:31.455859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.455987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 04:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:54.264 [2024-11-28 04:34:31.456089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.456208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 04:34:31 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:54.264 [2024-11-28 04:34:31.456233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.264 qpair failed and we were unable to recover it. 00:27:54.264 04:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:54.264 [2024-11-28 04:34:31.456360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 [2024-11-28 04:34:31.456457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.264 04:34:31 -- common/autotest_common.sh@10 -- # set +x 00:27:54.265 [2024-11-28 04:34:31.456482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.456625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.456725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.456751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.456855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.456948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.456973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.457071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.457322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.457599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.457821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.457943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.458041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.458289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.458545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.458754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.458899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.459037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.459287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.459541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf72cb0 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.459784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.265 [2024-11-28 04:34:31.459926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f25ec000b90 with addr=10.0.0.2, port=4420 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.460007] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:54.265 [2024-11-28 04:34:31.462535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.265 [2024-11-28 04:34:31.462672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.265 [2024-11-28 04:34:31.462700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.265 [2024-11-28 04:34:31.462715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.265 [2024-11-28 04:34:31.462729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.265 [2024-11-28 04:34:31.462767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 04:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:54.265 04:34:31 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:54.265 04:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:54.265 04:34:31 -- common/autotest_common.sh@10 -- # set +x 00:27:54.265 04:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:54.265 [2024-11-28 04:34:31.472382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.265 04:34:31 -- host/target_disconnect.sh@58 -- # wait 4018520 00:27:54.265 [2024-11-28 04:34:31.472496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.265 [2024-11-28 04:34:31.472532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.265 [2024-11-28 04:34:31.472551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.265 [2024-11-28 04:34:31.472566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.265 [2024-11-28 04:34:31.472598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.482413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.265 [2024-11-28 04:34:31.482569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.265 [2024-11-28 04:34:31.482597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.265 [2024-11-28 04:34:31.482612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.265 [2024-11-28 04:34:31.482626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.265 [2024-11-28 04:34:31.482656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.265 [2024-11-28 04:34:31.492405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.265 [2024-11-28 04:34:31.492514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.265 [2024-11-28 04:34:31.492550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.265 [2024-11-28 04:34:31.492566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.265 [2024-11-28 04:34:31.492580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.265 [2024-11-28 04:34:31.492610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.265 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.502466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.502576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.502603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.502618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.502630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.502661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.512405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.512511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.512544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.512560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.512574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.512604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.522501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.522609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.522637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.522652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.522671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.522704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.532429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.532548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.532576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.532591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.532605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.532638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.542459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.542570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.542597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.542612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.542625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.542658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.552490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.552601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.552627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.552642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.552656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.552699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.562494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.562595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.562622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.562636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.562650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.562680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.572573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.572686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.572713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.572728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.572741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.572771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.582668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.582780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.582807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.582821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.582834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.582877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.592648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.592757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.592783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.592798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.592811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.592841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.602697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.602801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.602827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.602842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.602855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.602885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.612716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.612827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.612853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.612874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.612889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.525 [2024-11-28 04:34:31.612919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-28 04:34:31.622743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.525 [2024-11-28 04:34:31.622885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.525 [2024-11-28 04:34:31.622910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.525 [2024-11-28 04:34:31.622925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.525 [2024-11-28 04:34:31.622938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.622968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.632718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.632823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.632849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.632864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.632877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.632907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.642739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.642835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.642860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.642875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.642888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.642918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.652820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.652924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.652949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.652964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.652978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.653008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.662820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.662926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.662952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.662967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.662980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.663011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.672846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.672945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.672971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.672986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.673000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.673030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.682877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.682980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.683006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.683021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.683035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.683066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.692887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.693020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.693046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.693060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.693074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.693116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.702977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.703080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.703106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.703129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.703144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.703187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.712984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.713093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.713120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.713136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.713150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.713183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.722997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.723100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.723126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.723141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.723155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.723187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.732996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.733103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.733129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.733144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.733158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.733188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.743119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.743218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.743244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.743259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.743273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.743303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.753026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.526 [2024-11-28 04:34:31.753123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.526 [2024-11-28 04:34:31.753148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.526 [2024-11-28 04:34:31.753162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.526 [2024-11-28 04:34:31.753175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.526 [2024-11-28 04:34:31.753206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-28 04:34:31.763073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.763176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.763204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.763219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.763233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.763263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-28 04:34:31.773137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.773242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.773268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.773283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.773296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.773327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-28 04:34:31.783136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.783235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.783261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.783275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.783289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.783320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-28 04:34:31.793179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.793283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.793314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.793330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.793344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.793374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-28 04:34:31.803210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.803313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.803342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.803357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.803370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.803401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-28 04:34:31.813233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.813339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.813365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.813380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.813394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.813425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-28 04:34:31.823242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.823349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.823375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.823390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.823404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.823436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-28 04:34:31.833268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.527 [2024-11-28 04:34:31.833361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.527 [2024-11-28 04:34:31.833387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.527 [2024-11-28 04:34:31.833402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.527 [2024-11-28 04:34:31.833415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.527 [2024-11-28 04:34:31.833451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.843317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.843420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.843445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.843460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.843474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.843504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.853357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.853459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.853484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.853498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.853511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.853549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.863356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.863463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.863489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.863503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.863516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.863554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.873408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.873533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.873560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.873574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.873588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.873618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.883477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.883586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.883618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.883633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.883647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.883678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.893484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.893677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.893703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.893717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.893730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.893761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.903495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.903603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.903629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.903644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.903657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.903699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.913501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.913602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.913628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.786 [2024-11-28 04:34:31.913642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.786 [2024-11-28 04:34:31.913655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.786 [2024-11-28 04:34:31.913686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.786 qpair failed and we were unable to recover it. 00:27:54.786 [2024-11-28 04:34:31.923559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.786 [2024-11-28 04:34:31.923658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.786 [2024-11-28 04:34:31.923685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.923699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.923713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.923761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:31.933587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:31.933699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:31.933725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.933739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.933752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.933784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:31.943617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:31.943736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:31.943762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.943777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.943790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.943819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:31.953708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:31.953810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:31.953836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.953851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.953864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.953894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:31.963686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:31.963797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:31.963823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.963838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.963852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.963894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:31.973702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:31.973805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:31.973836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.973851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.973864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.973896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:31.983722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:31.983826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:31.983853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.983867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.983880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.983910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:31.993731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:31.993832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:31.993857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:31.993872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:31.993886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:31.993915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:32.003812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:32.003929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:32.003955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:32.003969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:32.003983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:32.004012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:32.013811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:32.013927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:32.013952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:32.013966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:32.013985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:32.014016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:32.023847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:32.023942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:32.023967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:32.023982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:32.023995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:32.024025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:32.033932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:32.034033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:32.034059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:32.034073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:32.034087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:32.034116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:32.043878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:32.043985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:32.044010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:32.044024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:32.044037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.787 [2024-11-28 04:34:32.044068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.787 qpair failed and we were unable to recover it. 00:27:54.787 [2024-11-28 04:34:32.053924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.787 [2024-11-28 04:34:32.054029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.787 [2024-11-28 04:34:32.054055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.787 [2024-11-28 04:34:32.054069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.787 [2024-11-28 04:34:32.054082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.788 [2024-11-28 04:34:32.054112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.788 qpair failed and we were unable to recover it. 00:27:54.788 [2024-11-28 04:34:32.064056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.788 [2024-11-28 04:34:32.064184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.788 [2024-11-28 04:34:32.064210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.788 [2024-11-28 04:34:32.064224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.788 [2024-11-28 04:34:32.064237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.788 [2024-11-28 04:34:32.064269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.788 qpair failed and we were unable to recover it. 00:27:54.788 [2024-11-28 04:34:32.073979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.788 [2024-11-28 04:34:32.074080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.788 [2024-11-28 04:34:32.074106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.788 [2024-11-28 04:34:32.074121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.788 [2024-11-28 04:34:32.074135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.788 [2024-11-28 04:34:32.074165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.788 qpair failed and we were unable to recover it. 00:27:54.788 [2024-11-28 04:34:32.084023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.788 [2024-11-28 04:34:32.084138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.788 [2024-11-28 04:34:32.084164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.788 [2024-11-28 04:34:32.084179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.788 [2024-11-28 04:34:32.084192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.788 [2024-11-28 04:34:32.084222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.788 qpair failed and we were unable to recover it. 00:27:54.788 [2024-11-28 04:34:32.094111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:54.788 [2024-11-28 04:34:32.094217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:54.788 [2024-11-28 04:34:32.094242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:54.788 [2024-11-28 04:34:32.094257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:54.788 [2024-11-28 04:34:32.094270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:54.788 [2024-11-28 04:34:32.094302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:54.788 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.104082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.104192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.104218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.104233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.104252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.104285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.114101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.114205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.114231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.114246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.114259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.114291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.124119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.124225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.124252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.124266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.124280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.124309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.134180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.134288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.134313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.134328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.134341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.134371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.144195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.144299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.144325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.144340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.144353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.144395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.154302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.154408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.154434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.154448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.154462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.154492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.164297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.164399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.164425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.164440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.164453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.164483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.174260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.174365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.174391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.174406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.174419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.174449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.184309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.184418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.184446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.184462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.184476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.184506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.194313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.194412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.194438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.194459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.194473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.194517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.204345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.204451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.204477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.204492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.204505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.204543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.214395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.214502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.214537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.214555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.214568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.047 [2024-11-28 04:34:32.214599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.047 qpair failed and we were unable to recover it. 00:27:55.047 [2024-11-28 04:34:32.224445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.047 [2024-11-28 04:34:32.224556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.047 [2024-11-28 04:34:32.224583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.047 [2024-11-28 04:34:32.224598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.047 [2024-11-28 04:34:32.224611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.224643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.234426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.234567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.234592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.234608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.234621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.234650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.244470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.244566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.244592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.244607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.244620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.244650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.254593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.254697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.254722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.254736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.254750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.254780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.264531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.264638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.264663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.264677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.264691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.264721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.274551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.274650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.274676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.274691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.274705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.274735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.284655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.284753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.284784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.284799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.284812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.284842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.294712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.294817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.294842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.294857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.294870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.294900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.304667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.304764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.304790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.304804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.304817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.304847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.314682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.314781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.314809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.314824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.314838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.314870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.324726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.324836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.324862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.324877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.324890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.324920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.334741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.334846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.334872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.334886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.334898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.334928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.344776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.344898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.344924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.344939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.344952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.344982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.048 [2024-11-28 04:34:32.354770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.048 [2024-11-28 04:34:32.354869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.048 [2024-11-28 04:34:32.354894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.048 [2024-11-28 04:34:32.354909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.048 [2024-11-28 04:34:32.354921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.048 [2024-11-28 04:34:32.354951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.048 qpair failed and we were unable to recover it. 00:27:55.307 [2024-11-28 04:34:32.364809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.307 [2024-11-28 04:34:32.364911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.307 [2024-11-28 04:34:32.364937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.307 [2024-11-28 04:34:32.364951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.307 [2024-11-28 04:34:32.364964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.307 [2024-11-28 04:34:32.364993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.307 qpair failed and we were unable to recover it. 00:27:55.307 [2024-11-28 04:34:32.374846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.307 [2024-11-28 04:34:32.374948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.307 [2024-11-28 04:34:32.374979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.307 [2024-11-28 04:34:32.374995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.307 [2024-11-28 04:34:32.375008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.307 [2024-11-28 04:34:32.375038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.307 qpair failed and we were unable to recover it. 00:27:55.307 [2024-11-28 04:34:32.384867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.307 [2024-11-28 04:34:32.384972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.307 [2024-11-28 04:34:32.384998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.307 [2024-11-28 04:34:32.385012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.307 [2024-11-28 04:34:32.385026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.307 [2024-11-28 04:34:32.385068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.307 qpair failed and we were unable to recover it. 00:27:55.307 [2024-11-28 04:34:32.394902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.307 [2024-11-28 04:34:32.394996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.307 [2024-11-28 04:34:32.395024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.307 [2024-11-28 04:34:32.395039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.307 [2024-11-28 04:34:32.395052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.307 [2024-11-28 04:34:32.395093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.307 qpair failed and we were unable to recover it. 00:27:55.307 [2024-11-28 04:34:32.404915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.307 [2024-11-28 04:34:32.405010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.307 [2024-11-28 04:34:32.405036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.405051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.405065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.405095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.414992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.415100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.415129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.415145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.415158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.415197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.424982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.425086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.425112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.425127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.425141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.425171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.435042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.435146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.435170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.435185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.435198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.435227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.445073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.445175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.445204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.445220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.445234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.445264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.455103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.455247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.455273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.455288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.455301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.455331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.465121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.465230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.465261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.465277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.465290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.465320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.475222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.475321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.475348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.475363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.475376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.475407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.485176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.485298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.485324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.485339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.485352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.485381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.495244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.495351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.495376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.495391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.495404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.495435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.505256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.505404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.505431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.505446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.505465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.505507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.515256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.515359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.515385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.515399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.515412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.515443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.525314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.525455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.308 [2024-11-28 04:34:32.525481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.308 [2024-11-28 04:34:32.525496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.308 [2024-11-28 04:34:32.525509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.308 [2024-11-28 04:34:32.525546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.308 qpair failed and we were unable to recover it. 00:27:55.308 [2024-11-28 04:34:32.535321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.308 [2024-11-28 04:34:32.535424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.535449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.535464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.535477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.535508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.545333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.545460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.545486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.545500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.545513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.545551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.555405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.555534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.555561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.555576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.555589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.555619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.565397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.565506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.565539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.565556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.565569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.565600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.575434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.575549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.575575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.575590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.575603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.575635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.585456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.585565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.585592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.585607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.585619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.585650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.595532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.595648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.595674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.595688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.595708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.595740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.605548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.605664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.605689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.605704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.605718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.605748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.309 [2024-11-28 04:34:32.615617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.309 [2024-11-28 04:34:32.615725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.309 [2024-11-28 04:34:32.615751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.309 [2024-11-28 04:34:32.615772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.309 [2024-11-28 04:34:32.615786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.309 [2024-11-28 04:34:32.615815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.309 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-28 04:34:32.625602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.569 [2024-11-28 04:34:32.625719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.569 [2024-11-28 04:34:32.625745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.569 [2024-11-28 04:34:32.625760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.569 [2024-11-28 04:34:32.625773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.569 [2024-11-28 04:34:32.625803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-28 04:34:32.635614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.569 [2024-11-28 04:34:32.635717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.569 [2024-11-28 04:34:32.635743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.569 [2024-11-28 04:34:32.635758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.569 [2024-11-28 04:34:32.635771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.569 [2024-11-28 04:34:32.635801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.569 qpair failed and we were unable to recover it. 00:27:55.569 [2024-11-28 04:34:32.645781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.645899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.645925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.645939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.645952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.645983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.655697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.655803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.655828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.655843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.655856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.655888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.665758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.665906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.665932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.665947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.665961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.665991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.675762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.675858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.675884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.675899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.675913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.675942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.685849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.685946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.685972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.685993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.686007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.686038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.695856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.695978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.696003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.696017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.696031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.696062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.705818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.705920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.705945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.705960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.705973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.706003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.715840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.715943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.715969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.715984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.715997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.716027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.725873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.725978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.726004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.726018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.726031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.726061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.735950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.736054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.736080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.736095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.736108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.736137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.745980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.746085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.746111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.746125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.746138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.746168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.755977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.756120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.756145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.756160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.756173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.756203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.570 qpair failed and we were unable to recover it. 00:27:55.570 [2024-11-28 04:34:32.766075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.570 [2024-11-28 04:34:32.766171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.570 [2024-11-28 04:34:32.766197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.570 [2024-11-28 04:34:32.766212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.570 [2024-11-28 04:34:32.766225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.570 [2024-11-28 04:34:32.766256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.776129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.776232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.776261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.776283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.776297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.571 [2024-11-28 04:34:32.776329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.786124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.786244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.786270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.786286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.786301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.571 [2024-11-28 04:34:32.786331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.796221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.796382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.796432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.796448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.796461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:55.571 [2024-11-28 04:34:32.796505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.806113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.806224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.806255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.806271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.806284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.806315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.816139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.816245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.816273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.816289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.816303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.816333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.826165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.826302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.826330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.826345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.826358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.826388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.836199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.836303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.836329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.836344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.836358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.836386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.846232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.846345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.846372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.846387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.846400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.846429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.856293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.856409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.856435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.856450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.856463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.856492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.866274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.866413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.866444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.866460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.866473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.866502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.571 [2024-11-28 04:34:32.876344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.571 [2024-11-28 04:34:32.876449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.571 [2024-11-28 04:34:32.876477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.571 [2024-11-28 04:34:32.876493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.571 [2024-11-28 04:34:32.876506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.571 [2024-11-28 04:34:32.876549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.571 qpair failed and we were unable to recover it. 00:27:55.830 [2024-11-28 04:34:32.886372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.830 [2024-11-28 04:34:32.886516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.830 [2024-11-28 04:34:32.886551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.830 [2024-11-28 04:34:32.886568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.830 [2024-11-28 04:34:32.886582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.886612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.896417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.896561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.896588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.896603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.896616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.896647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.906433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.906540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.906566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.906586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.906600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.906629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.916542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.916654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.916681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.916695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.916709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.916737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.926555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.926663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.926689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.926703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.926717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.926745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.936500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.936609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.936634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.936649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.936662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.936693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.946519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.946656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.946682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.946696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.946709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.946738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.956583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.956686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.956724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.956743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.956756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.956787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.966679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.966779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.966804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.966819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.966833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.966862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.976676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.976780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.976805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.976820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.976832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.976862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.986666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.986765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.986790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.986805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.986818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.986846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:32.996707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:32.996822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:32.996847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:32.996861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:32.996874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:32.996909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:33.006744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:33.006847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:33.006872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:33.006887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:33.006900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:33.006929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:33.016758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.831 [2024-11-28 04:34:33.016868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.831 [2024-11-28 04:34:33.016893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.831 [2024-11-28 04:34:33.016907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.831 [2024-11-28 04:34:33.016920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.831 [2024-11-28 04:34:33.016949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.831 qpair failed and we were unable to recover it. 00:27:55.831 [2024-11-28 04:34:33.026769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.026867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.026892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.026907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.026919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.026947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.036814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.036937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.036962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.036977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.036990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.037018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.046820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.046918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.046949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.046964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.046977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.047006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.056873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.057002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.057028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.057042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.057055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.057083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.066872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.066974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.067000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.067014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.067027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.067055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.076892] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.076996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.077022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.077036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.077049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.077079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.086958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.087070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.087095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.087109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.087121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.087159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.097009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.097114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.097140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.097154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.097167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.097196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.106994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.107097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.107123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.107137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.107150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.107180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.117042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.117193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.117218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.117233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.117246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.117274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.127070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.127181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.127209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.127223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.127237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.127266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:55.832 [2024-11-28 04:34:33.137095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:55.832 [2024-11-28 04:34:33.137203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:55.832 [2024-11-28 04:34:33.137236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:55.832 [2024-11-28 04:34:33.137253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:55.832 [2024-11-28 04:34:33.137266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:55.832 [2024-11-28 04:34:33.137297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:55.832 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.147106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.147258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.147285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.147301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.147314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.147344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.157160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.157262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.157288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.157303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.157317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.157346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.167194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.167294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.167322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.167337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.167350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.167379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.177256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.177359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.177385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.177400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.177413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.177447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.187256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.187357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.187383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.187398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.187411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.187440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.197259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.197356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.197382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.197397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.197410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.197437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.207305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.207404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.207429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.207444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.207458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.207486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.217388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.217543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.217569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.217584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.217597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.217625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.227358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.227462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.227493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.227508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.227521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.227559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.237381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.237476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.237501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.237515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.237534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.237565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.247416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.247520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.247552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.247566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.247580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.247609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.257440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.257548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.257573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.257588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.257602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.092 [2024-11-28 04:34:33.257631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-28 04:34:33.267473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.092 [2024-11-28 04:34:33.267584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.092 [2024-11-28 04:34:33.267612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.092 [2024-11-28 04:34:33.267627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.092 [2024-11-28 04:34:33.267641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.267675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.277492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.277601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.277627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.277641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.277654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.277683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.287545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.287646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.287671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.287685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.287698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.287727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.297568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.297678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.297705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.297720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.297733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.297762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.307573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.307682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.307708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.307722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.307735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.307764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.317621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.317758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.317788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.317803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.317817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.317845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.327674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.327776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.327801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.327815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.327828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.327857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.337695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.337799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.337824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.337839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.337852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.337880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.347702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.347825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.347850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.347864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.347877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.347905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.357755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.357885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.357910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.357925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.357938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.357972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.367790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.367892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.367918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.367932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.367945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.367973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.377828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.377934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.377959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.377974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.377987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.378015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.387809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.387945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.387970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.387984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.387998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.388025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-28 04:34:33.397876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.093 [2024-11-28 04:34:33.397977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.093 [2024-11-28 04:34:33.398004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.093 [2024-11-28 04:34:33.398019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.093 [2024-11-28 04:34:33.398033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.093 [2024-11-28 04:34:33.398062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.352 [2024-11-28 04:34:33.407870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.352 [2024-11-28 04:34:33.407991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.352 [2024-11-28 04:34:33.408024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.352 [2024-11-28 04:34:33.408040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.352 [2024-11-28 04:34:33.408053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.352 [2024-11-28 04:34:33.408083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.352 qpair failed and we were unable to recover it. 00:27:56.352 [2024-11-28 04:34:33.417915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.352 [2024-11-28 04:34:33.418017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.352 [2024-11-28 04:34:33.418042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.352 [2024-11-28 04:34:33.418057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.352 [2024-11-28 04:34:33.418071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.352 [2024-11-28 04:34:33.418100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.352 qpair failed and we were unable to recover it. 00:27:56.352 [2024-11-28 04:34:33.428041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.352 [2024-11-28 04:34:33.428155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.352 [2024-11-28 04:34:33.428181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.352 [2024-11-28 04:34:33.428196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.352 [2024-11-28 04:34:33.428214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.352 [2024-11-28 04:34:33.428244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.352 qpair failed and we were unable to recover it. 00:27:56.352 [2024-11-28 04:34:33.438063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.352 [2024-11-28 04:34:33.438163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.352 [2024-11-28 04:34:33.438188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.352 [2024-11-28 04:34:33.438202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.352 [2024-11-28 04:34:33.438214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.352 [2024-11-28 04:34:33.438243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.352 qpair failed and we were unable to recover it. 00:27:56.352 [2024-11-28 04:34:33.447994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.352 [2024-11-28 04:34:33.448085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.352 [2024-11-28 04:34:33.448111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.352 [2024-11-28 04:34:33.448125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.352 [2024-11-28 04:34:33.448144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.352 [2024-11-28 04:34:33.448173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.352 qpair failed and we were unable to recover it. 00:27:56.352 [2024-11-28 04:34:33.458105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.352 [2024-11-28 04:34:33.458207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.458232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.458246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.458259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.458288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.468079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.468189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.468214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.468228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.468242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.468270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.478097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.478214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.478240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.478255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.478268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.478297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.488178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.488278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.488303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.488318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.488331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.488359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.498142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.498266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.498296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.498312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.498326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.498354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.508165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.508268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.508293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.508308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.508321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.508350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.518225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.518340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.518365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.518379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.518392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.518421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.528225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.528324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.528349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.528363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.528376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.528404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.538267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.538412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.538437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.538451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.538470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.538499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.548400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.548521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.548554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.548568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.548581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.548610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.558378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.558481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.558507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.558521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.558543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.558572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.568400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.568507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.568539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.568556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.568569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.568597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.578396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.578514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.578552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.578568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.578582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.578611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.353 qpair failed and we were unable to recover it. 00:27:56.353 [2024-11-28 04:34:33.588487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.353 [2024-11-28 04:34:33.588608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.353 [2024-11-28 04:34:33.588635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.353 [2024-11-28 04:34:33.588650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.353 [2024-11-28 04:34:33.588663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.353 [2024-11-28 04:34:33.588691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.354 [2024-11-28 04:34:33.598504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.354 [2024-11-28 04:34:33.598642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.354 [2024-11-28 04:34:33.598668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.354 [2024-11-28 04:34:33.598682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.354 [2024-11-28 04:34:33.598695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.354 [2024-11-28 04:34:33.598724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.354 [2024-11-28 04:34:33.608499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.354 [2024-11-28 04:34:33.608608] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.354 [2024-11-28 04:34:33.608636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.354 [2024-11-28 04:34:33.608651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.354 [2024-11-28 04:34:33.608664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.354 [2024-11-28 04:34:33.608693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.354 [2024-11-28 04:34:33.618565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.354 [2024-11-28 04:34:33.618672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.354 [2024-11-28 04:34:33.618698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.354 [2024-11-28 04:34:33.618712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.354 [2024-11-28 04:34:33.618725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.354 [2024-11-28 04:34:33.618754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.354 [2024-11-28 04:34:33.628622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.354 [2024-11-28 04:34:33.628748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.354 [2024-11-28 04:34:33.628773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.354 [2024-11-28 04:34:33.628787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.354 [2024-11-28 04:34:33.628806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.354 [2024-11-28 04:34:33.628835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.354 [2024-11-28 04:34:33.638558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.354 [2024-11-28 04:34:33.638656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.354 [2024-11-28 04:34:33.638682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.354 [2024-11-28 04:34:33.638696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.354 [2024-11-28 04:34:33.638709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.354 [2024-11-28 04:34:33.638739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.354 [2024-11-28 04:34:33.648577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.354 [2024-11-28 04:34:33.648702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.354 [2024-11-28 04:34:33.648727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.354 [2024-11-28 04:34:33.648741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.354 [2024-11-28 04:34:33.648754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.354 [2024-11-28 04:34:33.648783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.354 [2024-11-28 04:34:33.658666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.354 [2024-11-28 04:34:33.658812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.354 [2024-11-28 04:34:33.658840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.354 [2024-11-28 04:34:33.658855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.354 [2024-11-28 04:34:33.658868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.354 [2024-11-28 04:34:33.658897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.354 qpair failed and we were unable to recover it. 00:27:56.613 [2024-11-28 04:34:33.668667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.613 [2024-11-28 04:34:33.668770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.613 [2024-11-28 04:34:33.668798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.613 [2024-11-28 04:34:33.668814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.613 [2024-11-28 04:34:33.668827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.613 [2024-11-28 04:34:33.668857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.613 qpair failed and we were unable to recover it. 00:27:56.613 [2024-11-28 04:34:33.678677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.613 [2024-11-28 04:34:33.678806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.613 [2024-11-28 04:34:33.678832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.613 [2024-11-28 04:34:33.678848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.613 [2024-11-28 04:34:33.678861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.613 [2024-11-28 04:34:33.678891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.613 qpair failed and we were unable to recover it. 00:27:56.613 [2024-11-28 04:34:33.688689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.613 [2024-11-28 04:34:33.688791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.613 [2024-11-28 04:34:33.688817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.613 [2024-11-28 04:34:33.688831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.613 [2024-11-28 04:34:33.688844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.613 [2024-11-28 04:34:33.688873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.613 qpair failed and we were unable to recover it. 00:27:56.613 [2024-11-28 04:34:33.698750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.613 [2024-11-28 04:34:33.698858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.613 [2024-11-28 04:34:33.698887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.613 [2024-11-28 04:34:33.698903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.613 [2024-11-28 04:34:33.698916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.613 [2024-11-28 04:34:33.698946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.613 qpair failed and we were unable to recover it. 00:27:56.613 [2024-11-28 04:34:33.708780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.613 [2024-11-28 04:34:33.708913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.613 [2024-11-28 04:34:33.708940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.613 [2024-11-28 04:34:33.708955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.613 [2024-11-28 04:34:33.708968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.613 [2024-11-28 04:34:33.708997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.613 qpair failed and we were unable to recover it. 00:27:56.613 [2024-11-28 04:34:33.718803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.613 [2024-11-28 04:34:33.718936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.613 [2024-11-28 04:34:33.718962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.613 [2024-11-28 04:34:33.718976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.613 [2024-11-28 04:34:33.718995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.613 [2024-11-28 04:34:33.719024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.613 qpair failed and we were unable to recover it. 00:27:56.613 [2024-11-28 04:34:33.728860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.729005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.729030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.729044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.729058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.729086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.738859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.738974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.739000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.739014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.739027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.739055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.748857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.748957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.748983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.748997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.749010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.749038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.758904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.758998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.759024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.759038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.759051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.759080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.768943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.769053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.769078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.769093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.769105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.769135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.778967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.779072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.779098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.779112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.779125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.779153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.788999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.789104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.789129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.789143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.789156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.789184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.799040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.799169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.799194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.799208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.799221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.799249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.809029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.809129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.809154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.809168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.809187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.809217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.819075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.819178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.819203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.819217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.819230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.819258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.829121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.829235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.829260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.829275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.829288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.829316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.839233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.839327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.839352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.839366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.839379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.839408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.849175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.849273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.849298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.849312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.614 [2024-11-28 04:34:33.849325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.614 [2024-11-28 04:34:33.849354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.614 qpair failed and we were unable to recover it. 00:27:56.614 [2024-11-28 04:34:33.859191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.614 [2024-11-28 04:34:33.859297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.614 [2024-11-28 04:34:33.859322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.614 [2024-11-28 04:34:33.859336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.615 [2024-11-28 04:34:33.859350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.615 [2024-11-28 04:34:33.859378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.615 qpair failed and we were unable to recover it. 00:27:56.615 [2024-11-28 04:34:33.869232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.615 [2024-11-28 04:34:33.869334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.615 [2024-11-28 04:34:33.869360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.615 [2024-11-28 04:34:33.869374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.615 [2024-11-28 04:34:33.869387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.615 [2024-11-28 04:34:33.869415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.615 qpair failed and we were unable to recover it. 00:27:56.615 [2024-11-28 04:34:33.879251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.615 [2024-11-28 04:34:33.879359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.615 [2024-11-28 04:34:33.879385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.615 [2024-11-28 04:34:33.879399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.615 [2024-11-28 04:34:33.879412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.615 [2024-11-28 04:34:33.879441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.615 qpair failed and we were unable to recover it. 00:27:56.615 [2024-11-28 04:34:33.889284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.615 [2024-11-28 04:34:33.889411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.615 [2024-11-28 04:34:33.889437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.615 [2024-11-28 04:34:33.889451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.615 [2024-11-28 04:34:33.889464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.615 [2024-11-28 04:34:33.889493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.615 qpair failed and we were unable to recover it. 00:27:56.615 [2024-11-28 04:34:33.899339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.615 [2024-11-28 04:34:33.899448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.615 [2024-11-28 04:34:33.899475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.615 [2024-11-28 04:34:33.899497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.615 [2024-11-28 04:34:33.899510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.615 [2024-11-28 04:34:33.899550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.615 qpair failed and we were unable to recover it. 00:27:56.615 [2024-11-28 04:34:33.909372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.615 [2024-11-28 04:34:33.909471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.615 [2024-11-28 04:34:33.909496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.615 [2024-11-28 04:34:33.909510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.615 [2024-11-28 04:34:33.909530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.615 [2024-11-28 04:34:33.909563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.615 qpair failed and we were unable to recover it. 00:27:56.615 [2024-11-28 04:34:33.919361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.615 [2024-11-28 04:34:33.919463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.615 [2024-11-28 04:34:33.919490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.615 [2024-11-28 04:34:33.919505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.615 [2024-11-28 04:34:33.919519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.615 [2024-11-28 04:34:33.919560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.615 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.929471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.929610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.929639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.929654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.929667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.874 [2024-11-28 04:34:33.929697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.939467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.939585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.939610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.939625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.939638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:56.874 [2024-11-28 04:34:33.939668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.939721] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:56.874 A controller has encountered a failure and is being reset. 00:27:56.874 [2024-11-28 04:34:33.949457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.949560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.949593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.949610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.949624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.874 [2024-11-28 04:34:33.949659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.959568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.959671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.959700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.959715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.959729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.874 [2024-11-28 04:34:33.959759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.969563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.969686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.969713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.969729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.969743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.874 [2024-11-28 04:34:33.969776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.979560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.979674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.979701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.979716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.979729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.874 [2024-11-28 04:34:33.979759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.989566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.989688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.989720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.989736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.989750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.874 [2024-11-28 04:34:33.989779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:33.999616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.874 [2024-11-28 04:34:33.999722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.874 [2024-11-28 04:34:33.999748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.874 [2024-11-28 04:34:33.999763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.874 [2024-11-28 04:34:33.999776] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.874 [2024-11-28 04:34:33.999815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.874 qpair failed and we were unable to recover it. 00:27:56.874 [2024-11-28 04:34:34.009650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.009745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.009772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.009787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.009802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.009831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.019670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.019770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.019797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.019812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.019826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.019855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.029691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.029844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.029870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.029885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.029899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.029935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.039720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.039820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.039847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.039862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.039875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.039907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.049775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.049879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.049906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.049921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.049935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.049979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.059786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.059901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.059927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.059942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.059956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.059986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.069814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.069917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.069944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.069959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.069972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.070002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.079838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.079935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.079970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.079987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.080001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.080032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.089887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.090032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.090059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.090075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.090088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.090131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.099897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.099998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.100024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.100039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.100052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.100081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.109953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.110072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.110098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.110113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.110126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.110157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.119995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.120106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.120132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.120147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.120166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.120209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.129967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.130070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.875 [2024-11-28 04:34:34.130096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.875 [2024-11-28 04:34:34.130111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.875 [2024-11-28 04:34:34.130124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.875 [2024-11-28 04:34:34.130153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.875 qpair failed and we were unable to recover it. 00:27:56.875 [2024-11-28 04:34:34.140019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.875 [2024-11-28 04:34:34.140143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.876 [2024-11-28 04:34:34.140170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.876 [2024-11-28 04:34:34.140185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.876 [2024-11-28 04:34:34.140198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.876 [2024-11-28 04:34:34.140228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.876 qpair failed and we were unable to recover it. 00:27:56.876 [2024-11-28 04:34:34.150092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.876 [2024-11-28 04:34:34.150197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.876 [2024-11-28 04:34:34.150223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.876 [2024-11-28 04:34:34.150238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.876 [2024-11-28 04:34:34.150252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.876 [2024-11-28 04:34:34.150281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.876 qpair failed and we were unable to recover it. 00:27:56.876 [2024-11-28 04:34:34.160063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.876 [2024-11-28 04:34:34.160165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.876 [2024-11-28 04:34:34.160191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.876 [2024-11-28 04:34:34.160205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.876 [2024-11-28 04:34:34.160219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.876 [2024-11-28 04:34:34.160249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.876 qpair failed and we were unable to recover it. 00:27:56.876 [2024-11-28 04:34:34.170144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.876 [2024-11-28 04:34:34.170257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.876 [2024-11-28 04:34:34.170283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.876 [2024-11-28 04:34:34.170297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.876 [2024-11-28 04:34:34.170311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.876 [2024-11-28 04:34:34.170341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.876 qpair failed and we were unable to recover it. 00:27:56.876 [2024-11-28 04:34:34.180133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:56.876 [2024-11-28 04:34:34.180274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:56.876 [2024-11-28 04:34:34.180303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:56.876 [2024-11-28 04:34:34.180319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:56.876 [2024-11-28 04:34:34.180332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:56.876 [2024-11-28 04:34:34.180362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:56.876 qpair failed and we were unable to recover it. 00:27:57.135 [2024-11-28 04:34:34.190161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.135 [2024-11-28 04:34:34.190266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.135 [2024-11-28 04:34:34.190292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.135 [2024-11-28 04:34:34.190307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.135 [2024-11-28 04:34:34.190321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.135 [2024-11-28 04:34:34.190351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.135 qpair failed and we were unable to recover it. 00:27:57.135 [2024-11-28 04:34:34.200208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.135 [2024-11-28 04:34:34.200321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.135 [2024-11-28 04:34:34.200348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.135 [2024-11-28 04:34:34.200363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.200376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.200417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.210212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.210313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.210339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.210354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.210373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.210403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.220272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.220380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.220409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.220425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.220439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.220479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.230291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.230402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.230428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.230443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.230457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.230486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.240408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.240545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.240571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.240586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.240599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.240629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.250319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.250421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.250448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.250463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.250476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.250506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.260348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.260452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.260478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.260493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.260506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.260542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.270386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.270512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.270554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.270570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.270584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.270626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.280488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.280612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.280638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.280653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.280667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.280697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.290452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.290574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.290601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.290616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.290629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.290671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.300479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.300599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.300625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.300649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.300664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.300694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.310506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.310618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.310645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.310659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.310672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.310701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.320594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.320702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.320729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.320744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.320757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.320786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.136 [2024-11-28 04:34:34.330669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.136 [2024-11-28 04:34:34.330797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.136 [2024-11-28 04:34:34.330823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.136 [2024-11-28 04:34:34.330838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.136 [2024-11-28 04:34:34.330851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.136 [2024-11-28 04:34:34.330880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.136 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.340623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.340726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.340752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.340766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.340779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.340809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.350639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.350755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.350781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.350795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.350809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.350839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.360733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.360829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.360865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.360880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.360893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.360923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.370681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.370784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.370810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.370827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.370840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.370870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.380739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.380850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.380876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.380891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.380904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.380933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.390741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.390841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.390872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.390888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.390901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.390930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.400844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.400953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.400979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.400993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.401007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.401036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.410853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.410947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.410972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.410987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.411000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.411030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.420854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.420958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.420984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.420999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.421011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.421041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.430887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.430988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.431014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.431028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.431042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.431071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.137 [2024-11-28 04:34:34.440888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.137 [2024-11-28 04:34:34.440993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.137 [2024-11-28 04:34:34.441018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.137 [2024-11-28 04:34:34.441032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.137 [2024-11-28 04:34:34.441045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.137 [2024-11-28 04:34:34.441073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.137 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.450958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.451059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.451086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.451101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.451115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.451156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.460954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.461110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.461136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.461151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.461164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.461196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.471004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.471107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.471133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.471148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.471161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.471191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.481102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.481207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.481239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.481254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.481268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.481298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.491098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.491198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.491227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.491243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.491256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.491285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.501135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.501242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.501268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.501284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.501298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.501329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.511106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.511231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.511257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.511272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.511285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.511316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.521123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.521224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.521250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.521265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.521279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.521315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.531191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.531337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.531363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.531378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.531392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.531422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.541222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.541343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.541369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.541384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.541397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.541426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.397 qpair failed and we were unable to recover it. 00:27:57.397 [2024-11-28 04:34:34.551311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.397 [2024-11-28 04:34:34.551456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.397 [2024-11-28 04:34:34.551481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.397 [2024-11-28 04:34:34.551496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.397 [2024-11-28 04:34:34.551509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.397 [2024-11-28 04:34:34.551546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.561255] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.561356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.561381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.561396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.561410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.561441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.571282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.571382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.571413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.571428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.571442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.571471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.581347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.581460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.581486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.581500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.581513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.581550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.591330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.591433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.591459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.591474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.591487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.591517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.601359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.601461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.601486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.601501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.601514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.601553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.611411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.611506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.611541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.611560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.611579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.611622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.621438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.621553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.621580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.621595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.621607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.621638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.631455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.631558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.631584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.631598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.631612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.631641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.641600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.641730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.641756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.641770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.641783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.641813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.651518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.651620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.651645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.651660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.651673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.651703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.661586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.661742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.661768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.661783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.661796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.661825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.671679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.671780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.671805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.671819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.671833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.671862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.681612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.681756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.398 [2024-11-28 04:34:34.681785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.398 [2024-11-28 04:34:34.681800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.398 [2024-11-28 04:34:34.681813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.398 [2024-11-28 04:34:34.681842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.398 qpair failed and we were unable to recover it. 00:27:57.398 [2024-11-28 04:34:34.691650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.398 [2024-11-28 04:34:34.691751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.399 [2024-11-28 04:34:34.691777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.399 [2024-11-28 04:34:34.691791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.399 [2024-11-28 04:34:34.691805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.399 [2024-11-28 04:34:34.691835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.399 qpair failed and we were unable to recover it. 00:27:57.399 [2024-11-28 04:34:34.701685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.399 [2024-11-28 04:34:34.701814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.399 [2024-11-28 04:34:34.701840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.399 [2024-11-28 04:34:34.701855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.399 [2024-11-28 04:34:34.701874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.399 [2024-11-28 04:34:34.701906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.399 qpair failed and we were unable to recover it. 00:27:57.658 [2024-11-28 04:34:34.711715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.658 [2024-11-28 04:34:34.711817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.658 [2024-11-28 04:34:34.711844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.658 [2024-11-28 04:34:34.711858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.658 [2024-11-28 04:34:34.711872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.658 [2024-11-28 04:34:34.711901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.658 qpair failed and we were unable to recover it. 00:27:57.658 [2024-11-28 04:34:34.721755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.658 [2024-11-28 04:34:34.721854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.658 [2024-11-28 04:34:34.721880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.658 [2024-11-28 04:34:34.721895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.658 [2024-11-28 04:34:34.721908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.658 [2024-11-28 04:34:34.721937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.658 qpair failed and we were unable to recover it. 00:27:57.658 [2024-11-28 04:34:34.731800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.731899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.731925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.731940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.731953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.731982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.741884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.742029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.742054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.742069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.742083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.742112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.751804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.751908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.751934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.751948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.751961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.751992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.761866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.761962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.761988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.762003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.762016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.762045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.771881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.771982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.772008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.772023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.772036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.772065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.781929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.782035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.782061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.782075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.782089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.782118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.791937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.792038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.792064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.792086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.792100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.792130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.801957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.802055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.802081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.802096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.802110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.802151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.811972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.812100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.812126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.812141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.812154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.812184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.822026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.822135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.822161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.822176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.822190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.822219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.832114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.832224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.832251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.832265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.832279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.832308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.842092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.842193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.842219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.842234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.842247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.842276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.852105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.852202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.659 [2024-11-28 04:34:34.852228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.659 [2024-11-28 04:34:34.852242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.659 [2024-11-28 04:34:34.852256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.659 [2024-11-28 04:34:34.852286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.659 qpair failed and we were unable to recover it. 00:27:57.659 [2024-11-28 04:34:34.862133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.659 [2024-11-28 04:34:34.862238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.862263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.862278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.862291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.862320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.872180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.872287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.872312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.872327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.872340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.872370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.882210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.882341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.882367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.882388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.882403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.882432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.892250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.892358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.892385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.892403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.892418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.892449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.902246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.902350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.902377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.902392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.902405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.902434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.912294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.912419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.912446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.912461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.912474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.912503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.922319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.922420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.922447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.922466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.922479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.922508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.932350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.932455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.932481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.932496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.932509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.932546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.942444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.942552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.942578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.942593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.942605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.942636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.952376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.952478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.952504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.952519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.952540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.952571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.660 [2024-11-28 04:34:34.962407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.660 [2024-11-28 04:34:34.962509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.660 [2024-11-28 04:34:34.962543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.660 [2024-11-28 04:34:34.962559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.660 [2024-11-28 04:34:34.962572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.660 [2024-11-28 04:34:34.962601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.660 qpair failed and we were unable to recover it. 00:27:57.920 [2024-11-28 04:34:34.972425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.920 [2024-11-28 04:34:34.972534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.920 [2024-11-28 04:34:34.972565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.920 [2024-11-28 04:34:34.972581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.920 [2024-11-28 04:34:34.972594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.920 [2024-11-28 04:34:34.972623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.920 qpair failed and we were unable to recover it. 00:27:57.920 [2024-11-28 04:34:34.982466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.920 [2024-11-28 04:34:34.982570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.920 [2024-11-28 04:34:34.982596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.920 [2024-11-28 04:34:34.982611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.920 [2024-11-28 04:34:34.982626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.920 [2024-11-28 04:34:34.982656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.920 qpair failed and we were unable to recover it. 00:27:57.920 [2024-11-28 04:34:34.992495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.920 [2024-11-28 04:34:34.992606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.920 [2024-11-28 04:34:34.992632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.920 [2024-11-28 04:34:34.992647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.920 [2024-11-28 04:34:34.992661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.920 [2024-11-28 04:34:34.992691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.920 qpair failed and we were unable to recover it. 00:27:57.920 [2024-11-28 04:34:35.002549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.920 [2024-11-28 04:34:35.002684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.920 [2024-11-28 04:34:35.002710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.920 [2024-11-28 04:34:35.002725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.920 [2024-11-28 04:34:35.002738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.920 [2024-11-28 04:34:35.002768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.920 qpair failed and we were unable to recover it. 00:27:57.920 [2024-11-28 04:34:35.012671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.920 [2024-11-28 04:34:35.012812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.920 [2024-11-28 04:34:35.012839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.920 [2024-11-28 04:34:35.012853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.920 [2024-11-28 04:34:35.012866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.920 [2024-11-28 04:34:35.012904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.920 qpair failed and we were unable to recover it. 00:27:57.920 [2024-11-28 04:34:35.022609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.920 [2024-11-28 04:34:35.022766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.920 [2024-11-28 04:34:35.022793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.920 [2024-11-28 04:34:35.022808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.022825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.022859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.032703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.032808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.032835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.032850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.032864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.032894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.042668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.042795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.042821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.042836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.042850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.042882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.052674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.052771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.052797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.052812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.052826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.052855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.062809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.062910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.062941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.062957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.062971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.063000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.072834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.072970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.072996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.073011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.073025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.073055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.082758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.082860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.082886] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.082901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.082915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.082946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.092807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.092906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.092932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.092948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.092961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.092992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.102862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.103018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.103044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.103059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.103073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.103120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.112838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.112938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.112964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.112979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.112993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.113024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.122900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.123002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.123029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.123052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.123065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.123094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.132933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.133037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.133062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.133077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.133090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.133119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.142949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.143050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.143076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.143090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.143104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.143133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.921 [2024-11-28 04:34:35.153011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.921 [2024-11-28 04:34:35.153124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.921 [2024-11-28 04:34:35.153150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.921 [2024-11-28 04:34:35.153165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.921 [2024-11-28 04:34:35.153178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.921 [2024-11-28 04:34:35.153207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.921 qpair failed and we were unable to recover it. 00:27:57.922 [2024-11-28 04:34:35.163022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.922 [2024-11-28 04:34:35.163125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.922 [2024-11-28 04:34:35.163151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.922 [2024-11-28 04:34:35.163165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.922 [2024-11-28 04:34:35.163179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.922 [2024-11-28 04:34:35.163210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.922 qpair failed and we were unable to recover it. 00:27:57.922 [2024-11-28 04:34:35.173025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.922 [2024-11-28 04:34:35.173118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.922 [2024-11-28 04:34:35.173144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.922 [2024-11-28 04:34:35.173159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.922 [2024-11-28 04:34:35.173172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.922 [2024-11-28 04:34:35.173214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.922 qpair failed and we were unable to recover it. 00:27:57.922 [2024-11-28 04:34:35.183051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.922 [2024-11-28 04:34:35.183156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.922 [2024-11-28 04:34:35.183182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.922 [2024-11-28 04:34:35.183197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.922 [2024-11-28 04:34:35.183210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.922 [2024-11-28 04:34:35.183241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.922 qpair failed and we were unable to recover it. 00:27:57.922 [2024-11-28 04:34:35.193098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.922 [2024-11-28 04:34:35.193195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.922 [2024-11-28 04:34:35.193220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.922 [2024-11-28 04:34:35.193235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.922 [2024-11-28 04:34:35.193254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.922 [2024-11-28 04:34:35.193286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.922 qpair failed and we were unable to recover it. 00:27:57.922 [2024-11-28 04:34:35.203150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.922 [2024-11-28 04:34:35.203264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.922 [2024-11-28 04:34:35.203289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.922 [2024-11-28 04:34:35.203304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.922 [2024-11-28 04:34:35.203318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.922 [2024-11-28 04:34:35.203348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.922 qpair failed and we were unable to recover it. 00:27:57.922 [2024-11-28 04:34:35.213228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.922 [2024-11-28 04:34:35.213326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.922 [2024-11-28 04:34:35.213352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.922 [2024-11-28 04:34:35.213367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.922 [2024-11-28 04:34:35.213380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.922 [2024-11-28 04:34:35.213409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.922 qpair failed and we were unable to recover it. 00:27:57.922 [2024-11-28 04:34:35.223231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:57.922 [2024-11-28 04:34:35.223351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:57.922 [2024-11-28 04:34:35.223376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:57.922 [2024-11-28 04:34:35.223391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:57.922 [2024-11-28 04:34:35.223405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:57.922 [2024-11-28 04:34:35.223437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:57.922 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.233224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.233328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.233354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.233368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.233382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.233411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.243345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.243447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.243472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.243487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.243500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.243537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.253267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.253365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.253390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.253405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.253418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.253449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.263301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.263405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.263431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.263446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.263459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.263488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.273445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.273551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.273577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.273592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.273605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.273634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.283381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.283540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.283566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.283588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.283602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.283632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.293437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.293573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.293599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.293614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.293628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.293657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.303420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.181 [2024-11-28 04:34:35.303533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.181 [2024-11-28 04:34:35.303559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.181 [2024-11-28 04:34:35.303574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.181 [2024-11-28 04:34:35.303589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.181 [2024-11-28 04:34:35.303618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.181 qpair failed and we were unable to recover it. 00:27:58.181 [2024-11-28 04:34:35.313540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.313645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.313671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.313685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.313699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.313729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.323516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.323630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.323655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.323670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.323683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.323712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.333509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.333622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.333648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.333663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.333676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.333705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.343575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.343692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.343718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.343733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.343746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.343775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.353669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.353772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.353809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.353823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.353836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.353866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.363736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.363855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.363881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.363896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.363909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.363938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.373638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.373767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.373793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.373813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.373828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.373857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.383678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.383782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.383808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.383822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.383836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.383865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.393773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.393880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.393906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.393920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.393933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.393963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.403771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.403870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.403896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.182 [2024-11-28 04:34:35.403911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.182 [2024-11-28 04:34:35.403924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.182 [2024-11-28 04:34:35.403953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.182 qpair failed and we were unable to recover it. 00:27:58.182 [2024-11-28 04:34:35.413752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.182 [2024-11-28 04:34:35.413846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.182 [2024-11-28 04:34:35.413871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.413886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.413900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.413929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-28 04:34:35.423819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.183 [2024-11-28 04:34:35.423939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.183 [2024-11-28 04:34:35.423965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.423980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.423993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.424022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-28 04:34:35.433804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.183 [2024-11-28 04:34:35.433961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.183 [2024-11-28 04:34:35.433986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.434000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.434014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.434045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-28 04:34:35.443829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.183 [2024-11-28 04:34:35.443927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.183 [2024-11-28 04:34:35.443951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.443965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.443978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.444019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-28 04:34:35.453861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.183 [2024-11-28 04:34:35.453967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.183 [2024-11-28 04:34:35.453993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.454008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.454021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.454050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-28 04:34:35.463906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.183 [2024-11-28 04:34:35.464018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.183 [2024-11-28 04:34:35.464051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.464067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.464080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.464109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-28 04:34:35.473969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.183 [2024-11-28 04:34:35.474117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.183 [2024-11-28 04:34:35.474143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.474159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.474172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.474202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.183 [2024-11-28 04:34:35.483948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.183 [2024-11-28 04:34:35.484046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.183 [2024-11-28 04:34:35.484073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.183 [2024-11-28 04:34:35.484087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.183 [2024-11-28 04:34:35.484100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.183 [2024-11-28 04:34:35.484141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.183 qpair failed and we were unable to recover it. 00:27:58.442 [2024-11-28 04:34:35.494000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.494099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.494125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.494141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.494154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.494183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.504144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.504272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.504297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.504312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.504325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.504361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.514079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.514191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.514221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.514237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.514251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.514281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.524105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.524219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.524245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.524260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.524273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.524302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.534095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.534241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.534267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.534281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.534295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.534324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.544137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.544241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.544266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.544281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.544295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.544324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.554213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.554344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.554376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.554392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.554405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.554434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.564194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.564295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.564321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.564336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.564349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.564381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.574211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.574308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.574334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.574348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.574362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.574392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.584269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.443 [2024-11-28 04:34:35.584374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.443 [2024-11-28 04:34:35.584399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.443 [2024-11-28 04:34:35.584414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.443 [2024-11-28 04:34:35.584428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.443 [2024-11-28 04:34:35.584457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.443 qpair failed and we were unable to recover it. 00:27:58.443 [2024-11-28 04:34:35.594305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.594461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.594487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.594503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.594515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.594559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.604311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.604421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.604448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.604463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.604476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.604505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.614414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.614517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.614549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.614565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.614578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.614608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.624411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.624535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.624561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.624577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.624590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.624619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.634403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.634543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.634578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.634594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.634607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.634638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.644404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.644536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.644568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.644583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.644597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.644627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.654532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.654635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.654662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.654676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.654689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.654718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.664471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.664582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.664608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.664623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.664636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.664665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.674556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.674665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.674691] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.674705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.674719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.674748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.684511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.684632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.684658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.444 [2024-11-28 04:34:35.684673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.444 [2024-11-28 04:34:35.684692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.444 [2024-11-28 04:34:35.684723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.444 qpair failed and we were unable to recover it. 00:27:58.444 [2024-11-28 04:34:35.694550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.444 [2024-11-28 04:34:35.694648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.444 [2024-11-28 04:34:35.694674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.445 [2024-11-28 04:34:35.694688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.445 [2024-11-28 04:34:35.694702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.445 [2024-11-28 04:34:35.694732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.445 qpair failed and we were unable to recover it. 00:27:58.445 [2024-11-28 04:34:35.704631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.445 [2024-11-28 04:34:35.704736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.445 [2024-11-28 04:34:35.704762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.445 [2024-11-28 04:34:35.704777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.445 [2024-11-28 04:34:35.704790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.445 [2024-11-28 04:34:35.704818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.445 qpair failed and we were unable to recover it. 00:27:58.445 [2024-11-28 04:34:35.714663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.445 [2024-11-28 04:34:35.714776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.445 [2024-11-28 04:34:35.714804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.445 [2024-11-28 04:34:35.714819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.445 [2024-11-28 04:34:35.714833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.445 [2024-11-28 04:34:35.714865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.445 qpair failed and we were unable to recover it. 00:27:58.445 [2024-11-28 04:34:35.724650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.445 [2024-11-28 04:34:35.724786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.445 [2024-11-28 04:34:35.724812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.445 [2024-11-28 04:34:35.724827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.445 [2024-11-28 04:34:35.724840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.445 [2024-11-28 04:34:35.724870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.445 qpair failed and we were unable to recover it. 00:27:58.445 [2024-11-28 04:34:35.734723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.445 [2024-11-28 04:34:35.734843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.445 [2024-11-28 04:34:35.734870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.445 [2024-11-28 04:34:35.734885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.445 [2024-11-28 04:34:35.734898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.445 [2024-11-28 04:34:35.734927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.445 qpair failed and we were unable to recover it. 00:27:58.445 [2024-11-28 04:34:35.744711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.445 [2024-11-28 04:34:35.744812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.445 [2024-11-28 04:34:35.744837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.445 [2024-11-28 04:34:35.744852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.445 [2024-11-28 04:34:35.744865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.445 [2024-11-28 04:34:35.744896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.445 qpair failed and we were unable to recover it. 00:27:58.704 [2024-11-28 04:34:35.754744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.754862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.754887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.754902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.754915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.754959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.764784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.764926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.764951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.764966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.764979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.765008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.774796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.774898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.774924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.774938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.774958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.774989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.784849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.784959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.784984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.784999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.785013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.785043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.794826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.794968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.794993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.795008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.795022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.795051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.804861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.804957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.804982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.804998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.805011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.805040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.814897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.814997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.815022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.815037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.815050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.815079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.824916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.825020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.825046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.825061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.825074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.825105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.834952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.835051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.835076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.835090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.835104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.835132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.845000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.705 [2024-11-28 04:34:35.845109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.705 [2024-11-28 04:34:35.845134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.705 [2024-11-28 04:34:35.845149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.705 [2024-11-28 04:34:35.845162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.705 [2024-11-28 04:34:35.845191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.705 qpair failed and we were unable to recover it. 00:27:58.705 [2024-11-28 04:34:35.855071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.855209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.855235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.855249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.855262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.855291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.865133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.865270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.865296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.865317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.865333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.865363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.875056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.875157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.875183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.875197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.875211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.875240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.885103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.885202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.885228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.885242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.885255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.885285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.895107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.895203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.895229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.895243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.895257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.895286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.905250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.905354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.905380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.905395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.905408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.905436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.915192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.915290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.915316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.915331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.915343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.915373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.925224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.925320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.925346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.925361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.925375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.925404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.935374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.935520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.935553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.935569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.935582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.935612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.945285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.945392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.706 [2024-11-28 04:34:35.945418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.706 [2024-11-28 04:34:35.945433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.706 [2024-11-28 04:34:35.945446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.706 [2024-11-28 04:34:35.945475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.706 qpair failed and we were unable to recover it. 00:27:58.706 [2024-11-28 04:34:35.955321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.706 [2024-11-28 04:34:35.955462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.707 [2024-11-28 04:34:35.955494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.707 [2024-11-28 04:34:35.955510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.707 [2024-11-28 04:34:35.955531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.707 [2024-11-28 04:34:35.955577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-28 04:34:35.965363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.707 [2024-11-28 04:34:35.965470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.707 [2024-11-28 04:34:35.965495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.707 [2024-11-28 04:34:35.965510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.707 [2024-11-28 04:34:35.965532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.707 [2024-11-28 04:34:35.965564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-28 04:34:35.975396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.707 [2024-11-28 04:34:35.975499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.707 [2024-11-28 04:34:35.975539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.707 [2024-11-28 04:34:35.975556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.707 [2024-11-28 04:34:35.975570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.707 [2024-11-28 04:34:35.975599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-28 04:34:35.985403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.707 [2024-11-28 04:34:35.985505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.707 [2024-11-28 04:34:35.985542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.707 [2024-11-28 04:34:35.985559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.707 [2024-11-28 04:34:35.985573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.707 [2024-11-28 04:34:35.985603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-28 04:34:35.995462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.707 [2024-11-28 04:34:35.995574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.707 [2024-11-28 04:34:35.995600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.707 [2024-11-28 04:34:35.995614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.707 [2024-11-28 04:34:35.995627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.707 [2024-11-28 04:34:35.995657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.707 [2024-11-28 04:34:36.005475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.707 [2024-11-28 04:34:36.005595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.707 [2024-11-28 04:34:36.005621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.707 [2024-11-28 04:34:36.005636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.707 [2024-11-28 04:34:36.005649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.707 [2024-11-28 04:34:36.005680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.707 qpair failed and we were unable to recover it. 00:27:58.966 [2024-11-28 04:34:36.015551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.966 [2024-11-28 04:34:36.015655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.966 [2024-11-28 04:34:36.015682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.966 [2024-11-28 04:34:36.015696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.966 [2024-11-28 04:34:36.015709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.966 [2024-11-28 04:34:36.015738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.966 qpair failed and we were unable to recover it. 00:27:58.966 [2024-11-28 04:34:36.025565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.966 [2024-11-28 04:34:36.025684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.966 [2024-11-28 04:34:36.025712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.966 [2024-11-28 04:34:36.025728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.966 [2024-11-28 04:34:36.025741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.966 [2024-11-28 04:34:36.025772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.966 qpair failed and we were unable to recover it. 00:27:58.966 [2024-11-28 04:34:36.035600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.966 [2024-11-28 04:34:36.035704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.966 [2024-11-28 04:34:36.035733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.966 [2024-11-28 04:34:36.035748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.966 [2024-11-28 04:34:36.035761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.966 [2024-11-28 04:34:36.035802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.966 qpair failed and we were unable to recover it. 00:27:58.966 [2024-11-28 04:34:36.045590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.966 [2024-11-28 04:34:36.045714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.966 [2024-11-28 04:34:36.045746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.966 [2024-11-28 04:34:36.045761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.966 [2024-11-28 04:34:36.045775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.966 [2024-11-28 04:34:36.045805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.966 qpair failed and we were unable to recover it. 00:27:58.966 [2024-11-28 04:34:36.055642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.966 [2024-11-28 04:34:36.055753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.966 [2024-11-28 04:34:36.055780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.055795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.055809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.055838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.065656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.065802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.065828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.065843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.065856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.065885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.075673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.075776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.075802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.075817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.075831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.075861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.085701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.085848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.085874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.085889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.085903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.085938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.095736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.095835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.095862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.095877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.095890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.095931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.105806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.105916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.105942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.105957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.105970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.105999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.115832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.115945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.115974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.115989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.116003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.116032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.125928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.126030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.126056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.126071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.126084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.126114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.135862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.135963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.135995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.136010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.136024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.136065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.145920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.146039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.146065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.146079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.146093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.967 [2024-11-28 04:34:36.146123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.967 qpair failed and we were unable to recover it. 00:27:58.967 [2024-11-28 04:34:36.155920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.967 [2024-11-28 04:34:36.156030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.967 [2024-11-28 04:34:36.156056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.967 [2024-11-28 04:34:36.156072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.967 [2024-11-28 04:34:36.156086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.156115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.165924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.166024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.166051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.166066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.166079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.166108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.175990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.176104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.176130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.176145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.176164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.176195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.186001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.186130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.186157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.186173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.186186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.186216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.196046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.196153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.196179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.196193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.196206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.196236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.206142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.206290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.206318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.206333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.206347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.206376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.216084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.216180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.216206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.216221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.216234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.216264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.226139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.226284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.226310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.226324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.226338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.226367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.236135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.236268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.236294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.236309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.236322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.236364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.246151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.246280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.246306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.246321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.246334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.246363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.256210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.256320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.256345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.968 [2024-11-28 04:34:36.256360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.968 [2024-11-28 04:34:36.256373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.968 [2024-11-28 04:34:36.256404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.968 qpair failed and we were unable to recover it. 00:27:58.968 [2024-11-28 04:34:36.266229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:58.968 [2024-11-28 04:34:36.266334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:58.968 [2024-11-28 04:34:36.266359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:58.969 [2024-11-28 04:34:36.266374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:58.969 [2024-11-28 04:34:36.266392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:58.969 [2024-11-28 04:34:36.266423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:58.969 qpair failed and we were unable to recover it. 00:27:59.270 [2024-11-28 04:34:36.276280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.270 [2024-11-28 04:34:36.276418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.270 [2024-11-28 04:34:36.276444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.270 [2024-11-28 04:34:36.276459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.270 [2024-11-28 04:34:36.276472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f0000b90 00:27:59.270 [2024-11-28 04:34:36.276501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:59.270 qpair failed and we were unable to recover it. 00:27:59.270 [2024-11-28 04:34:36.286292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.270 [2024-11-28 04:34:36.286398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.270 [2024-11-28 04:34:36.286431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.270 [2024-11-28 04:34:36.286447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.270 [2024-11-28 04:34:36.286461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.270 [2024-11-28 04:34:36.286505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.270 qpair failed and we were unable to recover it. 00:27:59.270 [2024-11-28 04:34:36.296309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.270 [2024-11-28 04:34:36.296414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.270 [2024-11-28 04:34:36.296442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.270 [2024-11-28 04:34:36.296458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.270 [2024-11-28 04:34:36.296471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.270 [2024-11-28 04:34:36.296504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.270 qpair failed and we were unable to recover it. 00:27:59.270 [2024-11-28 04:34:36.306340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.270 [2024-11-28 04:34:36.306447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.270 [2024-11-28 04:34:36.306474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.270 [2024-11-28 04:34:36.306489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.270 [2024-11-28 04:34:36.306502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.270 [2024-11-28 04:34:36.306540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.270 qpair failed and we were unable to recover it. 00:27:59.270 [2024-11-28 04:34:36.316346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.270 [2024-11-28 04:34:36.316454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.270 [2024-11-28 04:34:36.316481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.270 [2024-11-28 04:34:36.316495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.270 [2024-11-28 04:34:36.316510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.270 [2024-11-28 04:34:36.316547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.270 qpair failed and we were unable to recover it. 00:27:59.270 [2024-11-28 04:34:36.326395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.270 [2024-11-28 04:34:36.326498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.326531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.326550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.326563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.326595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.336404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.336505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.336539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.336556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.336569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.336599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.346462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.346585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.346611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.346626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.346638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.346676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.356471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.356588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.356614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.356636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.356650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.356681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.366584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.366723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.366750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.366764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.366777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.366807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.376551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.376674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.376700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.376715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.376728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.376760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.386603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.386718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.386744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.386758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.386772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.386802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.396580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.396714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.396740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.396754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.396767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.396796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.406625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.406733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.406759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.406773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.406786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.406815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.416624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.416736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.416761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.416776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.271 [2024-11-28 04:34:36.416789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.271 [2024-11-28 04:34:36.416819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.271 qpair failed and we were unable to recover it. 00:27:59.271 [2024-11-28 04:34:36.426681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.271 [2024-11-28 04:34:36.426780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.271 [2024-11-28 04:34:36.426806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.271 [2024-11-28 04:34:36.426821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.426834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.426864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.436723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.436825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.436851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.436865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.436878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.436908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.446740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.446843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.446868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.446887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.446901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.446931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.456760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.456862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.456888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.456903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.456916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.456947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.466833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.466945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.466971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.466985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.466998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.467027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.476807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.476932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.476958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.476973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.476986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.477015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.486859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.486961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.486987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.487001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.487014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.487044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.496841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.496942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.496968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.496983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.496996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.497025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.506916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.507038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.507064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.507078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.507091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.507121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.516917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.517031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.517058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.517072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.517085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.517114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.527083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.527181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.272 [2024-11-28 04:34:36.527209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.272 [2024-11-28 04:34:36.527224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.272 [2024-11-28 04:34:36.527238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.272 [2024-11-28 04:34:36.527268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.272 qpair failed and we were unable to recover it. 00:27:59.272 [2024-11-28 04:34:36.536959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.272 [2024-11-28 04:34:36.537064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.273 [2024-11-28 04:34:36.537096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.273 [2024-11-28 04:34:36.537111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.273 [2024-11-28 04:34:36.537125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.273 [2024-11-28 04:34:36.537155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.273 qpair failed and we were unable to recover it. 00:27:59.273 [2024-11-28 04:34:36.547011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.273 [2024-11-28 04:34:36.547121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.273 [2024-11-28 04:34:36.547146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.273 [2024-11-28 04:34:36.547160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.273 [2024-11-28 04:34:36.547174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.273 [2024-11-28 04:34:36.547205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.273 qpair failed and we were unable to recover it. 00:27:59.273 [2024-11-28 04:34:36.557050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.273 [2024-11-28 04:34:36.557161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.273 [2024-11-28 04:34:36.557188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.273 [2024-11-28 04:34:36.557203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.273 [2024-11-28 04:34:36.557216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.273 [2024-11-28 04:34:36.557247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.273 qpair failed and we were unable to recover it. 00:27:59.273 [2024-11-28 04:34:36.567094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.273 [2024-11-28 04:34:36.567202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.273 [2024-11-28 04:34:36.567229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.273 [2024-11-28 04:34:36.567245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.273 [2024-11-28 04:34:36.567259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.273 [2024-11-28 04:34:36.567288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.273 qpair failed and we were unable to recover it. 00:27:59.273 [2024-11-28 04:34:36.577165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.273 [2024-11-28 04:34:36.577311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.273 [2024-11-28 04:34:36.577340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.273 [2024-11-28 04:34:36.577355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.273 [2024-11-28 04:34:36.577370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.273 [2024-11-28 04:34:36.577413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.273 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.587194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.587304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.587333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.532 [2024-11-28 04:34:36.587348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.532 [2024-11-28 04:34:36.587362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.532 [2024-11-28 04:34:36.587392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.532 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.597188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.597295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.597324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.532 [2024-11-28 04:34:36.597339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.532 [2024-11-28 04:34:36.597353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.532 [2024-11-28 04:34:36.597384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.532 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.607239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.607339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.607365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.532 [2024-11-28 04:34:36.607380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.532 [2024-11-28 04:34:36.607394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.532 [2024-11-28 04:34:36.607425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.532 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.617229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.617341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.617367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.532 [2024-11-28 04:34:36.617382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.532 [2024-11-28 04:34:36.617396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.532 [2024-11-28 04:34:36.617425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.532 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.627304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.627445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.627477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.532 [2024-11-28 04:34:36.627493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.532 [2024-11-28 04:34:36.627506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.532 [2024-11-28 04:34:36.627543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.532 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.637266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.637374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.637400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.532 [2024-11-28 04:34:36.637414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.532 [2024-11-28 04:34:36.637428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.532 [2024-11-28 04:34:36.637458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.532 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.647375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.647475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.647501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.532 [2024-11-28 04:34:36.647515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.532 [2024-11-28 04:34:36.647537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25ec000b90 00:27:59.532 [2024-11-28 04:34:36.647568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:59.532 qpair failed and we were unable to recover it. 00:27:59.532 [2024-11-28 04:34:36.657334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.532 [2024-11-28 04:34:36.657433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.532 [2024-11-28 04:34:36.657465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.533 [2024-11-28 04:34:36.657482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.533 [2024-11-28 04:34:36.657496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:59.533 [2024-11-28 04:34:36.657535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.533 qpair failed and we were unable to recover it. 00:27:59.533 [2024-11-28 04:34:36.667357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.533 [2024-11-28 04:34:36.667462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.533 [2024-11-28 04:34:36.667489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.533 [2024-11-28 04:34:36.667504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.533 [2024-11-28 04:34:36.667517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xf72cb0 00:27:59.533 [2024-11-28 04:34:36.667560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:59.533 qpair failed and we were unable to recover it. 00:27:59.533 [2024-11-28 04:34:36.677423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.533 [2024-11-28 04:34:36.677582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.533 [2024-11-28 04:34:36.677617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.533 [2024-11-28 04:34:36.677643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.533 [2024-11-28 04:34:36.677668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f8000b90 00:27:59.533 [2024-11-28 04:34:36.677732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:59.533 qpair failed and we were unable to recover it. 00:27:59.533 [2024-11-28 04:34:36.687411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:59.533 [2024-11-28 04:34:36.687513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:59.533 [2024-11-28 04:34:36.687551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:59.533 [2024-11-28 04:34:36.687576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:59.533 [2024-11-28 04:34:36.687601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f25f8000b90 00:27:59.533 [2024-11-28 04:34:36.687650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:59.533 qpair failed and we were unable to recover it. 00:27:59.533 Controller properly reset. 00:27:59.533 Initializing NVMe Controllers 00:27:59.533 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:59.533 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:59.533 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:59.533 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:59.533 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:59.533 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:59.533 Initialization complete. Launching workers. 00:27:59.533 Starting thread on core 1 00:27:59.533 Starting thread on core 2 00:27:59.533 Starting thread on core 3 00:27:59.533 Starting thread on core 0 00:27:59.533 04:34:36 -- host/target_disconnect.sh@59 -- # sync 00:27:59.533 00:27:59.533 real 0m11.565s 00:27:59.533 user 0m21.607s 00:27:59.533 sys 0m5.104s 00:27:59.533 04:34:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:59.533 04:34:36 -- common/autotest_common.sh@10 -- # set +x 00:27:59.533 ************************************ 00:27:59.533 END TEST nvmf_target_disconnect_tc2 00:27:59.533 ************************************ 00:27:59.533 04:34:36 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:59.533 04:34:36 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:59.533 04:34:36 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:59.533 04:34:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:59.533 04:34:36 -- nvmf/common.sh@116 -- # sync 00:27:59.533 04:34:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:59.533 04:34:36 -- nvmf/common.sh@119 -- # set +e 00:27:59.533 04:34:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:59.533 04:34:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:59.533 rmmod nvme_tcp 00:27:59.533 rmmod nvme_fabrics 00:27:59.533 rmmod nvme_keyring 00:27:59.533 04:34:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:59.533 04:34:36 -- nvmf/common.sh@123 -- # set -e 00:27:59.533 04:34:36 -- nvmf/common.sh@124 -- # return 0 00:27:59.533 04:34:36 -- nvmf/common.sh@477 -- # '[' -n 4019027 ']' 00:27:59.533 04:34:36 -- nvmf/common.sh@478 -- # killprocess 4019027 00:27:59.533 04:34:36 -- common/autotest_common.sh@936 -- # '[' -z 4019027 ']' 00:27:59.533 04:34:36 -- common/autotest_common.sh@940 -- # kill -0 4019027 00:27:59.533 04:34:36 -- common/autotest_common.sh@941 -- # uname 00:27:59.791 04:34:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:59.791 04:34:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4019027 00:27:59.791 04:34:36 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:59.791 04:34:36 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:59.791 04:34:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4019027' 00:27:59.791 killing process with pid 4019027 00:27:59.791 04:34:36 -- common/autotest_common.sh@955 -- # kill 4019027 00:27:59.791 04:34:36 -- common/autotest_common.sh@960 -- # wait 4019027 00:28:00.050 04:34:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:00.050 04:34:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:00.050 04:34:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:00.050 04:34:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:00.050 04:34:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:00.050 04:34:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:00.050 04:34:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:00.050 04:34:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:01.951 04:34:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:01.951 00:28:01.951 real 0m16.435s 00:28:01.951 user 0m48.228s 00:28:01.951 sys 0m7.082s 00:28:01.951 04:34:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:01.951 04:34:39 -- common/autotest_common.sh@10 -- # set +x 00:28:01.951 ************************************ 00:28:01.951 END TEST nvmf_target_disconnect 00:28:01.951 ************************************ 00:28:01.951 04:34:39 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:01.951 04:34:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:01.951 04:34:39 -- common/autotest_common.sh@10 -- # set +x 00:28:01.951 04:34:39 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:01.951 00:28:01.951 real 21m31.780s 00:28:01.951 user 62m17.696s 00:28:01.951 sys 5m2.729s 00:28:01.951 04:34:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:01.951 04:34:39 -- common/autotest_common.sh@10 -- # set +x 00:28:01.951 ************************************ 00:28:01.951 END TEST nvmf_tcp 00:28:01.951 ************************************ 00:28:02.210 04:34:39 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:02.210 04:34:39 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:02.210 04:34:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:02.210 04:34:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:02.210 04:34:39 -- common/autotest_common.sh@10 -- # set +x 00:28:02.210 ************************************ 00:28:02.210 START TEST spdkcli_nvmf_tcp 00:28:02.210 ************************************ 00:28:02.210 04:34:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:02.210 * Looking for test storage... 00:28:02.210 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:02.210 04:34:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:02.210 04:34:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:02.210 04:34:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:02.210 04:34:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:02.210 04:34:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:02.210 04:34:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:02.210 04:34:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:02.210 04:34:39 -- scripts/common.sh@335 -- # IFS=.-: 00:28:02.210 04:34:39 -- scripts/common.sh@335 -- # read -ra ver1 00:28:02.210 04:34:39 -- scripts/common.sh@336 -- # IFS=.-: 00:28:02.210 04:34:39 -- scripts/common.sh@336 -- # read -ra ver2 00:28:02.210 04:34:39 -- scripts/common.sh@337 -- # local 'op=<' 00:28:02.210 04:34:39 -- scripts/common.sh@339 -- # ver1_l=2 00:28:02.210 04:34:39 -- scripts/common.sh@340 -- # ver2_l=1 00:28:02.210 04:34:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:02.210 04:34:39 -- scripts/common.sh@343 -- # case "$op" in 00:28:02.210 04:34:39 -- scripts/common.sh@344 -- # : 1 00:28:02.210 04:34:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:02.210 04:34:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:02.210 04:34:39 -- scripts/common.sh@364 -- # decimal 1 00:28:02.210 04:34:39 -- scripts/common.sh@352 -- # local d=1 00:28:02.210 04:34:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:02.210 04:34:39 -- scripts/common.sh@354 -- # echo 1 00:28:02.210 04:34:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:02.210 04:34:39 -- scripts/common.sh@365 -- # decimal 2 00:28:02.210 04:34:39 -- scripts/common.sh@352 -- # local d=2 00:28:02.210 04:34:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:02.210 04:34:39 -- scripts/common.sh@354 -- # echo 2 00:28:02.210 04:34:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:02.210 04:34:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:02.210 04:34:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:02.210 04:34:39 -- scripts/common.sh@367 -- # return 0 00:28:02.210 04:34:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:02.210 04:34:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:02.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.210 --rc genhtml_branch_coverage=1 00:28:02.210 --rc genhtml_function_coverage=1 00:28:02.210 --rc genhtml_legend=1 00:28:02.210 --rc geninfo_all_blocks=1 00:28:02.210 --rc geninfo_unexecuted_blocks=1 00:28:02.210 00:28:02.210 ' 00:28:02.210 04:34:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:02.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.210 --rc genhtml_branch_coverage=1 00:28:02.210 --rc genhtml_function_coverage=1 00:28:02.210 --rc genhtml_legend=1 00:28:02.210 --rc geninfo_all_blocks=1 00:28:02.210 --rc geninfo_unexecuted_blocks=1 00:28:02.210 00:28:02.210 ' 00:28:02.210 04:34:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:02.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.210 --rc genhtml_branch_coverage=1 00:28:02.210 --rc genhtml_function_coverage=1 00:28:02.210 --rc genhtml_legend=1 00:28:02.210 --rc geninfo_all_blocks=1 00:28:02.210 --rc geninfo_unexecuted_blocks=1 00:28:02.210 00:28:02.210 ' 00:28:02.210 04:34:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:02.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.210 --rc genhtml_branch_coverage=1 00:28:02.210 --rc genhtml_function_coverage=1 00:28:02.210 --rc genhtml_legend=1 00:28:02.210 --rc geninfo_all_blocks=1 00:28:02.210 --rc geninfo_unexecuted_blocks=1 00:28:02.210 00:28:02.210 ' 00:28:02.210 04:34:39 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:02.210 04:34:39 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:02.210 04:34:39 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:02.210 04:34:39 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:02.210 04:34:39 -- nvmf/common.sh@7 -- # uname -s 00:28:02.210 04:34:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:02.210 04:34:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:02.210 04:34:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:02.210 04:34:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:02.210 04:34:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:02.210 04:34:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:02.210 04:34:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:02.210 04:34:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:02.210 04:34:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:02.210 04:34:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:02.210 04:34:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:02.210 04:34:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:02.210 04:34:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:02.210 04:34:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:02.210 04:34:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:02.210 04:34:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:02.210 04:34:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:02.210 04:34:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:02.210 04:34:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:02.210 04:34:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.210 04:34:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.210 04:34:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.210 04:34:39 -- paths/export.sh@5 -- # export PATH 00:28:02.211 04:34:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.211 04:34:39 -- nvmf/common.sh@46 -- # : 0 00:28:02.211 04:34:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:02.211 04:34:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:02.211 04:34:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:02.211 04:34:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:02.211 04:34:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:02.211 04:34:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:02.211 04:34:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:02.211 04:34:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:02.211 04:34:39 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:02.211 04:34:39 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:02.211 04:34:39 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:02.211 04:34:39 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:02.211 04:34:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:02.211 04:34:39 -- common/autotest_common.sh@10 -- # set +x 00:28:02.211 04:34:39 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:02.211 04:34:39 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=4020256 00:28:02.211 04:34:39 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:02.211 04:34:39 -- spdkcli/common.sh@34 -- # waitforlisten 4020256 00:28:02.211 04:34:39 -- common/autotest_common.sh@829 -- # '[' -z 4020256 ']' 00:28:02.211 04:34:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:02.211 04:34:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:02.211 04:34:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:02.211 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:02.211 04:34:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:02.211 04:34:39 -- common/autotest_common.sh@10 -- # set +x 00:28:02.211 [2024-11-28 04:34:39.481746] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:02.211 [2024-11-28 04:34:39.481851] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4020256 ] 00:28:02.211 EAL: No free 2048 kB hugepages reported on node 1 00:28:02.469 [2024-11-28 04:34:39.543577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:02.469 [2024-11-28 04:34:39.658018] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:02.469 [2024-11-28 04:34:39.658223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:02.469 [2024-11-28 04:34:39.658230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:03.402 04:34:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:03.402 04:34:40 -- common/autotest_common.sh@862 -- # return 0 00:28:03.402 04:34:40 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:03.402 04:34:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:03.402 04:34:40 -- common/autotest_common.sh@10 -- # set +x 00:28:03.402 04:34:40 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:03.402 04:34:40 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:03.403 04:34:40 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:03.403 04:34:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:03.403 04:34:40 -- common/autotest_common.sh@10 -- # set +x 00:28:03.403 04:34:40 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:03.403 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:03.403 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:03.403 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:03.403 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:03.403 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:03.403 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:03.403 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:03.403 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:03.403 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:03.403 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:03.403 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:03.403 ' 00:28:03.660 [2024-11-28 04:34:40.882287] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:06.190 [2024-11-28 04:34:43.068729] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:07.123 [2024-11-28 04:34:44.305300] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:09.660 [2024-11-28 04:34:46.604623] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:11.561 [2024-11-28 04:34:48.579135] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:12.936 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:12.936 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:12.936 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:12.936 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:12.936 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:12.936 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:12.936 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:12.936 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:12.936 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:12.936 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:12.936 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:12.936 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:12.936 04:34:50 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:12.936 04:34:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:12.936 04:34:50 -- common/autotest_common.sh@10 -- # set +x 00:28:12.936 04:34:50 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:12.936 04:34:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:12.936 04:34:50 -- common/autotest_common.sh@10 -- # set +x 00:28:12.936 04:34:50 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:12.936 04:34:50 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:13.503 04:34:50 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:13.503 04:34:50 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:13.503 04:34:50 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:13.503 04:34:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:13.503 04:34:50 -- common/autotest_common.sh@10 -- # set +x 00:28:13.503 04:34:50 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:13.503 04:34:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:13.503 04:34:50 -- common/autotest_common.sh@10 -- # set +x 00:28:13.503 04:34:50 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:13.503 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:13.503 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:13.503 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:13.503 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:13.503 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:13.503 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:13.503 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:13.503 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:13.503 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:13.503 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:13.503 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:13.503 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:13.503 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:13.503 ' 00:28:18.767 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:18.767 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:18.767 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:18.767 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:18.767 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:18.767 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:18.767 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:18.767 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:18.767 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:18.767 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:18.767 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:18.767 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:18.767 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:18.767 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:18.767 04:34:56 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:18.767 04:34:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:18.767 04:34:56 -- common/autotest_common.sh@10 -- # set +x 00:28:18.767 04:34:56 -- spdkcli/nvmf.sh@90 -- # killprocess 4020256 00:28:18.767 04:34:56 -- common/autotest_common.sh@936 -- # '[' -z 4020256 ']' 00:28:18.767 04:34:56 -- common/autotest_common.sh@940 -- # kill -0 4020256 00:28:18.767 04:34:56 -- common/autotest_common.sh@941 -- # uname 00:28:18.767 04:34:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:18.767 04:34:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4020256 00:28:19.026 04:34:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:19.026 04:34:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:19.026 04:34:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4020256' 00:28:19.026 killing process with pid 4020256 00:28:19.026 04:34:56 -- common/autotest_common.sh@955 -- # kill 4020256 00:28:19.026 [2024-11-28 04:34:56.101869] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:19.026 04:34:56 -- common/autotest_common.sh@960 -- # wait 4020256 00:28:19.284 04:34:56 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:19.284 04:34:56 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:19.284 04:34:56 -- spdkcli/common.sh@13 -- # '[' -n 4020256 ']' 00:28:19.284 04:34:56 -- spdkcli/common.sh@14 -- # killprocess 4020256 00:28:19.284 04:34:56 -- common/autotest_common.sh@936 -- # '[' -z 4020256 ']' 00:28:19.284 04:34:56 -- common/autotest_common.sh@940 -- # kill -0 4020256 00:28:19.284 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4020256) - No such process 00:28:19.284 04:34:56 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4020256 is not found' 00:28:19.284 Process with pid 4020256 is not found 00:28:19.284 04:34:56 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:19.284 04:34:56 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:19.284 04:34:56 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:19.284 00:28:19.284 real 0m17.072s 00:28:19.284 user 0m36.368s 00:28:19.284 sys 0m0.792s 00:28:19.284 04:34:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:19.284 04:34:56 -- common/autotest_common.sh@10 -- # set +x 00:28:19.284 ************************************ 00:28:19.284 END TEST spdkcli_nvmf_tcp 00:28:19.284 ************************************ 00:28:19.284 04:34:56 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:19.284 04:34:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:19.284 04:34:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:19.284 04:34:56 -- common/autotest_common.sh@10 -- # set +x 00:28:19.284 ************************************ 00:28:19.284 START TEST nvmf_identify_passthru 00:28:19.284 ************************************ 00:28:19.284 04:34:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:19.284 * Looking for test storage... 00:28:19.284 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:19.284 04:34:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:19.284 04:34:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:19.284 04:34:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:19.284 04:34:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:19.284 04:34:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:19.284 04:34:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:19.284 04:34:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:19.284 04:34:56 -- scripts/common.sh@335 -- # IFS=.-: 00:28:19.284 04:34:56 -- scripts/common.sh@335 -- # read -ra ver1 00:28:19.284 04:34:56 -- scripts/common.sh@336 -- # IFS=.-: 00:28:19.284 04:34:56 -- scripts/common.sh@336 -- # read -ra ver2 00:28:19.284 04:34:56 -- scripts/common.sh@337 -- # local 'op=<' 00:28:19.284 04:34:56 -- scripts/common.sh@339 -- # ver1_l=2 00:28:19.284 04:34:56 -- scripts/common.sh@340 -- # ver2_l=1 00:28:19.284 04:34:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:19.284 04:34:56 -- scripts/common.sh@343 -- # case "$op" in 00:28:19.284 04:34:56 -- scripts/common.sh@344 -- # : 1 00:28:19.284 04:34:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:19.284 04:34:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:19.284 04:34:56 -- scripts/common.sh@364 -- # decimal 1 00:28:19.284 04:34:56 -- scripts/common.sh@352 -- # local d=1 00:28:19.284 04:34:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:19.284 04:34:56 -- scripts/common.sh@354 -- # echo 1 00:28:19.284 04:34:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:19.284 04:34:56 -- scripts/common.sh@365 -- # decimal 2 00:28:19.284 04:34:56 -- scripts/common.sh@352 -- # local d=2 00:28:19.284 04:34:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:19.284 04:34:56 -- scripts/common.sh@354 -- # echo 2 00:28:19.284 04:34:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:19.284 04:34:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:19.284 04:34:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:19.284 04:34:56 -- scripts/common.sh@367 -- # return 0 00:28:19.284 04:34:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:19.284 04:34:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:19.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.284 --rc genhtml_branch_coverage=1 00:28:19.284 --rc genhtml_function_coverage=1 00:28:19.284 --rc genhtml_legend=1 00:28:19.284 --rc geninfo_all_blocks=1 00:28:19.284 --rc geninfo_unexecuted_blocks=1 00:28:19.284 00:28:19.284 ' 00:28:19.284 04:34:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:19.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.284 --rc genhtml_branch_coverage=1 00:28:19.284 --rc genhtml_function_coverage=1 00:28:19.284 --rc genhtml_legend=1 00:28:19.284 --rc geninfo_all_blocks=1 00:28:19.284 --rc geninfo_unexecuted_blocks=1 00:28:19.284 00:28:19.284 ' 00:28:19.284 04:34:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:19.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.284 --rc genhtml_branch_coverage=1 00:28:19.284 --rc genhtml_function_coverage=1 00:28:19.284 --rc genhtml_legend=1 00:28:19.284 --rc geninfo_all_blocks=1 00:28:19.284 --rc geninfo_unexecuted_blocks=1 00:28:19.284 00:28:19.284 ' 00:28:19.284 04:34:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:19.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:19.284 --rc genhtml_branch_coverage=1 00:28:19.284 --rc genhtml_function_coverage=1 00:28:19.284 --rc genhtml_legend=1 00:28:19.284 --rc geninfo_all_blocks=1 00:28:19.284 --rc geninfo_unexecuted_blocks=1 00:28:19.284 00:28:19.284 ' 00:28:19.284 04:34:56 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:19.284 04:34:56 -- nvmf/common.sh@7 -- # uname -s 00:28:19.284 04:34:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:19.284 04:34:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:19.284 04:34:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:19.284 04:34:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:19.284 04:34:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:19.285 04:34:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:19.285 04:34:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:19.285 04:34:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:19.285 04:34:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:19.285 04:34:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:19.285 04:34:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:19.285 04:34:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:19.285 04:34:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:19.285 04:34:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:19.285 04:34:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:19.285 04:34:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:19.285 04:34:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:19.285 04:34:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:19.285 04:34:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:19.285 04:34:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- paths/export.sh@5 -- # export PATH 00:28:19.285 04:34:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- nvmf/common.sh@46 -- # : 0 00:28:19.285 04:34:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:19.285 04:34:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:19.285 04:34:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:19.285 04:34:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:19.285 04:34:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:19.285 04:34:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:19.285 04:34:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:19.285 04:34:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:19.285 04:34:56 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:19.285 04:34:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:19.285 04:34:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:19.285 04:34:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:19.285 04:34:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- paths/export.sh@5 -- # export PATH 00:28:19.285 04:34:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.285 04:34:56 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:19.285 04:34:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:19.285 04:34:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:19.285 04:34:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:19.285 04:34:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:19.285 04:34:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:19.285 04:34:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:19.285 04:34:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:19.285 04:34:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:19.285 04:34:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:19.285 04:34:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:19.285 04:34:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:19.285 04:34:56 -- common/autotest_common.sh@10 -- # set +x 00:28:21.185 04:34:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:21.185 04:34:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:21.185 04:34:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:21.185 04:34:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:21.185 04:34:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:21.185 04:34:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:21.185 04:34:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:21.185 04:34:58 -- nvmf/common.sh@294 -- # net_devs=() 00:28:21.185 04:34:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:21.186 04:34:58 -- nvmf/common.sh@295 -- # e810=() 00:28:21.186 04:34:58 -- nvmf/common.sh@295 -- # local -ga e810 00:28:21.186 04:34:58 -- nvmf/common.sh@296 -- # x722=() 00:28:21.186 04:34:58 -- nvmf/common.sh@296 -- # local -ga x722 00:28:21.186 04:34:58 -- nvmf/common.sh@297 -- # mlx=() 00:28:21.186 04:34:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:21.186 04:34:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:21.186 04:34:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:21.186 04:34:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:21.186 04:34:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:21.186 04:34:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:21.186 04:34:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:21.186 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:21.186 04:34:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:21.186 04:34:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:21.186 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:21.186 04:34:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:21.186 04:34:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:21.186 04:34:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:21.186 04:34:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:21.186 04:34:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:21.186 04:34:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:21.186 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:21.186 04:34:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:21.186 04:34:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:21.186 04:34:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:21.186 04:34:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:21.186 04:34:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:21.186 04:34:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:21.186 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:21.186 04:34:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:21.186 04:34:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:21.186 04:34:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:21.186 04:34:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:21.186 04:34:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:21.186 04:34:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:21.186 04:34:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:21.186 04:34:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:21.186 04:34:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:21.186 04:34:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:21.186 04:34:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:21.186 04:34:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:21.186 04:34:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:21.186 04:34:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:21.186 04:34:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:21.186 04:34:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:21.186 04:34:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:21.186 04:34:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:21.444 04:34:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:21.444 04:34:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:21.444 04:34:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:21.444 04:34:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:21.444 04:34:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:21.444 04:34:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:21.444 04:34:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:21.444 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:21.444 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:28:21.444 00:28:21.444 --- 10.0.0.2 ping statistics --- 00:28:21.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:21.444 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:28:21.444 04:34:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:21.444 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:21.444 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:28:21.444 00:28:21.444 --- 10.0.0.1 ping statistics --- 00:28:21.444 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:21.444 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:28:21.444 04:34:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:21.444 04:34:58 -- nvmf/common.sh@410 -- # return 0 00:28:21.444 04:34:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:21.444 04:34:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:21.444 04:34:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:21.444 04:34:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:21.444 04:34:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:21.444 04:34:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:21.444 04:34:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:21.444 04:34:58 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:21.444 04:34:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:21.444 04:34:58 -- common/autotest_common.sh@10 -- # set +x 00:28:21.444 04:34:58 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:21.444 04:34:58 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:21.444 04:34:58 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:21.444 04:34:58 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:21.444 04:34:58 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:21.444 04:34:58 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:21.444 04:34:58 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:21.444 04:34:58 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:21.444 04:34:58 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:21.444 04:34:58 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:21.704 04:34:58 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:21.704 04:34:58 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:21.704 04:34:58 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:21.704 04:34:58 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:21.704 04:34:58 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:21.704 04:34:58 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:21.704 04:34:58 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:21.704 04:34:58 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:21.704 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.890 04:35:03 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:25.890 04:35:03 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:25.890 04:35:03 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:25.890 04:35:03 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:25.890 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.075 04:35:07 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:30.075 04:35:07 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:30.075 04:35:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:30.075 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:30.075 04:35:07 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:30.075 04:35:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:30.075 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:30.075 04:35:07 -- target/identify_passthru.sh@31 -- # nvmfpid=4025031 00:28:30.075 04:35:07 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:30.075 04:35:07 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:30.075 04:35:07 -- target/identify_passthru.sh@35 -- # waitforlisten 4025031 00:28:30.075 04:35:07 -- common/autotest_common.sh@829 -- # '[' -z 4025031 ']' 00:28:30.075 04:35:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:30.075 04:35:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:30.075 04:35:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:30.075 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:30.075 04:35:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:30.075 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:30.075 [2024-11-28 04:35:07.279333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:30.076 [2024-11-28 04:35:07.279414] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:30.076 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.076 [2024-11-28 04:35:07.346835] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:30.334 [2024-11-28 04:35:07.453976] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:30.334 [2024-11-28 04:35:07.454131] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:30.334 [2024-11-28 04:35:07.454147] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:30.334 [2024-11-28 04:35:07.454159] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:30.334 [2024-11-28 04:35:07.454222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:30.334 [2024-11-28 04:35:07.454246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:30.334 [2024-11-28 04:35:07.454307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:30.334 [2024-11-28 04:35:07.454310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:30.334 04:35:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:30.334 04:35:07 -- common/autotest_common.sh@862 -- # return 0 00:28:30.334 04:35:07 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:30.334 04:35:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.334 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:30.334 INFO: Log level set to 20 00:28:30.334 INFO: Requests: 00:28:30.334 { 00:28:30.334 "jsonrpc": "2.0", 00:28:30.334 "method": "nvmf_set_config", 00:28:30.334 "id": 1, 00:28:30.334 "params": { 00:28:30.334 "admin_cmd_passthru": { 00:28:30.334 "identify_ctrlr": true 00:28:30.334 } 00:28:30.334 } 00:28:30.334 } 00:28:30.334 00:28:30.334 INFO: response: 00:28:30.334 { 00:28:30.334 "jsonrpc": "2.0", 00:28:30.334 "id": 1, 00:28:30.334 "result": true 00:28:30.334 } 00:28:30.334 00:28:30.334 04:35:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.334 04:35:07 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:30.334 04:35:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.334 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:30.334 INFO: Setting log level to 20 00:28:30.334 INFO: Setting log level to 20 00:28:30.334 INFO: Log level set to 20 00:28:30.334 INFO: Log level set to 20 00:28:30.334 INFO: Requests: 00:28:30.334 { 00:28:30.334 "jsonrpc": "2.0", 00:28:30.334 "method": "framework_start_init", 00:28:30.334 "id": 1 00:28:30.334 } 00:28:30.334 00:28:30.334 INFO: Requests: 00:28:30.334 { 00:28:30.334 "jsonrpc": "2.0", 00:28:30.334 "method": "framework_start_init", 00:28:30.334 "id": 1 00:28:30.334 } 00:28:30.334 00:28:30.334 [2024-11-28 04:35:07.596730] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:30.334 INFO: response: 00:28:30.334 { 00:28:30.334 "jsonrpc": "2.0", 00:28:30.334 "id": 1, 00:28:30.334 "result": true 00:28:30.334 } 00:28:30.334 00:28:30.334 INFO: response: 00:28:30.334 { 00:28:30.334 "jsonrpc": "2.0", 00:28:30.334 "id": 1, 00:28:30.334 "result": true 00:28:30.334 } 00:28:30.334 00:28:30.334 04:35:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.334 04:35:07 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:30.334 04:35:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.334 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:30.334 INFO: Setting log level to 40 00:28:30.334 INFO: Setting log level to 40 00:28:30.334 INFO: Setting log level to 40 00:28:30.334 [2024-11-28 04:35:07.606679] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:30.334 04:35:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.334 04:35:07 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:30.334 04:35:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:30.334 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:30.334 04:35:07 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:30.334 04:35:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.334 04:35:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.611 Nvme0n1 00:28:33.611 04:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.611 04:35:10 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:33.611 04:35:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.611 04:35:10 -- common/autotest_common.sh@10 -- # set +x 00:28:33.611 04:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.611 04:35:10 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:33.611 04:35:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.611 04:35:10 -- common/autotest_common.sh@10 -- # set +x 00:28:33.611 04:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.611 04:35:10 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:33.611 04:35:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.611 04:35:10 -- common/autotest_common.sh@10 -- # set +x 00:28:33.611 [2024-11-28 04:35:10.495471] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:33.611 04:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.611 04:35:10 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:33.611 04:35:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.611 04:35:10 -- common/autotest_common.sh@10 -- # set +x 00:28:33.611 [2024-11-28 04:35:10.503195] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:33.611 [ 00:28:33.611 { 00:28:33.612 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:33.612 "subtype": "Discovery", 00:28:33.612 "listen_addresses": [], 00:28:33.612 "allow_any_host": true, 00:28:33.612 "hosts": [] 00:28:33.612 }, 00:28:33.612 { 00:28:33.612 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:33.612 "subtype": "NVMe", 00:28:33.612 "listen_addresses": [ 00:28:33.612 { 00:28:33.612 "transport": "TCP", 00:28:33.612 "trtype": "TCP", 00:28:33.612 "adrfam": "IPv4", 00:28:33.612 "traddr": "10.0.0.2", 00:28:33.612 "trsvcid": "4420" 00:28:33.612 } 00:28:33.612 ], 00:28:33.612 "allow_any_host": true, 00:28:33.612 "hosts": [], 00:28:33.612 "serial_number": "SPDK00000000000001", 00:28:33.612 "model_number": "SPDK bdev Controller", 00:28:33.612 "max_namespaces": 1, 00:28:33.612 "min_cntlid": 1, 00:28:33.612 "max_cntlid": 65519, 00:28:33.612 "namespaces": [ 00:28:33.612 { 00:28:33.612 "nsid": 1, 00:28:33.612 "bdev_name": "Nvme0n1", 00:28:33.612 "name": "Nvme0n1", 00:28:33.612 "nguid": "00B6FBE7AA4E4104AA4027EEABB47C23", 00:28:33.612 "uuid": "00b6fbe7-aa4e-4104-aa40-27eeabb47c23" 00:28:33.612 } 00:28:33.612 ] 00:28:33.612 } 00:28:33.612 ] 00:28:33.612 04:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.612 04:35:10 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:33.612 04:35:10 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:33.612 04:35:10 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:33.612 EAL: No free 2048 kB hugepages reported on node 1 00:28:33.612 04:35:10 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:33.612 04:35:10 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:33.612 04:35:10 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:33.612 04:35:10 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:33.612 EAL: No free 2048 kB hugepages reported on node 1 00:28:33.612 04:35:10 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:33.612 04:35:10 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:33.612 04:35:10 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:33.612 04:35:10 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:33.612 04:35:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.612 04:35:10 -- common/autotest_common.sh@10 -- # set +x 00:28:33.612 04:35:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.612 04:35:10 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:33.612 04:35:10 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:33.612 04:35:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:33.612 04:35:10 -- nvmf/common.sh@116 -- # sync 00:28:33.612 04:35:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:33.612 04:35:10 -- nvmf/common.sh@119 -- # set +e 00:28:33.612 04:35:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:33.612 04:35:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:33.612 rmmod nvme_tcp 00:28:33.612 rmmod nvme_fabrics 00:28:33.612 rmmod nvme_keyring 00:28:33.612 04:35:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:33.612 04:35:10 -- nvmf/common.sh@123 -- # set -e 00:28:33.612 04:35:10 -- nvmf/common.sh@124 -- # return 0 00:28:33.612 04:35:10 -- nvmf/common.sh@477 -- # '[' -n 4025031 ']' 00:28:33.612 04:35:10 -- nvmf/common.sh@478 -- # killprocess 4025031 00:28:33.612 04:35:10 -- common/autotest_common.sh@936 -- # '[' -z 4025031 ']' 00:28:33.612 04:35:10 -- common/autotest_common.sh@940 -- # kill -0 4025031 00:28:33.612 04:35:10 -- common/autotest_common.sh@941 -- # uname 00:28:33.612 04:35:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:33.612 04:35:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4025031 00:28:33.612 04:35:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:33.612 04:35:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:33.612 04:35:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4025031' 00:28:33.612 killing process with pid 4025031 00:28:33.612 04:35:10 -- common/autotest_common.sh@955 -- # kill 4025031 00:28:33.612 [2024-11-28 04:35:10.832081] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:33.612 04:35:10 -- common/autotest_common.sh@960 -- # wait 4025031 00:28:35.510 04:35:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:35.510 04:35:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:35.510 04:35:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:35.510 04:35:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:35.510 04:35:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:35.510 04:35:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:35.510 04:35:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:35.510 04:35:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:37.412 04:35:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:37.412 00:28:37.412 real 0m18.110s 00:28:37.412 user 0m26.481s 00:28:37.412 sys 0m2.212s 00:28:37.412 04:35:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:37.412 04:35:14 -- common/autotest_common.sh@10 -- # set +x 00:28:37.412 ************************************ 00:28:37.412 END TEST nvmf_identify_passthru 00:28:37.412 ************************************ 00:28:37.412 04:35:14 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:37.412 04:35:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:37.412 04:35:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:37.412 04:35:14 -- common/autotest_common.sh@10 -- # set +x 00:28:37.412 ************************************ 00:28:37.412 START TEST nvmf_dif 00:28:37.412 ************************************ 00:28:37.412 04:35:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:37.412 * Looking for test storage... 00:28:37.412 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:37.412 04:35:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:37.412 04:35:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:37.412 04:35:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:37.412 04:35:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:37.412 04:35:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:37.413 04:35:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:37.413 04:35:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:37.413 04:35:14 -- scripts/common.sh@335 -- # IFS=.-: 00:28:37.413 04:35:14 -- scripts/common.sh@335 -- # read -ra ver1 00:28:37.413 04:35:14 -- scripts/common.sh@336 -- # IFS=.-: 00:28:37.413 04:35:14 -- scripts/common.sh@336 -- # read -ra ver2 00:28:37.413 04:35:14 -- scripts/common.sh@337 -- # local 'op=<' 00:28:37.413 04:35:14 -- scripts/common.sh@339 -- # ver1_l=2 00:28:37.413 04:35:14 -- scripts/common.sh@340 -- # ver2_l=1 00:28:37.413 04:35:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:37.413 04:35:14 -- scripts/common.sh@343 -- # case "$op" in 00:28:37.413 04:35:14 -- scripts/common.sh@344 -- # : 1 00:28:37.413 04:35:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:37.413 04:35:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:37.413 04:35:14 -- scripts/common.sh@364 -- # decimal 1 00:28:37.413 04:35:14 -- scripts/common.sh@352 -- # local d=1 00:28:37.413 04:35:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:37.413 04:35:14 -- scripts/common.sh@354 -- # echo 1 00:28:37.413 04:35:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:37.413 04:35:14 -- scripts/common.sh@365 -- # decimal 2 00:28:37.413 04:35:14 -- scripts/common.sh@352 -- # local d=2 00:28:37.413 04:35:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:37.413 04:35:14 -- scripts/common.sh@354 -- # echo 2 00:28:37.413 04:35:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:37.413 04:35:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:37.413 04:35:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:37.413 04:35:14 -- scripts/common.sh@367 -- # return 0 00:28:37.413 04:35:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:37.413 04:35:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:37.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:37.413 --rc genhtml_branch_coverage=1 00:28:37.413 --rc genhtml_function_coverage=1 00:28:37.413 --rc genhtml_legend=1 00:28:37.413 --rc geninfo_all_blocks=1 00:28:37.413 --rc geninfo_unexecuted_blocks=1 00:28:37.413 00:28:37.413 ' 00:28:37.413 04:35:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:37.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:37.413 --rc genhtml_branch_coverage=1 00:28:37.413 --rc genhtml_function_coverage=1 00:28:37.413 --rc genhtml_legend=1 00:28:37.413 --rc geninfo_all_blocks=1 00:28:37.413 --rc geninfo_unexecuted_blocks=1 00:28:37.413 00:28:37.413 ' 00:28:37.413 04:35:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:37.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:37.413 --rc genhtml_branch_coverage=1 00:28:37.413 --rc genhtml_function_coverage=1 00:28:37.413 --rc genhtml_legend=1 00:28:37.413 --rc geninfo_all_blocks=1 00:28:37.413 --rc geninfo_unexecuted_blocks=1 00:28:37.413 00:28:37.413 ' 00:28:37.413 04:35:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:37.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:37.413 --rc genhtml_branch_coverage=1 00:28:37.413 --rc genhtml_function_coverage=1 00:28:37.413 --rc genhtml_legend=1 00:28:37.413 --rc geninfo_all_blocks=1 00:28:37.413 --rc geninfo_unexecuted_blocks=1 00:28:37.413 00:28:37.413 ' 00:28:37.413 04:35:14 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:37.413 04:35:14 -- nvmf/common.sh@7 -- # uname -s 00:28:37.413 04:35:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:37.413 04:35:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:37.413 04:35:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:37.413 04:35:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:37.413 04:35:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:37.413 04:35:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:37.413 04:35:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:37.413 04:35:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:37.413 04:35:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:37.413 04:35:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:37.413 04:35:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:37.413 04:35:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:37.413 04:35:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:37.413 04:35:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:37.413 04:35:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:37.413 04:35:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:37.413 04:35:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:37.413 04:35:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:37.413 04:35:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:37.413 04:35:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:37.413 04:35:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:37.413 04:35:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:37.413 04:35:14 -- paths/export.sh@5 -- # export PATH 00:28:37.413 04:35:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:37.413 04:35:14 -- nvmf/common.sh@46 -- # : 0 00:28:37.413 04:35:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:37.413 04:35:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:37.413 04:35:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:37.413 04:35:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:37.413 04:35:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:37.413 04:35:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:37.413 04:35:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:37.413 04:35:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:37.413 04:35:14 -- target/dif.sh@15 -- # NULL_META=16 00:28:37.413 04:35:14 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:37.413 04:35:14 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:37.413 04:35:14 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:37.413 04:35:14 -- target/dif.sh@135 -- # nvmftestinit 00:28:37.413 04:35:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:37.413 04:35:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:37.413 04:35:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:37.413 04:35:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:37.413 04:35:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:37.413 04:35:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:37.413 04:35:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:37.413 04:35:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:37.413 04:35:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:37.413 04:35:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:37.413 04:35:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:37.413 04:35:14 -- common/autotest_common.sh@10 -- # set +x 00:28:39.942 04:35:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:39.942 04:35:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:39.942 04:35:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:39.942 04:35:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:39.942 04:35:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:39.942 04:35:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:39.942 04:35:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:39.942 04:35:16 -- nvmf/common.sh@294 -- # net_devs=() 00:28:39.942 04:35:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:39.942 04:35:16 -- nvmf/common.sh@295 -- # e810=() 00:28:39.942 04:35:16 -- nvmf/common.sh@295 -- # local -ga e810 00:28:39.942 04:35:16 -- nvmf/common.sh@296 -- # x722=() 00:28:39.942 04:35:16 -- nvmf/common.sh@296 -- # local -ga x722 00:28:39.942 04:35:16 -- nvmf/common.sh@297 -- # mlx=() 00:28:39.942 04:35:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:39.942 04:35:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:39.942 04:35:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:39.942 04:35:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:39.942 04:35:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:39.942 04:35:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:39.942 04:35:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:39.942 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:39.942 04:35:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:39.942 04:35:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:39.942 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:39.942 04:35:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:39.942 04:35:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:39.942 04:35:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:39.942 04:35:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:39.942 04:35:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:39.942 04:35:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:39.942 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:39.942 04:35:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:39.942 04:35:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:39.942 04:35:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:39.942 04:35:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:39.942 04:35:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:39.942 04:35:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:39.942 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:39.942 04:35:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:39.942 04:35:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:39.942 04:35:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:39.942 04:35:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:39.942 04:35:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:39.942 04:35:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:39.942 04:35:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:39.942 04:35:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:39.942 04:35:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:39.942 04:35:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:39.942 04:35:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:39.942 04:35:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:39.942 04:35:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:39.942 04:35:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:39.942 04:35:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:39.942 04:35:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:39.942 04:35:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:39.942 04:35:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:39.942 04:35:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:39.942 04:35:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:39.942 04:35:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:39.942 04:35:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:39.942 04:35:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:39.942 04:35:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:39.942 04:35:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:39.942 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:39.942 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:28:39.942 00:28:39.943 --- 10.0.0.2 ping statistics --- 00:28:39.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:39.943 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:28:39.943 04:35:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:39.943 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:39.943 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.065 ms 00:28:39.943 00:28:39.943 --- 10.0.0.1 ping statistics --- 00:28:39.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:39.943 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:28:39.943 04:35:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:39.943 04:35:16 -- nvmf/common.sh@410 -- # return 0 00:28:39.943 04:35:16 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:39.943 04:35:16 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:40.880 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:40.880 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:40.880 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:40.880 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:40.880 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:40.880 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:40.880 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:40.880 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:40.880 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:40.880 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:40.880 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:40.880 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:40.880 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:40.880 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:40.880 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:40.880 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:40.880 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:41.140 04:35:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:41.140 04:35:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:41.140 04:35:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:41.140 04:35:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:41.140 04:35:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:41.140 04:35:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:41.140 04:35:18 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:41.140 04:35:18 -- target/dif.sh@137 -- # nvmfappstart 00:28:41.140 04:35:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:41.140 04:35:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:41.140 04:35:18 -- common/autotest_common.sh@10 -- # set +x 00:28:41.140 04:35:18 -- nvmf/common.sh@469 -- # nvmfpid=4028350 00:28:41.140 04:35:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:41.140 04:35:18 -- nvmf/common.sh@470 -- # waitforlisten 4028350 00:28:41.140 04:35:18 -- common/autotest_common.sh@829 -- # '[' -z 4028350 ']' 00:28:41.140 04:35:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:41.140 04:35:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:41.140 04:35:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:41.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:41.140 04:35:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:41.140 04:35:18 -- common/autotest_common.sh@10 -- # set +x 00:28:41.140 [2024-11-28 04:35:18.367452] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:41.140 [2024-11-28 04:35:18.367552] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:41.140 EAL: No free 2048 kB hugepages reported on node 1 00:28:41.140 [2024-11-28 04:35:18.432603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:41.401 [2024-11-28 04:35:18.545608] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:41.401 [2024-11-28 04:35:18.545765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:41.401 [2024-11-28 04:35:18.545782] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:41.401 [2024-11-28 04:35:18.545795] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:41.401 [2024-11-28 04:35:18.545821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:42.335 04:35:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:42.335 04:35:19 -- common/autotest_common.sh@862 -- # return 0 00:28:42.335 04:35:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:42.335 04:35:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:42.335 04:35:19 -- common/autotest_common.sh@10 -- # set +x 00:28:42.335 04:35:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:42.335 04:35:19 -- target/dif.sh@139 -- # create_transport 00:28:42.335 04:35:19 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:42.335 04:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.335 04:35:19 -- common/autotest_common.sh@10 -- # set +x 00:28:42.335 [2024-11-28 04:35:19.371756] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:42.335 04:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.335 04:35:19 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:42.335 04:35:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:42.335 04:35:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:42.335 04:35:19 -- common/autotest_common.sh@10 -- # set +x 00:28:42.335 ************************************ 00:28:42.335 START TEST fio_dif_1_default 00:28:42.335 ************************************ 00:28:42.335 04:35:19 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:42.335 04:35:19 -- target/dif.sh@86 -- # create_subsystems 0 00:28:42.335 04:35:19 -- target/dif.sh@28 -- # local sub 00:28:42.335 04:35:19 -- target/dif.sh@30 -- # for sub in "$@" 00:28:42.335 04:35:19 -- target/dif.sh@31 -- # create_subsystem 0 00:28:42.335 04:35:19 -- target/dif.sh@18 -- # local sub_id=0 00:28:42.335 04:35:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:42.335 04:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.335 04:35:19 -- common/autotest_common.sh@10 -- # set +x 00:28:42.335 bdev_null0 00:28:42.335 04:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.335 04:35:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:42.335 04:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.335 04:35:19 -- common/autotest_common.sh@10 -- # set +x 00:28:42.335 04:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.335 04:35:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:42.335 04:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.335 04:35:19 -- common/autotest_common.sh@10 -- # set +x 00:28:42.335 04:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.335 04:35:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:42.335 04:35:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.335 04:35:19 -- common/autotest_common.sh@10 -- # set +x 00:28:42.335 [2024-11-28 04:35:19.408068] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:42.335 04:35:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.335 04:35:19 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:42.335 04:35:19 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:42.335 04:35:19 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:42.335 04:35:19 -- nvmf/common.sh@520 -- # config=() 00:28:42.335 04:35:19 -- nvmf/common.sh@520 -- # local subsystem config 00:28:42.335 04:35:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:42.335 04:35:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:42.335 { 00:28:42.335 "params": { 00:28:42.335 "name": "Nvme$subsystem", 00:28:42.335 "trtype": "$TEST_TRANSPORT", 00:28:42.335 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:42.335 "adrfam": "ipv4", 00:28:42.335 "trsvcid": "$NVMF_PORT", 00:28:42.335 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:42.335 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:42.335 "hdgst": ${hdgst:-false}, 00:28:42.335 "ddgst": ${ddgst:-false} 00:28:42.335 }, 00:28:42.335 "method": "bdev_nvme_attach_controller" 00:28:42.335 } 00:28:42.335 EOF 00:28:42.335 )") 00:28:42.335 04:35:19 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:42.335 04:35:19 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:42.335 04:35:19 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:42.335 04:35:19 -- target/dif.sh@82 -- # gen_fio_conf 00:28:42.336 04:35:19 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:42.336 04:35:19 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:42.336 04:35:19 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:42.336 04:35:19 -- target/dif.sh@54 -- # local file 00:28:42.336 04:35:19 -- common/autotest_common.sh@1330 -- # shift 00:28:42.336 04:35:19 -- target/dif.sh@56 -- # cat 00:28:42.336 04:35:19 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:42.336 04:35:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:42.336 04:35:19 -- nvmf/common.sh@542 -- # cat 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:42.336 04:35:19 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:42.336 04:35:19 -- target/dif.sh@72 -- # (( file <= files )) 00:28:42.336 04:35:19 -- nvmf/common.sh@544 -- # jq . 00:28:42.336 04:35:19 -- nvmf/common.sh@545 -- # IFS=, 00:28:42.336 04:35:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:42.336 "params": { 00:28:42.336 "name": "Nvme0", 00:28:42.336 "trtype": "tcp", 00:28:42.336 "traddr": "10.0.0.2", 00:28:42.336 "adrfam": "ipv4", 00:28:42.336 "trsvcid": "4420", 00:28:42.336 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:42.336 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:42.336 "hdgst": false, 00:28:42.336 "ddgst": false 00:28:42.336 }, 00:28:42.336 "method": "bdev_nvme_attach_controller" 00:28:42.336 }' 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:42.336 04:35:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:42.336 04:35:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:42.336 04:35:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:42.336 04:35:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:42.336 04:35:19 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:42.336 04:35:19 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:42.594 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:42.594 fio-3.35 00:28:42.594 Starting 1 thread 00:28:42.594 EAL: No free 2048 kB hugepages reported on node 1 00:28:42.852 [2024-11-28 04:35:20.096313] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:42.852 [2024-11-28 04:35:20.096399] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:55.077 00:28:55.077 filename0: (groupid=0, jobs=1): err= 0: pid=4028597: Thu Nov 28 04:35:30 2024 00:28:55.077 read: IOPS=191, BW=765KiB/s (783kB/s)(7648KiB/10001msec) 00:28:55.077 slat (nsec): min=3718, max=53003, avg=9106.22, stdev=2418.84 00:28:55.077 clat (usec): min=602, max=41366, avg=20892.74, stdev=20278.49 00:28:55.077 lat (usec): min=610, max=41378, avg=20901.85, stdev=20278.41 00:28:55.077 clat percentiles (usec): 00:28:55.077 | 1.00th=[ 619], 5.00th=[ 644], 10.00th=[ 660], 20.00th=[ 685], 00:28:55.077 | 30.00th=[ 709], 40.00th=[ 717], 50.00th=[ 840], 60.00th=[41157], 00:28:55.077 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:55.077 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:28:55.077 | 99.99th=[41157] 00:28:55.077 bw ( KiB/s): min= 704, max= 768, per=99.91%, avg=764.63, stdev=14.68, samples=19 00:28:55.077 iops : min= 176, max= 192, avg=191.16, stdev= 3.67, samples=19 00:28:55.077 lat (usec) : 750=48.48%, 1000=1.52% 00:28:55.077 lat (msec) : 10=0.21%, 50=49.79% 00:28:55.077 cpu : usr=91.70%, sys=8.00%, ctx=30, majf=0, minf=256 00:28:55.077 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:55.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.077 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:55.077 issued rwts: total=1912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:55.077 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:55.077 00:28:55.077 Run status group 0 (all jobs): 00:28:55.077 READ: bw=765KiB/s (783kB/s), 765KiB/s-765KiB/s (783kB/s-783kB/s), io=7648KiB (7832kB), run=10001-10001msec 00:28:55.077 04:35:30 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:55.077 04:35:30 -- target/dif.sh@43 -- # local sub 00:28:55.077 04:35:30 -- target/dif.sh@45 -- # for sub in "$@" 00:28:55.077 04:35:30 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:55.077 04:35:30 -- target/dif.sh@36 -- # local sub_id=0 00:28:55.077 04:35:30 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:55.077 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.077 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.077 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.077 04:35:30 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:55.077 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.077 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.077 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.077 00:28:55.077 real 0m11.061s 00:28:55.077 user 0m10.330s 00:28:55.077 sys 0m1.077s 00:28:55.077 04:35:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:55.077 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.077 ************************************ 00:28:55.077 END TEST fio_dif_1_default 00:28:55.077 ************************************ 00:28:55.077 04:35:30 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:55.077 04:35:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:55.077 04:35:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:55.077 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.077 ************************************ 00:28:55.078 START TEST fio_dif_1_multi_subsystems 00:28:55.078 ************************************ 00:28:55.078 04:35:30 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:55.078 04:35:30 -- target/dif.sh@92 -- # local files=1 00:28:55.078 04:35:30 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:55.078 04:35:30 -- target/dif.sh@28 -- # local sub 00:28:55.078 04:35:30 -- target/dif.sh@30 -- # for sub in "$@" 00:28:55.078 04:35:30 -- target/dif.sh@31 -- # create_subsystem 0 00:28:55.078 04:35:30 -- target/dif.sh@18 -- # local sub_id=0 00:28:55.078 04:35:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 bdev_null0 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 [2024-11-28 04:35:30.492540] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@30 -- # for sub in "$@" 00:28:55.078 04:35:30 -- target/dif.sh@31 -- # create_subsystem 1 00:28:55.078 04:35:30 -- target/dif.sh@18 -- # local sub_id=1 00:28:55.078 04:35:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 bdev_null1 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:55.078 04:35:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.078 04:35:30 -- common/autotest_common.sh@10 -- # set +x 00:28:55.078 04:35:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.078 04:35:30 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:55.078 04:35:30 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:55.078 04:35:30 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:55.078 04:35:30 -- nvmf/common.sh@520 -- # config=() 00:28:55.078 04:35:30 -- nvmf/common.sh@520 -- # local subsystem config 00:28:55.078 04:35:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:55.078 04:35:30 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.078 04:35:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:55.078 { 00:28:55.078 "params": { 00:28:55.078 "name": "Nvme$subsystem", 00:28:55.078 "trtype": "$TEST_TRANSPORT", 00:28:55.078 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:55.078 "adrfam": "ipv4", 00:28:55.078 "trsvcid": "$NVMF_PORT", 00:28:55.078 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:55.078 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:55.078 "hdgst": ${hdgst:-false}, 00:28:55.078 "ddgst": ${ddgst:-false} 00:28:55.078 }, 00:28:55.078 "method": "bdev_nvme_attach_controller" 00:28:55.078 } 00:28:55.078 EOF 00:28:55.078 )") 00:28:55.078 04:35:30 -- target/dif.sh@82 -- # gen_fio_conf 00:28:55.078 04:35:30 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.078 04:35:30 -- target/dif.sh@54 -- # local file 00:28:55.078 04:35:30 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:55.078 04:35:30 -- target/dif.sh@56 -- # cat 00:28:55.078 04:35:30 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:55.078 04:35:30 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:55.078 04:35:30 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.078 04:35:30 -- common/autotest_common.sh@1330 -- # shift 00:28:55.078 04:35:30 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:55.078 04:35:30 -- nvmf/common.sh@542 -- # cat 00:28:55.078 04:35:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:55.078 04:35:30 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:55.078 04:35:30 -- target/dif.sh@72 -- # (( file <= files )) 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.078 04:35:30 -- target/dif.sh@73 -- # cat 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:55.078 04:35:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:55.078 04:35:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:55.078 { 00:28:55.078 "params": { 00:28:55.078 "name": "Nvme$subsystem", 00:28:55.078 "trtype": "$TEST_TRANSPORT", 00:28:55.078 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:55.078 "adrfam": "ipv4", 00:28:55.078 "trsvcid": "$NVMF_PORT", 00:28:55.078 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:55.078 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:55.078 "hdgst": ${hdgst:-false}, 00:28:55.078 "ddgst": ${ddgst:-false} 00:28:55.078 }, 00:28:55.078 "method": "bdev_nvme_attach_controller" 00:28:55.078 } 00:28:55.078 EOF 00:28:55.078 )") 00:28:55.078 04:35:30 -- nvmf/common.sh@542 -- # cat 00:28:55.078 04:35:30 -- target/dif.sh@72 -- # (( file++ )) 00:28:55.078 04:35:30 -- target/dif.sh@72 -- # (( file <= files )) 00:28:55.078 04:35:30 -- nvmf/common.sh@544 -- # jq . 00:28:55.078 04:35:30 -- nvmf/common.sh@545 -- # IFS=, 00:28:55.078 04:35:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:55.078 "params": { 00:28:55.078 "name": "Nvme0", 00:28:55.078 "trtype": "tcp", 00:28:55.078 "traddr": "10.0.0.2", 00:28:55.078 "adrfam": "ipv4", 00:28:55.078 "trsvcid": "4420", 00:28:55.078 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:55.078 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:55.078 "hdgst": false, 00:28:55.078 "ddgst": false 00:28:55.078 }, 00:28:55.078 "method": "bdev_nvme_attach_controller" 00:28:55.078 },{ 00:28:55.078 "params": { 00:28:55.078 "name": "Nvme1", 00:28:55.078 "trtype": "tcp", 00:28:55.078 "traddr": "10.0.0.2", 00:28:55.078 "adrfam": "ipv4", 00:28:55.078 "trsvcid": "4420", 00:28:55.078 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:55.078 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:55.078 "hdgst": false, 00:28:55.078 "ddgst": false 00:28:55.078 }, 00:28:55.078 "method": "bdev_nvme_attach_controller" 00:28:55.078 }' 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:55.078 04:35:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:55.078 04:35:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:55.078 04:35:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:55.078 04:35:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:55.078 04:35:30 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:55.078 04:35:30 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.078 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:55.078 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:55.078 fio-3.35 00:28:55.078 Starting 2 threads 00:28:55.078 EAL: No free 2048 kB hugepages reported on node 1 00:28:55.078 [2024-11-28 04:35:31.453965] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:55.078 [2024-11-28 04:35:31.454062] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:05.044 00:29:05.044 filename0: (groupid=0, jobs=1): err= 0: pid=4030036: Thu Nov 28 04:35:41 2024 00:29:05.044 read: IOPS=190, BW=760KiB/s (778kB/s)(7632KiB/10039msec) 00:29:05.044 slat (nsec): min=6911, max=59819, avg=8893.83, stdev=3090.00 00:29:05.044 clat (usec): min=611, max=42559, avg=21017.46, stdev=20304.97 00:29:05.044 lat (usec): min=619, max=42606, avg=21026.36, stdev=20304.76 00:29:05.044 clat percentiles (usec): 00:29:05.044 | 1.00th=[ 627], 5.00th=[ 644], 10.00th=[ 652], 20.00th=[ 660], 00:29:05.044 | 30.00th=[ 668], 40.00th=[ 685], 50.00th=[40633], 60.00th=[41157], 00:29:05.044 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:05.044 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42730], 99.95th=[42730], 00:29:05.044 | 99.99th=[42730] 00:29:05.044 bw ( KiB/s): min= 704, max= 768, per=66.32%, avg=761.60, stdev=19.70, samples=20 00:29:05.044 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:29:05.044 lat (usec) : 750=48.11%, 1000=1.10% 00:29:05.044 lat (msec) : 2=0.68%, 50=50.10% 00:29:05.044 cpu : usr=95.74%, sys=3.96%, ctx=21, majf=0, minf=237 00:29:05.044 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.044 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.044 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.044 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.044 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:05.044 filename1: (groupid=0, jobs=1): err= 0: pid=4030037: Thu Nov 28 04:35:41 2024 00:29:05.044 read: IOPS=97, BW=388KiB/s (398kB/s)(3888KiB/10010msec) 00:29:05.044 slat (nsec): min=6931, max=29178, avg=8956.62, stdev=2727.34 00:29:05.044 clat (usec): min=40763, max=42677, avg=41163.54, stdev=398.61 00:29:05.044 lat (usec): min=40770, max=42690, avg=41172.50, stdev=398.74 00:29:05.044 clat percentiles (usec): 00:29:05.044 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:05.044 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:05.044 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:29:05.044 | 99.00th=[42206], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:29:05.044 | 99.99th=[42730] 00:29:05.044 bw ( KiB/s): min= 384, max= 416, per=33.72%, avg=387.20, stdev= 9.85, samples=20 00:29:05.044 iops : min= 96, max= 104, avg=96.80, stdev= 2.46, samples=20 00:29:05.044 lat (msec) : 50=100.00% 00:29:05.044 cpu : usr=95.61%, sys=4.10%, ctx=13, majf=0, minf=108 00:29:05.044 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.044 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.044 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.044 issued rwts: total=972,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.044 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:05.044 00:29:05.044 Run status group 0 (all jobs): 00:29:05.044 READ: bw=1148KiB/s (1175kB/s), 388KiB/s-760KiB/s (398kB/s-778kB/s), io=11.2MiB (11.8MB), run=10010-10039msec 00:29:05.044 04:35:41 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:05.044 04:35:41 -- target/dif.sh@43 -- # local sub 00:29:05.044 04:35:41 -- target/dif.sh@45 -- # for sub in "$@" 00:29:05.044 04:35:41 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:05.044 04:35:41 -- target/dif.sh@36 -- # local sub_id=0 00:29:05.044 04:35:41 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:05.044 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.044 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.044 04:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.044 04:35:41 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:05.044 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.044 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.044 04:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.044 04:35:41 -- target/dif.sh@45 -- # for sub in "$@" 00:29:05.044 04:35:41 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:05.044 04:35:41 -- target/dif.sh@36 -- # local sub_id=1 00:29:05.044 04:35:41 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:05.044 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.044 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.044 04:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.044 04:35:41 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:05.044 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.044 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.044 04:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.044 00:29:05.044 real 0m11.482s 00:29:05.044 user 0m20.607s 00:29:05.044 sys 0m1.092s 00:29:05.044 04:35:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:05.044 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.044 ************************************ 00:29:05.044 END TEST fio_dif_1_multi_subsystems 00:29:05.044 ************************************ 00:29:05.044 04:35:41 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:05.044 04:35:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:05.044 04:35:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:05.044 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.044 ************************************ 00:29:05.044 START TEST fio_dif_rand_params 00:29:05.044 ************************************ 00:29:05.045 04:35:41 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:05.045 04:35:41 -- target/dif.sh@100 -- # local NULL_DIF 00:29:05.045 04:35:41 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:05.045 04:35:41 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:05.045 04:35:41 -- target/dif.sh@103 -- # bs=128k 00:29:05.045 04:35:41 -- target/dif.sh@103 -- # numjobs=3 00:29:05.045 04:35:41 -- target/dif.sh@103 -- # iodepth=3 00:29:05.045 04:35:41 -- target/dif.sh@103 -- # runtime=5 00:29:05.045 04:35:41 -- target/dif.sh@105 -- # create_subsystems 0 00:29:05.045 04:35:41 -- target/dif.sh@28 -- # local sub 00:29:05.045 04:35:41 -- target/dif.sh@30 -- # for sub in "$@" 00:29:05.045 04:35:41 -- target/dif.sh@31 -- # create_subsystem 0 00:29:05.045 04:35:41 -- target/dif.sh@18 -- # local sub_id=0 00:29:05.045 04:35:41 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:05.045 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.045 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.045 bdev_null0 00:29:05.045 04:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.045 04:35:41 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:05.045 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.045 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.045 04:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.045 04:35:41 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:05.045 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.045 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.045 04:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.045 04:35:41 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:05.045 04:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.045 04:35:41 -- common/autotest_common.sh@10 -- # set +x 00:29:05.045 [2024-11-28 04:35:41.999460] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:05.045 04:35:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.045 04:35:42 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:05.045 04:35:42 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:05.045 04:35:42 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:05.045 04:35:42 -- nvmf/common.sh@520 -- # config=() 00:29:05.045 04:35:42 -- nvmf/common.sh@520 -- # local subsystem config 00:29:05.045 04:35:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:05.045 04:35:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:05.045 { 00:29:05.045 "params": { 00:29:05.045 "name": "Nvme$subsystem", 00:29:05.045 "trtype": "$TEST_TRANSPORT", 00:29:05.045 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:05.045 "adrfam": "ipv4", 00:29:05.045 "trsvcid": "$NVMF_PORT", 00:29:05.045 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:05.045 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:05.045 "hdgst": ${hdgst:-false}, 00:29:05.045 "ddgst": ${ddgst:-false} 00:29:05.045 }, 00:29:05.045 "method": "bdev_nvme_attach_controller" 00:29:05.045 } 00:29:05.045 EOF 00:29:05.045 )") 00:29:05.045 04:35:42 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.045 04:35:42 -- target/dif.sh@82 -- # gen_fio_conf 00:29:05.045 04:35:42 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.045 04:35:42 -- target/dif.sh@54 -- # local file 00:29:05.045 04:35:42 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:05.045 04:35:42 -- target/dif.sh@56 -- # cat 00:29:05.045 04:35:42 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:05.045 04:35:42 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:05.045 04:35:42 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.045 04:35:42 -- common/autotest_common.sh@1330 -- # shift 00:29:05.045 04:35:42 -- nvmf/common.sh@542 -- # cat 00:29:05.045 04:35:42 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:05.045 04:35:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:05.045 04:35:42 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:05.045 04:35:42 -- target/dif.sh@72 -- # (( file <= files )) 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:05.045 04:35:42 -- nvmf/common.sh@544 -- # jq . 00:29:05.045 04:35:42 -- nvmf/common.sh@545 -- # IFS=, 00:29:05.045 04:35:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:05.045 "params": { 00:29:05.045 "name": "Nvme0", 00:29:05.045 "trtype": "tcp", 00:29:05.045 "traddr": "10.0.0.2", 00:29:05.045 "adrfam": "ipv4", 00:29:05.045 "trsvcid": "4420", 00:29:05.045 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:05.045 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:05.045 "hdgst": false, 00:29:05.045 "ddgst": false 00:29:05.045 }, 00:29:05.045 "method": "bdev_nvme_attach_controller" 00:29:05.045 }' 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.045 04:35:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.045 04:35:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:05.045 04:35:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.045 04:35:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.045 04:35:42 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:05.045 04:35:42 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.045 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:05.045 ... 00:29:05.045 fio-3.35 00:29:05.045 Starting 3 threads 00:29:05.045 EAL: No free 2048 kB hugepages reported on node 1 00:29:05.611 [2024-11-28 04:35:42.706626] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:05.611 [2024-11-28 04:35:42.706701] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:10.892 00:29:10.892 filename0: (groupid=0, jobs=1): err= 0: pid=4031491: Thu Nov 28 04:35:47 2024 00:29:10.892 read: IOPS=162, BW=20.3MiB/s (21.3MB/s)(103MiB/5048msec) 00:29:10.892 slat (nsec): min=7077, max=82488, avg=11871.12, stdev=3606.88 00:29:10.892 clat (usec): min=4730, max=92756, avg=18426.20, stdev=16099.94 00:29:10.892 lat (usec): min=4741, max=92763, avg=18438.07, stdev=16099.98 00:29:10.892 clat percentiles (usec): 00:29:10.892 | 1.00th=[ 5211], 5.00th=[ 5407], 10.00th=[ 6390], 20.00th=[ 8291], 00:29:10.892 | 30.00th=[ 9896], 40.00th=[11469], 50.00th=[13173], 60.00th=[14222], 00:29:10.892 | 70.00th=[15533], 80.00th=[17695], 90.00th=[51643], 95.00th=[54264], 00:29:10.892 | 99.00th=[56361], 99.50th=[56886], 99.90th=[92799], 99.95th=[92799], 00:29:10.892 | 99.99th=[92799] 00:29:10.892 bw ( KiB/s): min=14080, max=25600, per=29.89%, avg=20940.80, stdev=4153.90, samples=10 00:29:10.892 iops : min= 110, max= 200, avg=163.60, stdev=32.45, samples=10 00:29:10.892 lat (msec) : 10=30.33%, 20=53.11%, 50=4.63%, 100=11.94% 00:29:10.892 cpu : usr=93.86%, sys=5.69%, ctx=9, majf=0, minf=139 00:29:10.892 IO depths : 1=2.2%, 2=97.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.892 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.892 issued rwts: total=821,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.892 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:10.892 filename0: (groupid=0, jobs=1): err= 0: pid=4031492: Thu Nov 28 04:35:47 2024 00:29:10.892 read: IOPS=207, BW=25.9MiB/s (27.1MB/s)(130MiB/5009msec) 00:29:10.892 slat (nsec): min=7047, max=40280, avg=12079.40, stdev=2319.85 00:29:10.892 clat (usec): min=4549, max=93156, avg=14475.22, stdev=11691.52 00:29:10.892 lat (usec): min=4561, max=93168, avg=14487.30, stdev=11691.52 00:29:10.892 clat percentiles (usec): 00:29:10.892 | 1.00th=[ 4817], 5.00th=[ 5211], 10.00th=[ 5473], 20.00th=[ 6652], 00:29:10.892 | 30.00th=[ 8717], 40.00th=[10290], 50.00th=[11994], 60.00th=[13566], 00:29:10.892 | 70.00th=[15008], 80.00th=[16909], 90.00th=[19268], 95.00th=[50070], 00:29:10.892 | 99.00th=[54789], 99.50th=[55837], 99.90th=[56886], 99.95th=[92799], 00:29:10.892 | 99.99th=[92799] 00:29:10.892 bw ( KiB/s): min=19968, max=37120, per=37.79%, avg=26475.40, stdev=4681.94, samples=10 00:29:10.892 iops : min= 156, max= 290, avg=206.80, stdev=36.59, samples=10 00:29:10.892 lat (msec) : 10=38.19%, 20=53.23%, 50=3.38%, 100=5.21% 00:29:10.892 cpu : usr=93.49%, sys=6.07%, ctx=14, majf=0, minf=119 00:29:10.892 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.892 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.892 issued rwts: total=1037,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.892 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:10.892 filename0: (groupid=0, jobs=1): err= 0: pid=4031493: Thu Nov 28 04:35:47 2024 00:29:10.892 read: IOPS=179, BW=22.4MiB/s (23.5MB/s)(113MiB/5048msec) 00:29:10.892 slat (nsec): min=7085, max=33286, avg=11593.94, stdev=1994.48 00:29:10.892 clat (usec): min=5411, max=56946, avg=16672.80, stdev=14016.93 00:29:10.892 lat (usec): min=5423, max=56957, avg=16684.39, stdev=14017.11 00:29:10.892 clat percentiles (usec): 00:29:10.892 | 1.00th=[ 6128], 5.00th=[ 6456], 10.00th=[ 7373], 20.00th=[ 9634], 00:29:10.892 | 30.00th=[10290], 40.00th=[11076], 50.00th=[12256], 60.00th=[13042], 00:29:10.892 | 70.00th=[13698], 80.00th=[14615], 90.00th=[50594], 95.00th=[52691], 00:29:10.892 | 99.00th=[54789], 99.50th=[56361], 99.90th=[56886], 99.95th=[56886], 00:29:10.892 | 99.99th=[56886] 00:29:10.892 bw ( KiB/s): min=17664, max=33792, per=32.96%, avg=23091.20, stdev=4901.73, samples=10 00:29:10.892 iops : min= 138, max= 264, avg=180.40, stdev=38.29, samples=10 00:29:10.892 lat (msec) : 10=25.19%, 20=61.66%, 50=2.54%, 100=10.61% 00:29:10.892 cpu : usr=93.48%, sys=6.08%, ctx=12, majf=0, minf=148 00:29:10.892 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:10.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.892 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:10.892 issued rwts: total=905,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:10.892 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:10.892 00:29:10.892 Run status group 0 (all jobs): 00:29:10.892 READ: bw=68.4MiB/s (71.7MB/s), 20.3MiB/s-25.9MiB/s (21.3MB/s-27.1MB/s), io=345MiB (362MB), run=5009-5048msec 00:29:10.892 04:35:48 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:10.892 04:35:48 -- target/dif.sh@43 -- # local sub 00:29:10.892 04:35:48 -- target/dif.sh@45 -- # for sub in "$@" 00:29:10.892 04:35:48 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:10.892 04:35:48 -- target/dif.sh@36 -- # local sub_id=0 00:29:10.892 04:35:48 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:10.892 04:35:48 -- target/dif.sh@109 -- # bs=4k 00:29:10.892 04:35:48 -- target/dif.sh@109 -- # numjobs=8 00:29:10.892 04:35:48 -- target/dif.sh@109 -- # iodepth=16 00:29:10.892 04:35:48 -- target/dif.sh@109 -- # runtime= 00:29:10.892 04:35:48 -- target/dif.sh@109 -- # files=2 00:29:10.892 04:35:48 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:10.892 04:35:48 -- target/dif.sh@28 -- # local sub 00:29:10.892 04:35:48 -- target/dif.sh@30 -- # for sub in "$@" 00:29:10.892 04:35:48 -- target/dif.sh@31 -- # create_subsystem 0 00:29:10.892 04:35:48 -- target/dif.sh@18 -- # local sub_id=0 00:29:10.892 04:35:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 bdev_null0 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 [2024-11-28 04:35:48.139904] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@30 -- # for sub in "$@" 00:29:10.892 04:35:48 -- target/dif.sh@31 -- # create_subsystem 1 00:29:10.892 04:35:48 -- target/dif.sh@18 -- # local sub_id=1 00:29:10.892 04:35:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 bdev_null1 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.892 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.892 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.892 04:35:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:10.892 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.893 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.893 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.893 04:35:48 -- target/dif.sh@30 -- # for sub in "$@" 00:29:10.893 04:35:48 -- target/dif.sh@31 -- # create_subsystem 2 00:29:10.893 04:35:48 -- target/dif.sh@18 -- # local sub_id=2 00:29:10.893 04:35:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:10.893 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.893 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.893 bdev_null2 00:29:10.893 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.893 04:35:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:10.893 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.893 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.893 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.893 04:35:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:10.893 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.893 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:10.893 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.893 04:35:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:10.893 04:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.893 04:35:48 -- common/autotest_common.sh@10 -- # set +x 00:29:11.153 04:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.153 04:35:48 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:11.153 04:35:48 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:11.153 04:35:48 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:11.153 04:35:48 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:11.153 04:35:48 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:11.153 04:35:48 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:11.153 04:35:48 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:11.153 04:35:48 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:11.153 04:35:48 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:11.153 04:35:48 -- common/autotest_common.sh@1330 -- # shift 00:29:11.153 04:35:48 -- target/dif.sh@82 -- # gen_fio_conf 00:29:11.153 04:35:48 -- nvmf/common.sh@520 -- # config=() 00:29:11.153 04:35:48 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:11.153 04:35:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:11.153 04:35:48 -- target/dif.sh@54 -- # local file 00:29:11.153 04:35:48 -- nvmf/common.sh@520 -- # local subsystem config 00:29:11.153 04:35:48 -- target/dif.sh@56 -- # cat 00:29:11.153 04:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:11.153 04:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:11.153 { 00:29:11.153 "params": { 00:29:11.153 "name": "Nvme$subsystem", 00:29:11.153 "trtype": "$TEST_TRANSPORT", 00:29:11.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:11.153 "adrfam": "ipv4", 00:29:11.153 "trsvcid": "$NVMF_PORT", 00:29:11.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:11.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:11.153 "hdgst": ${hdgst:-false}, 00:29:11.153 "ddgst": ${ddgst:-false} 00:29:11.153 }, 00:29:11.153 "method": "bdev_nvme_attach_controller" 00:29:11.153 } 00:29:11.153 EOF 00:29:11.153 )") 00:29:11.153 04:35:48 -- nvmf/common.sh@542 -- # cat 00:29:11.153 04:35:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:11.153 04:35:48 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:11.153 04:35:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:11.153 04:35:48 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:11.153 04:35:48 -- target/dif.sh@72 -- # (( file <= files )) 00:29:11.153 04:35:48 -- target/dif.sh@73 -- # cat 00:29:11.153 04:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:11.153 04:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:11.153 { 00:29:11.153 "params": { 00:29:11.153 "name": "Nvme$subsystem", 00:29:11.153 "trtype": "$TEST_TRANSPORT", 00:29:11.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:11.153 "adrfam": "ipv4", 00:29:11.153 "trsvcid": "$NVMF_PORT", 00:29:11.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:11.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:11.153 "hdgst": ${hdgst:-false}, 00:29:11.153 "ddgst": ${ddgst:-false} 00:29:11.153 }, 00:29:11.153 "method": "bdev_nvme_attach_controller" 00:29:11.153 } 00:29:11.153 EOF 00:29:11.153 )") 00:29:11.153 04:35:48 -- target/dif.sh@72 -- # (( file++ )) 00:29:11.153 04:35:48 -- target/dif.sh@72 -- # (( file <= files )) 00:29:11.153 04:35:48 -- target/dif.sh@73 -- # cat 00:29:11.153 04:35:48 -- nvmf/common.sh@542 -- # cat 00:29:11.153 04:35:48 -- target/dif.sh@72 -- # (( file++ )) 00:29:11.153 04:35:48 -- target/dif.sh@72 -- # (( file <= files )) 00:29:11.153 04:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:11.153 04:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:11.153 { 00:29:11.153 "params": { 00:29:11.153 "name": "Nvme$subsystem", 00:29:11.153 "trtype": "$TEST_TRANSPORT", 00:29:11.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:11.153 "adrfam": "ipv4", 00:29:11.153 "trsvcid": "$NVMF_PORT", 00:29:11.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:11.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:11.153 "hdgst": ${hdgst:-false}, 00:29:11.153 "ddgst": ${ddgst:-false} 00:29:11.153 }, 00:29:11.153 "method": "bdev_nvme_attach_controller" 00:29:11.153 } 00:29:11.153 EOF 00:29:11.153 )") 00:29:11.153 04:35:48 -- nvmf/common.sh@542 -- # cat 00:29:11.153 04:35:48 -- nvmf/common.sh@544 -- # jq . 00:29:11.153 04:35:48 -- nvmf/common.sh@545 -- # IFS=, 00:29:11.153 04:35:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:11.153 "params": { 00:29:11.153 "name": "Nvme0", 00:29:11.153 "trtype": "tcp", 00:29:11.153 "traddr": "10.0.0.2", 00:29:11.153 "adrfam": "ipv4", 00:29:11.153 "trsvcid": "4420", 00:29:11.153 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:11.153 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:11.153 "hdgst": false, 00:29:11.153 "ddgst": false 00:29:11.153 }, 00:29:11.153 "method": "bdev_nvme_attach_controller" 00:29:11.153 },{ 00:29:11.153 "params": { 00:29:11.153 "name": "Nvme1", 00:29:11.153 "trtype": "tcp", 00:29:11.153 "traddr": "10.0.0.2", 00:29:11.154 "adrfam": "ipv4", 00:29:11.154 "trsvcid": "4420", 00:29:11.154 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:11.154 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:11.154 "hdgst": false, 00:29:11.154 "ddgst": false 00:29:11.154 }, 00:29:11.154 "method": "bdev_nvme_attach_controller" 00:29:11.154 },{ 00:29:11.154 "params": { 00:29:11.154 "name": "Nvme2", 00:29:11.154 "trtype": "tcp", 00:29:11.154 "traddr": "10.0.0.2", 00:29:11.154 "adrfam": "ipv4", 00:29:11.154 "trsvcid": "4420", 00:29:11.154 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:11.154 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:11.154 "hdgst": false, 00:29:11.154 "ddgst": false 00:29:11.154 }, 00:29:11.154 "method": "bdev_nvme_attach_controller" 00:29:11.154 }' 00:29:11.154 04:35:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:11.154 04:35:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:11.154 04:35:48 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:11.154 04:35:48 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:11.154 04:35:48 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:11.154 04:35:48 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:11.154 04:35:48 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:11.154 04:35:48 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:11.154 04:35:48 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:11.154 04:35:48 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:11.411 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:11.411 ... 00:29:11.411 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:11.411 ... 00:29:11.411 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:11.411 ... 00:29:11.411 fio-3.35 00:29:11.411 Starting 24 threads 00:29:11.411 EAL: No free 2048 kB hugepages reported on node 1 00:29:12.345 [2024-11-28 04:35:49.364783] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:12.345 [2024-11-28 04:35:49.364837] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:22.322 00:29:22.322 filename0: (groupid=0, jobs=1): err= 0: pid=4032380: Thu Nov 28 04:35:59 2024 00:29:22.322 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10014msec) 00:29:22.322 slat (usec): min=9, max=148, avg=47.69, stdev=16.26 00:29:22.322 clat (usec): min=21594, max=45194, avg=31450.74, stdev=1070.50 00:29:22.322 lat (usec): min=21628, max=45210, avg=31498.43, stdev=1070.47 00:29:22.322 clat percentiles (usec): 00:29:22.322 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.322 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.322 | 70.00th=[31589], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:22.322 | 99.00th=[33424], 99.50th=[34341], 99.90th=[45351], 99.95th=[45351], 00:29:22.322 | 99.99th=[45351] 00:29:22.322 bw ( KiB/s): min= 1920, max= 2048, per=4.15%, avg=2003.20, stdev=62.64, samples=20 00:29:22.322 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:22.322 lat (msec) : 50=100.00% 00:29:22.322 cpu : usr=97.04%, sys=1.78%, ctx=208, majf=0, minf=57 00:29:22.322 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:22.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.322 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.322 filename0: (groupid=0, jobs=1): err= 0: pid=4032381: Thu Nov 28 04:35:59 2024 00:29:22.322 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10014msec) 00:29:22.322 slat (usec): min=8, max=132, avg=46.88, stdev=17.05 00:29:22.322 clat (usec): min=21621, max=45106, avg=31493.96, stdev=1027.39 00:29:22.322 lat (usec): min=21658, max=45120, avg=31540.84, stdev=1025.72 00:29:22.322 clat percentiles (usec): 00:29:22.322 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:22.322 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.322 | 70.00th=[31589], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:22.322 | 99.00th=[33424], 99.50th=[33817], 99.90th=[44827], 99.95th=[44827], 00:29:22.322 | 99.99th=[45351] 00:29:22.322 bw ( KiB/s): min= 1920, max= 2048, per=4.15%, avg=2003.20, stdev=62.64, samples=20 00:29:22.322 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:22.322 lat (msec) : 50=100.00% 00:29:22.322 cpu : usr=98.50%, sys=0.99%, ctx=70, majf=0, minf=47 00:29:22.322 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:22.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.322 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.322 filename0: (groupid=0, jobs=1): err= 0: pid=4032382: Thu Nov 28 04:35:59 2024 00:29:22.322 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10007msec) 00:29:22.322 slat (usec): min=9, max=119, avg=50.10, stdev=15.58 00:29:22.322 clat (usec): min=21473, max=72163, avg=31503.86, stdev=2251.56 00:29:22.322 lat (usec): min=21510, max=72233, avg=31553.97, stdev=2252.67 00:29:22.322 clat percentiles (usec): 00:29:22.322 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.322 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:29:22.322 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:22.322 | 99.00th=[33817], 99.50th=[35390], 99.90th=[68682], 99.95th=[68682], 00:29:22.322 | 99.99th=[71828] 00:29:22.322 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:22.322 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:22.322 lat (msec) : 50=99.68%, 100=0.32% 00:29:22.322 cpu : usr=98.77%, sys=0.84%, ctx=14, majf=0, minf=40 00:29:22.322 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:22.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.322 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.322 filename0: (groupid=0, jobs=1): err= 0: pid=4032383: Thu Nov 28 04:35:59 2024 00:29:22.322 read: IOPS=506, BW=2024KiB/s (2073kB/s)(19.8MiB/10017msec) 00:29:22.322 slat (usec): min=3, max=165, avg=32.92, stdev=25.19 00:29:22.322 clat (usec): min=9097, max=42105, avg=31368.75, stdev=2169.62 00:29:22.322 lat (usec): min=9192, max=42117, avg=31401.67, stdev=2168.40 00:29:22.322 clat percentiles (usec): 00:29:22.322 | 1.00th=[17957], 5.00th=[30278], 10.00th=[31065], 20.00th=[31327], 00:29:22.322 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:22.322 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:29:22.322 | 99.00th=[33817], 99.50th=[34866], 99.90th=[39060], 99.95th=[39060], 00:29:22.322 | 99.99th=[42206] 00:29:22.322 bw ( KiB/s): min= 1920, max= 2104, per=4.19%, avg=2021.20, stdev=61.98, samples=20 00:29:22.322 iops : min= 480, max= 526, avg=505.30, stdev=15.50, samples=20 00:29:22.322 lat (msec) : 10=0.18%, 20=1.42%, 50=98.40% 00:29:22.322 cpu : usr=98.35%, sys=1.21%, ctx=16, majf=0, minf=95 00:29:22.322 IO depths : 1=3.5%, 2=9.1%, 4=22.4%, 8=56.0%, 16=9.0%, 32=0.0%, >=64=0.0% 00:29:22.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 complete : 0=0.0%, 4=93.6%, 8=0.6%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 issued rwts: total=5069,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.322 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.322 filename0: (groupid=0, jobs=1): err= 0: pid=4032384: Thu Nov 28 04:35:59 2024 00:29:22.322 read: IOPS=503, BW=2013KiB/s (2061kB/s)(19.7MiB/10017msec) 00:29:22.322 slat (usec): min=8, max=269, avg=29.25, stdev=16.13 00:29:22.322 clat (usec): min=19116, max=40379, avg=31556.12, stdev=1006.61 00:29:22.322 lat (usec): min=19125, max=40452, avg=31585.37, stdev=1007.24 00:29:22.322 clat percentiles (usec): 00:29:22.322 | 1.00th=[30278], 5.00th=[31065], 10.00th=[31327], 20.00th=[31327], 00:29:22.322 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:22.322 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:22.322 | 99.00th=[33424], 99.50th=[34341], 99.90th=[35390], 99.95th=[35914], 00:29:22.322 | 99.99th=[40633] 00:29:22.322 bw ( KiB/s): min= 1920, max= 2052, per=4.17%, avg=2009.80, stdev=60.32, samples=20 00:29:22.322 iops : min= 480, max= 513, avg=502.45, stdev=15.08, samples=20 00:29:22.322 lat (msec) : 20=0.32%, 50=99.68% 00:29:22.322 cpu : usr=96.04%, sys=2.19%, ctx=178, majf=0, minf=68 00:29:22.322 IO depths : 1=6.0%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:22.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.322 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.322 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.322 filename0: (groupid=0, jobs=1): err= 0: pid=4032385: Thu Nov 28 04:35:59 2024 00:29:22.322 read: IOPS=501, BW=2008KiB/s (2056kB/s)(19.6MiB/10008msec) 00:29:22.322 slat (usec): min=12, max=128, avg=47.45, stdev=14.59 00:29:22.322 clat (usec): min=13480, max=59689, avg=31427.56, stdev=1990.31 00:29:22.322 lat (usec): min=13519, max=59722, avg=31475.01, stdev=1990.86 00:29:22.322 clat percentiles (usec): 00:29:22.322 | 1.00th=[30802], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:22.322 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.322 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:22.322 | 99.00th=[33162], 99.50th=[33817], 99.90th=[59507], 99.95th=[59507], 00:29:22.322 | 99.99th=[59507] 00:29:22.322 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:22.322 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:22.322 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:22.322 cpu : usr=98.74%, sys=0.86%, ctx=20, majf=0, minf=54 00:29:22.323 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename0: (groupid=0, jobs=1): err= 0: pid=4032386: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=503, BW=2013KiB/s (2061kB/s)(19.7MiB/10015msec) 00:29:22.323 slat (usec): min=7, max=190, avg=43.90, stdev=31.70 00:29:22.323 clat (usec): min=18665, max=36247, avg=31359.75, stdev=905.77 00:29:22.323 lat (usec): min=18673, max=36292, avg=31403.65, stdev=908.73 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.323 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.323 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:22.323 | 99.00th=[33162], 99.50th=[33817], 99.90th=[34341], 99.95th=[34341], 00:29:22.323 | 99.99th=[36439] 00:29:22.323 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2009.60, stdev=60.18, samples=20 00:29:22.323 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:22.323 lat (msec) : 20=0.32%, 50=99.68% 00:29:22.323 cpu : usr=97.35%, sys=1.71%, ctx=74, majf=0, minf=51 00:29:22.323 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename0: (groupid=0, jobs=1): err= 0: pid=4032387: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=501, BW=2008KiB/s (2056kB/s)(19.6MiB/10009msec) 00:29:22.323 slat (usec): min=7, max=208, avg=53.71, stdev=29.68 00:29:22.323 clat (usec): min=2869, max=59382, avg=31403.83, stdev=3603.18 00:29:22.323 lat (usec): min=2877, max=59410, avg=31457.54, stdev=3606.52 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[21103], 5.00th=[24249], 10.00th=[30802], 20.00th=[31065], 00:29:22.323 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:29:22.323 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[38536], 00:29:22.323 | 99.00th=[42206], 99.50th=[42730], 99.90th=[58983], 99.95th=[59507], 00:29:22.323 | 99.99th=[59507] 00:29:22.323 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.00, stdev=71.95, samples=19 00:29:22.323 iops : min= 448, max= 512, avg=500.00, stdev=17.99, samples=19 00:29:22.323 lat (msec) : 4=0.04%, 20=0.36%, 50=99.24%, 100=0.36% 00:29:22.323 cpu : usr=98.68%, sys=0.90%, ctx=17, majf=0, minf=54 00:29:22.323 IO depths : 1=0.9%, 2=7.2%, 4=25.0%, 8=55.3%, 16=11.6%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename1: (groupid=0, jobs=1): err= 0: pid=4032388: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=501, BW=2008KiB/s (2056kB/s)(19.6MiB/10008msec) 00:29:22.323 slat (usec): min=10, max=187, avg=46.82, stdev=19.65 00:29:22.323 clat (usec): min=13490, max=59167, avg=31407.54, stdev=1973.43 00:29:22.323 lat (usec): min=13512, max=59212, avg=31454.35, stdev=1974.60 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:22.323 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.323 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:22.323 | 99.00th=[32900], 99.50th=[33817], 99.90th=[58983], 99.95th=[58983], 00:29:22.323 | 99.99th=[58983] 00:29:22.323 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:22.323 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:22.323 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:22.323 cpu : usr=96.88%, sys=1.74%, ctx=138, majf=0, minf=58 00:29:22.323 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename1: (groupid=0, jobs=1): err= 0: pid=4032389: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=500, BW=2001KiB/s (2049kB/s)(19.6MiB/10011msec) 00:29:22.323 slat (usec): min=5, max=110, avg=46.15, stdev=15.78 00:29:22.323 clat (usec): min=21562, max=76075, avg=31579.23, stdev=2483.42 00:29:22.323 lat (usec): min=21597, max=76087, avg=31625.39, stdev=2480.88 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:22.323 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.323 | 70.00th=[31589], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:22.323 | 99.00th=[33817], 99.50th=[37487], 99.90th=[72877], 99.95th=[72877], 00:29:22.323 | 99.99th=[76022] 00:29:22.323 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=1994.11, stdev=77.69, samples=19 00:29:22.323 iops : min= 448, max= 512, avg=498.53, stdev=19.42, samples=19 00:29:22.323 lat (msec) : 50=99.68%, 100=0.32% 00:29:22.323 cpu : usr=96.84%, sys=1.84%, ctx=38, majf=0, minf=51 00:29:22.323 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename1: (groupid=0, jobs=1): err= 0: pid=4032390: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=504, BW=2019KiB/s (2067kB/s)(19.8MiB/10017msec) 00:29:22.323 slat (usec): min=6, max=137, avg=31.51, stdev=16.75 00:29:22.323 clat (usec): min=7542, max=38876, avg=31417.06, stdev=1846.05 00:29:22.323 lat (usec): min=7549, max=38899, avg=31448.57, stdev=1847.13 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[25297], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:22.323 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:22.323 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32375], 00:29:22.323 | 99.00th=[33817], 99.50th=[33817], 99.90th=[39060], 99.95th=[39060], 00:29:22.323 | 99.99th=[39060] 00:29:22.323 bw ( KiB/s): min= 1920, max= 2176, per=4.18%, avg=2016.00, stdev=69.06, samples=20 00:29:22.323 iops : min= 480, max= 544, avg=504.00, stdev=17.27, samples=20 00:29:22.323 lat (msec) : 10=0.32%, 20=0.32%, 50=99.37% 00:29:22.323 cpu : usr=95.34%, sys=2.75%, ctx=403, majf=0, minf=67 00:29:22.323 IO depths : 1=5.7%, 2=11.8%, 4=24.6%, 8=51.0%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename1: (groupid=0, jobs=1): err= 0: pid=4032391: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10014msec) 00:29:22.323 slat (usec): min=7, max=211, avg=53.91, stdev=21.26 00:29:22.323 clat (usec): min=21368, max=45260, avg=31387.02, stdev=1055.54 00:29:22.323 lat (usec): min=21411, max=45272, avg=31440.92, stdev=1055.67 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.323 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:29:22.323 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:22.323 | 99.00th=[33424], 99.50th=[33817], 99.90th=[45351], 99.95th=[45351], 00:29:22.323 | 99.99th=[45351] 00:29:22.323 bw ( KiB/s): min= 1920, max= 2048, per=4.15%, avg=2003.20, stdev=62.64, samples=20 00:29:22.323 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:22.323 lat (msec) : 50=100.00% 00:29:22.323 cpu : usr=98.70%, sys=0.88%, ctx=26, majf=0, minf=57 00:29:22.323 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename1: (groupid=0, jobs=1): err= 0: pid=4032392: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=503, BW=2014KiB/s (2062kB/s)(19.7MiB/10010msec) 00:29:22.323 slat (usec): min=12, max=163, avg=49.33, stdev=26.35 00:29:22.323 clat (usec): min=8158, max=60941, avg=31313.43, stdev=2275.98 00:29:22.323 lat (usec): min=8174, max=60977, avg=31362.76, stdev=2275.68 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[22152], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:29:22.323 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.323 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:22.323 | 99.00th=[33162], 99.50th=[34866], 99.90th=[57410], 99.95th=[57410], 00:29:22.323 | 99.99th=[61080] 00:29:22.323 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2007.58, stdev=74.55, samples=19 00:29:22.323 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:29:22.323 lat (msec) : 10=0.20%, 20=0.56%, 50=98.93%, 100=0.32% 00:29:22.323 cpu : usr=96.40%, sys=1.99%, ctx=113, majf=0, minf=52 00:29:22.323 IO depths : 1=6.1%, 2=12.3%, 4=24.7%, 8=50.5%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:22.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.323 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.323 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.323 filename1: (groupid=0, jobs=1): err= 0: pid=4032393: Thu Nov 28 04:35:59 2024 00:29:22.323 read: IOPS=503, BW=2013KiB/s (2061kB/s)(19.7MiB/10017msec) 00:29:22.323 slat (nsec): min=7888, max=85284, avg=27598.60, stdev=10491.62 00:29:22.323 clat (usec): min=19119, max=35251, avg=31561.08, stdev=1001.05 00:29:22.323 lat (usec): min=19128, max=35311, avg=31588.67, stdev=1001.37 00:29:22.323 clat percentiles (usec): 00:29:22.323 | 1.00th=[30016], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:22.324 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:22.324 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32375], 00:29:22.324 | 99.00th=[33817], 99.50th=[34341], 99.90th=[34341], 99.95th=[34341], 00:29:22.324 | 99.99th=[35390] 00:29:22.324 bw ( KiB/s): min= 1920, max= 2052, per=4.17%, avg=2009.80, stdev=60.32, samples=20 00:29:22.324 iops : min= 480, max= 513, avg=502.45, stdev=15.08, samples=20 00:29:22.324 lat (msec) : 20=0.32%, 50=99.68% 00:29:22.324 cpu : usr=98.32%, sys=1.20%, ctx=57, majf=0, minf=50 00:29:22.324 IO depths : 1=5.0%, 2=11.2%, 4=24.9%, 8=51.4%, 16=7.5%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.324 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.324 filename1: (groupid=0, jobs=1): err= 0: pid=4032394: Thu Nov 28 04:35:59 2024 00:29:22.324 read: IOPS=501, BW=2008KiB/s (2056kB/s)(19.6MiB/10008msec) 00:29:22.324 slat (nsec): min=12616, max=97033, avg=43834.24, stdev=11900.75 00:29:22.324 clat (usec): min=13474, max=59345, avg=31463.61, stdev=1974.77 00:29:22.324 lat (usec): min=13504, max=59384, avg=31507.45, stdev=1975.00 00:29:22.324 clat percentiles (usec): 00:29:22.324 | 1.00th=[30802], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:22.324 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.324 | 70.00th=[31589], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:22.324 | 99.00th=[33162], 99.50th=[33817], 99.90th=[58983], 99.95th=[59507], 00:29:22.324 | 99.99th=[59507] 00:29:22.324 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:22.324 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:22.324 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:22.324 cpu : usr=98.71%, sys=0.88%, ctx=17, majf=0, minf=46 00:29:22.324 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.324 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.324 filename1: (groupid=0, jobs=1): err= 0: pid=4032395: Thu Nov 28 04:35:59 2024 00:29:22.324 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10013msec) 00:29:22.324 slat (usec): min=8, max=129, avg=43.42, stdev=19.25 00:29:22.324 clat (usec): min=20535, max=45031, avg=31496.86, stdev=1066.03 00:29:22.324 lat (usec): min=20563, max=45059, avg=31540.29, stdev=1064.98 00:29:22.324 clat percentiles (usec): 00:29:22.324 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.324 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:22.324 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:22.324 | 99.00th=[33424], 99.50th=[34341], 99.90th=[44827], 99.95th=[44827], 00:29:22.324 | 99.99th=[44827] 00:29:22.324 bw ( KiB/s): min= 1920, max= 2048, per=4.15%, avg=2003.20, stdev=62.64, samples=20 00:29:22.324 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:22.324 lat (msec) : 50=100.00% 00:29:22.324 cpu : usr=95.59%, sys=2.39%, ctx=165, majf=0, minf=53 00:29:22.324 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.324 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.324 filename2: (groupid=0, jobs=1): err= 0: pid=4032396: Thu Nov 28 04:35:59 2024 00:29:22.324 read: IOPS=501, BW=2007KiB/s (2056kB/s)(19.6MiB/10011msec) 00:29:22.324 slat (usec): min=8, max=153, avg=51.08, stdev=17.30 00:29:22.324 clat (usec): min=13596, max=58030, avg=31408.89, stdev=1995.64 00:29:22.324 lat (usec): min=13629, max=58070, avg=31459.97, stdev=1996.60 00:29:22.324 clat percentiles (usec): 00:29:22.324 | 1.00th=[26870], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.324 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.324 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:22.324 | 99.00th=[35390], 99.50th=[35914], 99.90th=[57934], 99.95th=[57934], 00:29:22.324 | 99.99th=[57934] 00:29:22.324 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:22.324 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:22.324 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:22.324 cpu : usr=98.59%, sys=1.01%, ctx=21, majf=0, minf=46 00:29:22.324 IO depths : 1=5.5%, 2=11.7%, 4=24.9%, 8=50.9%, 16=7.0%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.324 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.324 filename2: (groupid=0, jobs=1): err= 0: pid=4032397: Thu Nov 28 04:35:59 2024 00:29:22.324 read: IOPS=504, BW=2019KiB/s (2067kB/s)(19.8MiB/10019msec) 00:29:22.324 slat (usec): min=4, max=212, avg=41.21, stdev=28.24 00:29:22.324 clat (usec): min=7236, max=34242, avg=31332.43, stdev=1842.55 00:29:22.324 lat (usec): min=7241, max=34332, avg=31373.64, stdev=1843.78 00:29:22.324 clat percentiles (usec): 00:29:22.324 | 1.00th=[28967], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.324 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:22.324 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:22.324 | 99.00th=[33424], 99.50th=[33817], 99.90th=[34341], 99.95th=[34341], 00:29:22.324 | 99.99th=[34341] 00:29:22.324 bw ( KiB/s): min= 1920, max= 2180, per=4.18%, avg=2016.20, stdev=70.90, samples=20 00:29:22.324 iops : min= 480, max= 545, avg=504.05, stdev=17.72, samples=20 00:29:22.324 lat (msec) : 10=0.32%, 20=0.32%, 50=99.37% 00:29:22.324 cpu : usr=98.60%, sys=0.97%, ctx=14, majf=0, minf=46 00:29:22.324 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.324 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.324 filename2: (groupid=0, jobs=1): err= 0: pid=4032398: Thu Nov 28 04:35:59 2024 00:29:22.324 read: IOPS=504, BW=2017KiB/s (2066kB/s)(19.7MiB/10009msec) 00:29:22.324 slat (usec): min=7, max=127, avg=22.22, stdev=24.68 00:29:22.324 clat (usec): min=2104, max=59684, avg=31566.18, stdev=3026.88 00:29:22.324 lat (usec): min=2111, max=59727, avg=31588.40, stdev=3026.71 00:29:22.324 clat percentiles (usec): 00:29:22.324 | 1.00th=[19530], 5.00th=[30802], 10.00th=[31327], 20.00th=[31589], 00:29:22.324 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:22.324 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32375], 00:29:22.324 | 99.00th=[36439], 99.50th=[48497], 99.90th=[59507], 99.95th=[59507], 00:29:22.324 | 99.99th=[59507] 00:29:22.324 bw ( KiB/s): min= 1792, max= 2144, per=4.16%, avg=2006.74, stdev=72.41, samples=19 00:29:22.324 iops : min= 448, max= 536, avg=501.68, stdev=18.10, samples=19 00:29:22.324 lat (msec) : 4=0.20%, 10=0.16%, 20=0.83%, 50=98.49%, 100=0.32% 00:29:22.324 cpu : usr=98.50%, sys=1.11%, ctx=16, majf=0, minf=47 00:29:22.324 IO depths : 1=0.9%, 2=2.1%, 4=5.3%, 8=75.3%, 16=16.4%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=90.4%, 8=8.4%, 16=1.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.324 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.324 filename2: (groupid=0, jobs=1): err= 0: pid=4032399: Thu Nov 28 04:35:59 2024 00:29:22.324 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10014msec) 00:29:22.324 slat (usec): min=10, max=111, avg=39.85, stdev=11.73 00:29:22.324 clat (usec): min=21609, max=44967, avg=31560.24, stdev=1044.41 00:29:22.324 lat (usec): min=21649, max=44997, avg=31600.09, stdev=1042.14 00:29:22.324 clat percentiles (usec): 00:29:22.324 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:22.324 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:22.324 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:22.324 | 99.00th=[33817], 99.50th=[34341], 99.90th=[44827], 99.95th=[44827], 00:29:22.324 | 99.99th=[44827] 00:29:22.324 bw ( KiB/s): min= 1920, max= 2048, per=4.15%, avg=2003.20, stdev=62.64, samples=20 00:29:22.324 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:22.324 lat (msec) : 50=100.00% 00:29:22.324 cpu : usr=96.26%, sys=2.09%, ctx=113, majf=0, minf=49 00:29:22.324 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.324 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.324 filename2: (groupid=0, jobs=1): err= 0: pid=4032400: Thu Nov 28 04:35:59 2024 00:29:22.324 read: IOPS=500, BW=2002KiB/s (2050kB/s)(19.6MiB/10004msec) 00:29:22.324 slat (usec): min=14, max=138, avg=43.81, stdev=12.22 00:29:22.324 clat (usec): min=21657, max=68857, avg=31572.80, stdev=2058.53 00:29:22.324 lat (usec): min=21690, max=68892, avg=31616.60, stdev=2058.04 00:29:22.324 clat percentiles (usec): 00:29:22.324 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31065], 20.00th=[31065], 00:29:22.324 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.324 | 70.00th=[31589], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:22.324 | 99.00th=[33817], 99.50th=[34866], 99.90th=[65274], 99.95th=[65274], 00:29:22.324 | 99.99th=[68682] 00:29:22.324 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2000.84, stdev=76.45, samples=19 00:29:22.324 iops : min= 448, max= 512, avg=500.21, stdev=19.11, samples=19 00:29:22.324 lat (msec) : 50=99.68%, 100=0.32% 00:29:22.324 cpu : usr=96.71%, sys=2.19%, ctx=90, majf=0, minf=49 00:29:22.324 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:22.324 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.324 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.325 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.325 filename2: (groupid=0, jobs=1): err= 0: pid=4032401: Thu Nov 28 04:35:59 2024 00:29:22.325 read: IOPS=503, BW=2013KiB/s (2061kB/s)(19.7MiB/10016msec) 00:29:22.325 slat (usec): min=6, max=190, avg=45.81, stdev=33.70 00:29:22.325 clat (usec): min=18740, max=34340, avg=31352.31, stdev=906.90 00:29:22.325 lat (usec): min=18749, max=34362, avg=31398.12, stdev=908.04 00:29:22.325 clat percentiles (usec): 00:29:22.325 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.325 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.325 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:22.325 | 99.00th=[33162], 99.50th=[33817], 99.90th=[34341], 99.95th=[34341], 00:29:22.325 | 99.99th=[34341] 00:29:22.325 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=2009.60, stdev=60.18, samples=20 00:29:22.325 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:22.325 lat (msec) : 20=0.32%, 50=99.68% 00:29:22.325 cpu : usr=98.66%, sys=0.92%, ctx=18, majf=0, minf=52 00:29:22.325 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:22.325 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.325 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.325 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.325 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.325 filename2: (groupid=0, jobs=1): err= 0: pid=4032402: Thu Nov 28 04:35:59 2024 00:29:22.325 read: IOPS=504, BW=2018KiB/s (2067kB/s)(19.8MiB/10020msec) 00:29:22.325 slat (usec): min=7, max=105, avg=28.35, stdev=11.96 00:29:22.325 clat (usec): min=8059, max=37368, avg=31465.11, stdev=1847.72 00:29:22.325 lat (usec): min=8066, max=37435, avg=31493.46, stdev=1848.81 00:29:22.325 clat percentiles (usec): 00:29:22.325 | 1.00th=[26870], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:22.325 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:22.325 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:29:22.325 | 99.00th=[33817], 99.50th=[33817], 99.90th=[35914], 99.95th=[36439], 00:29:22.325 | 99.99th=[37487] 00:29:22.325 bw ( KiB/s): min= 1920, max= 2176, per=4.18%, avg=2016.00, stdev=69.06, samples=20 00:29:22.325 iops : min= 480, max= 544, avg=504.00, stdev=17.27, samples=20 00:29:22.325 lat (msec) : 10=0.28%, 20=0.36%, 50=99.37% 00:29:22.325 cpu : usr=96.05%, sys=2.19%, ctx=156, majf=0, minf=74 00:29:22.325 IO depths : 1=3.9%, 2=9.9%, 4=24.1%, 8=53.5%, 16=8.6%, 32=0.0%, >=64=0.0% 00:29:22.325 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.325 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.325 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.325 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.325 filename2: (groupid=0, jobs=1): err= 0: pid=4032403: Thu Nov 28 04:35:59 2024 00:29:22.325 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10012msec) 00:29:22.325 slat (usec): min=8, max=127, avg=48.92, stdev=17.21 00:29:22.325 clat (usec): min=13469, max=64008, avg=31425.50, stdev=2310.43 00:29:22.325 lat (usec): min=13495, max=64040, avg=31474.42, stdev=2311.00 00:29:22.325 clat percentiles (usec): 00:29:22.325 | 1.00th=[26608], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:22.325 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:22.325 | 70.00th=[31589], 80.00th=[31589], 90.00th=[31851], 95.00th=[32113], 00:29:22.325 | 99.00th=[35914], 99.50th=[36439], 99.90th=[63701], 99.95th=[63701], 00:29:22.325 | 99.99th=[64226] 00:29:22.325 bw ( KiB/s): min= 1792, max= 2048, per=4.15%, avg=2003.20, stdev=73.89, samples=20 00:29:22.325 iops : min= 448, max= 512, avg=500.80, stdev=18.47, samples=20 00:29:22.325 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:22.325 cpu : usr=98.26%, sys=1.13%, ctx=47, majf=0, minf=54 00:29:22.325 IO depths : 1=5.6%, 2=11.9%, 4=24.9%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:29:22.325 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.325 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.325 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.325 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:22.325 00:29:22.325 Run status group 0 (all jobs): 00:29:22.325 READ: bw=47.1MiB/s (49.4MB/s), 2001KiB/s-2024KiB/s (2049kB/s-2073kB/s), io=472MiB (495MB), run=10004-10020msec 00:29:22.583 04:35:59 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:22.583 04:35:59 -- target/dif.sh@43 -- # local sub 00:29:22.583 04:35:59 -- target/dif.sh@45 -- # for sub in "$@" 00:29:22.583 04:35:59 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:22.583 04:35:59 -- target/dif.sh@36 -- # local sub_id=0 00:29:22.583 04:35:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:22.583 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.583 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.841 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.841 04:35:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:22.841 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.841 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.841 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.841 04:35:59 -- target/dif.sh@45 -- # for sub in "$@" 00:29:22.841 04:35:59 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:22.841 04:35:59 -- target/dif.sh@36 -- # local sub_id=1 00:29:22.841 04:35:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:22.841 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@45 -- # for sub in "$@" 00:29:22.842 04:35:59 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:22.842 04:35:59 -- target/dif.sh@36 -- # local sub_id=2 00:29:22.842 04:35:59 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:22.842 04:35:59 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:22.842 04:35:59 -- target/dif.sh@115 -- # numjobs=2 00:29:22.842 04:35:59 -- target/dif.sh@115 -- # iodepth=8 00:29:22.842 04:35:59 -- target/dif.sh@115 -- # runtime=5 00:29:22.842 04:35:59 -- target/dif.sh@115 -- # files=1 00:29:22.842 04:35:59 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:22.842 04:35:59 -- target/dif.sh@28 -- # local sub 00:29:22.842 04:35:59 -- target/dif.sh@30 -- # for sub in "$@" 00:29:22.842 04:35:59 -- target/dif.sh@31 -- # create_subsystem 0 00:29:22.842 04:35:59 -- target/dif.sh@18 -- # local sub_id=0 00:29:22.842 04:35:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 bdev_null0 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 [2024-11-28 04:35:59.964577] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@30 -- # for sub in "$@" 00:29:22.842 04:35:59 -- target/dif.sh@31 -- # create_subsystem 1 00:29:22.842 04:35:59 -- target/dif.sh@18 -- # local sub_id=1 00:29:22.842 04:35:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 bdev_null1 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:35:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:35:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:22.842 04:35:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.842 04:35:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.842 04:36:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.842 04:36:00 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:22.842 04:36:00 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:22.842 04:36:00 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:22.842 04:36:00 -- nvmf/common.sh@520 -- # config=() 00:29:22.842 04:36:00 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:22.842 04:36:00 -- nvmf/common.sh@520 -- # local subsystem config 00:29:22.842 04:36:00 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:22.842 04:36:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:22.842 04:36:00 -- target/dif.sh@82 -- # gen_fio_conf 00:29:22.842 04:36:00 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:22.842 04:36:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:22.842 { 00:29:22.842 "params": { 00:29:22.842 "name": "Nvme$subsystem", 00:29:22.842 "trtype": "$TEST_TRANSPORT", 00:29:22.842 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:22.842 "adrfam": "ipv4", 00:29:22.842 "trsvcid": "$NVMF_PORT", 00:29:22.842 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:22.842 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:22.842 "hdgst": ${hdgst:-false}, 00:29:22.842 "ddgst": ${ddgst:-false} 00:29:22.842 }, 00:29:22.842 "method": "bdev_nvme_attach_controller" 00:29:22.842 } 00:29:22.842 EOF 00:29:22.842 )") 00:29:22.842 04:36:00 -- target/dif.sh@54 -- # local file 00:29:22.842 04:36:00 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:22.842 04:36:00 -- target/dif.sh@56 -- # cat 00:29:22.842 04:36:00 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:22.842 04:36:00 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.842 04:36:00 -- common/autotest_common.sh@1330 -- # shift 00:29:22.842 04:36:00 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:22.842 04:36:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:22.842 04:36:00 -- nvmf/common.sh@542 -- # cat 00:29:22.842 04:36:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.842 04:36:00 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:22.842 04:36:00 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:22.842 04:36:00 -- target/dif.sh@72 -- # (( file <= files )) 00:29:22.842 04:36:00 -- target/dif.sh@73 -- # cat 00:29:22.842 04:36:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:22.842 04:36:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:22.842 04:36:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:22.842 { 00:29:22.842 "params": { 00:29:22.842 "name": "Nvme$subsystem", 00:29:22.842 "trtype": "$TEST_TRANSPORT", 00:29:22.842 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:22.842 "adrfam": "ipv4", 00:29:22.842 "trsvcid": "$NVMF_PORT", 00:29:22.842 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:22.842 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:22.842 "hdgst": ${hdgst:-false}, 00:29:22.842 "ddgst": ${ddgst:-false} 00:29:22.842 }, 00:29:22.842 "method": "bdev_nvme_attach_controller" 00:29:22.842 } 00:29:22.842 EOF 00:29:22.842 )") 00:29:22.842 04:36:00 -- target/dif.sh@72 -- # (( file++ )) 00:29:22.843 04:36:00 -- target/dif.sh@72 -- # (( file <= files )) 00:29:22.843 04:36:00 -- nvmf/common.sh@542 -- # cat 00:29:22.843 04:36:00 -- nvmf/common.sh@544 -- # jq . 00:29:22.843 04:36:00 -- nvmf/common.sh@545 -- # IFS=, 00:29:22.843 04:36:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:22.843 "params": { 00:29:22.843 "name": "Nvme0", 00:29:22.843 "trtype": "tcp", 00:29:22.843 "traddr": "10.0.0.2", 00:29:22.843 "adrfam": "ipv4", 00:29:22.843 "trsvcid": "4420", 00:29:22.843 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:22.843 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:22.843 "hdgst": false, 00:29:22.843 "ddgst": false 00:29:22.843 }, 00:29:22.843 "method": "bdev_nvme_attach_controller" 00:29:22.843 },{ 00:29:22.843 "params": { 00:29:22.843 "name": "Nvme1", 00:29:22.843 "trtype": "tcp", 00:29:22.843 "traddr": "10.0.0.2", 00:29:22.843 "adrfam": "ipv4", 00:29:22.843 "trsvcid": "4420", 00:29:22.843 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:22.843 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:22.843 "hdgst": false, 00:29:22.843 "ddgst": false 00:29:22.843 }, 00:29:22.843 "method": "bdev_nvme_attach_controller" 00:29:22.843 }' 00:29:22.843 04:36:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:22.843 04:36:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:22.843 04:36:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:22.843 04:36:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.843 04:36:00 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:22.843 04:36:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:22.843 04:36:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:22.843 04:36:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:22.843 04:36:00 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:22.843 04:36:00 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:23.101 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:23.101 ... 00:29:23.101 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:23.101 ... 00:29:23.101 fio-3.35 00:29:23.101 Starting 4 threads 00:29:23.101 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.707 [2024-11-28 04:36:00.888485] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:23.707 [2024-11-28 04:36:00.888561] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:29.082 00:29:29.082 filename0: (groupid=0, jobs=1): err= 0: pid=4033834: Thu Nov 28 04:36:06 2024 00:29:29.082 read: IOPS=1807, BW=14.1MiB/s (14.8MB/s)(70.6MiB/5002msec) 00:29:29.082 slat (usec): min=3, max=266, avg=19.70, stdev=10.93 00:29:29.082 clat (usec): min=840, max=8427, avg=4354.73, stdev=526.27 00:29:29.082 lat (usec): min=852, max=8439, avg=4374.43, stdev=526.26 00:29:29.082 clat percentiles (usec): 00:29:29.082 | 1.00th=[ 2737], 5.00th=[ 3687], 10.00th=[ 3949], 20.00th=[ 4113], 00:29:29.082 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:29.082 | 70.00th=[ 4490], 80.00th=[ 4555], 90.00th=[ 4686], 95.00th=[ 5080], 00:29:29.082 | 99.00th=[ 6521], 99.50th=[ 6915], 99.90th=[ 7504], 99.95th=[ 7635], 00:29:29.082 | 99.99th=[ 8455] 00:29:29.082 bw ( KiB/s): min=13952, max=14848, per=24.91%, avg=14469.33, stdev=292.52, samples=9 00:29:29.082 iops : min= 1744, max= 1856, avg=1808.67, stdev=36.57, samples=9 00:29:29.082 lat (usec) : 1000=0.04% 00:29:29.082 lat (msec) : 2=0.36%, 4=11.22%, 10=88.37% 00:29:29.082 cpu : usr=93.90%, sys=5.44%, ctx=16, majf=0, minf=0 00:29:29.082 IO depths : 1=0.1%, 2=15.5%, 4=57.7%, 8=26.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:29.082 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 complete : 0=0.0%, 4=91.6%, 8=8.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 issued rwts: total=9043,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:29.082 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:29.082 filename0: (groupid=0, jobs=1): err= 0: pid=4033835: Thu Nov 28 04:36:06 2024 00:29:29.082 read: IOPS=1824, BW=14.3MiB/s (14.9MB/s)(71.3MiB/5004msec) 00:29:29.082 slat (nsec): min=4242, max=74385, avg=16490.53, stdev=9886.80 00:29:29.082 clat (usec): min=745, max=8221, avg=4328.75, stdev=520.11 00:29:29.082 lat (usec): min=757, max=8246, avg=4345.24, stdev=520.40 00:29:29.082 clat percentiles (usec): 00:29:29.082 | 1.00th=[ 2835], 5.00th=[ 3556], 10.00th=[ 3851], 20.00th=[ 4113], 00:29:29.082 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:29.082 | 70.00th=[ 4490], 80.00th=[ 4555], 90.00th=[ 4621], 95.00th=[ 4883], 00:29:29.082 | 99.00th=[ 6259], 99.50th=[ 6915], 99.90th=[ 7701], 99.95th=[ 7767], 00:29:29.082 | 99.99th=[ 8225] 00:29:29.082 bw ( KiB/s): min=14208, max=15184, per=25.13%, avg=14596.80, stdev=294.06, samples=10 00:29:29.082 iops : min= 1776, max= 1898, avg=1824.60, stdev=36.76, samples=10 00:29:29.082 lat (usec) : 750=0.01%, 1000=0.05% 00:29:29.082 lat (msec) : 2=0.19%, 4=14.54%, 10=85.20% 00:29:29.082 cpu : usr=94.00%, sys=5.32%, ctx=11, majf=0, minf=9 00:29:29.082 IO depths : 1=0.1%, 2=13.4%, 4=59.4%, 8=27.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:29.082 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 issued rwts: total=9131,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:29.082 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:29.082 filename1: (groupid=0, jobs=1): err= 0: pid=4033836: Thu Nov 28 04:36:06 2024 00:29:29.082 read: IOPS=1819, BW=14.2MiB/s (14.9MB/s)(71.1MiB/5004msec) 00:29:29.082 slat (usec): min=3, max=287, avg=21.12, stdev= 8.95 00:29:29.082 clat (usec): min=735, max=9217, avg=4321.73, stdev=530.01 00:29:29.082 lat (usec): min=751, max=9229, avg=4342.85, stdev=530.04 00:29:29.082 clat percentiles (usec): 00:29:29.082 | 1.00th=[ 2638], 5.00th=[ 3556], 10.00th=[ 3884], 20.00th=[ 4113], 00:29:29.082 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:29.082 | 70.00th=[ 4424], 80.00th=[ 4555], 90.00th=[ 4621], 95.00th=[ 4883], 00:29:29.082 | 99.00th=[ 6325], 99.50th=[ 6915], 99.90th=[ 7832], 99.95th=[ 7963], 00:29:29.082 | 99.99th=[ 9241] 00:29:29.082 bw ( KiB/s): min=14140, max=14976, per=25.06%, avg=14558.00, stdev=348.42, samples=10 00:29:29.082 iops : min= 1767, max= 1872, avg=1819.70, stdev=43.62, samples=10 00:29:29.082 lat (usec) : 750=0.01%, 1000=0.04% 00:29:29.082 lat (msec) : 2=0.30%, 4=13.62%, 10=86.03% 00:29:29.082 cpu : usr=94.94%, sys=4.36%, ctx=16, majf=0, minf=0 00:29:29.082 IO depths : 1=0.1%, 2=16.4%, 4=56.3%, 8=27.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:29.082 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 issued rwts: total=9105,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:29.082 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:29.082 filename1: (groupid=0, jobs=1): err= 0: pid=4033837: Thu Nov 28 04:36:06 2024 00:29:29.082 read: IOPS=1810, BW=14.1MiB/s (14.8MB/s)(70.8MiB/5002msec) 00:29:29.082 slat (nsec): min=3849, max=74894, avg=19246.70, stdev=9933.90 00:29:29.082 clat (usec): min=808, max=8219, avg=4349.96, stdev=601.16 00:29:29.082 lat (usec): min=840, max=8230, avg=4369.21, stdev=601.48 00:29:29.082 clat percentiles (usec): 00:29:29.082 | 1.00th=[ 2343], 5.00th=[ 3589], 10.00th=[ 3916], 20.00th=[ 4113], 00:29:29.082 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4359], 60.00th=[ 4424], 00:29:29.082 | 70.00th=[ 4490], 80.00th=[ 4555], 90.00th=[ 4686], 95.00th=[ 5211], 00:29:29.082 | 99.00th=[ 6718], 99.50th=[ 7111], 99.90th=[ 7767], 99.95th=[ 8029], 00:29:29.082 | 99.99th=[ 8225] 00:29:29.082 bw ( KiB/s): min=14176, max=15200, per=24.93%, avg=14479.70, stdev=318.36, samples=10 00:29:29.082 iops : min= 1772, max= 1900, avg=1809.90, stdev=39.75, samples=10 00:29:29.082 lat (usec) : 1000=0.10% 00:29:29.082 lat (msec) : 2=0.68%, 4=12.22%, 10=86.99% 00:29:29.082 cpu : usr=94.24%, sys=5.08%, ctx=12, majf=0, minf=9 00:29:29.082 IO depths : 1=0.1%, 2=14.9%, 4=57.4%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:29.082 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:29.082 issued rwts: total=9056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:29.082 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:29.082 00:29:29.082 Run status group 0 (all jobs): 00:29:29.082 READ: bw=56.7MiB/s (59.5MB/s), 14.1MiB/s-14.3MiB/s (14.8MB/s-14.9MB/s), io=284MiB (298MB), run=5002-5004msec 00:29:29.082 04:36:06 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:29.082 04:36:06 -- target/dif.sh@43 -- # local sub 00:29:29.082 04:36:06 -- target/dif.sh@45 -- # for sub in "$@" 00:29:29.082 04:36:06 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:29.082 04:36:06 -- target/dif.sh@36 -- # local sub_id=0 00:29:29.082 04:36:06 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:29.082 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.082 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.082 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.082 04:36:06 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:29.082 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.082 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.082 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.082 04:36:06 -- target/dif.sh@45 -- # for sub in "$@" 00:29:29.082 04:36:06 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:29.082 04:36:06 -- target/dif.sh@36 -- # local sub_id=1 00:29:29.082 04:36:06 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:29.082 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.083 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.083 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.083 04:36:06 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:29.083 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.083 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.083 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.083 00:29:29.083 real 0m24.396s 00:29:29.083 user 4m32.392s 00:29:29.083 sys 0m6.476s 00:29:29.083 04:36:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:29.083 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.083 ************************************ 00:29:29.083 END TEST fio_dif_rand_params 00:29:29.083 ************************************ 00:29:29.341 04:36:06 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:29.341 04:36:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:29.341 04:36:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:29.341 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.341 ************************************ 00:29:29.341 START TEST fio_dif_digest 00:29:29.341 ************************************ 00:29:29.341 04:36:06 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:29.341 04:36:06 -- target/dif.sh@123 -- # local NULL_DIF 00:29:29.341 04:36:06 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:29.341 04:36:06 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:29.341 04:36:06 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:29.341 04:36:06 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:29.341 04:36:06 -- target/dif.sh@127 -- # numjobs=3 00:29:29.341 04:36:06 -- target/dif.sh@127 -- # iodepth=3 00:29:29.341 04:36:06 -- target/dif.sh@127 -- # runtime=10 00:29:29.341 04:36:06 -- target/dif.sh@128 -- # hdgst=true 00:29:29.341 04:36:06 -- target/dif.sh@128 -- # ddgst=true 00:29:29.341 04:36:06 -- target/dif.sh@130 -- # create_subsystems 0 00:29:29.341 04:36:06 -- target/dif.sh@28 -- # local sub 00:29:29.341 04:36:06 -- target/dif.sh@30 -- # for sub in "$@" 00:29:29.341 04:36:06 -- target/dif.sh@31 -- # create_subsystem 0 00:29:29.341 04:36:06 -- target/dif.sh@18 -- # local sub_id=0 00:29:29.341 04:36:06 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:29.341 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.341 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.341 bdev_null0 00:29:29.341 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.341 04:36:06 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:29.341 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.341 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.341 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.341 04:36:06 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:29.341 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.341 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.341 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.341 04:36:06 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:29.341 04:36:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.341 04:36:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.341 [2024-11-28 04:36:06.430929] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:29.341 04:36:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.341 04:36:06 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:29.341 04:36:06 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:29.341 04:36:06 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:29.341 04:36:06 -- nvmf/common.sh@520 -- # config=() 00:29:29.341 04:36:06 -- nvmf/common.sh@520 -- # local subsystem config 00:29:29.341 04:36:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:29.341 04:36:06 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:29.341 04:36:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:29.341 { 00:29:29.341 "params": { 00:29:29.341 "name": "Nvme$subsystem", 00:29:29.341 "trtype": "$TEST_TRANSPORT", 00:29:29.341 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:29.341 "adrfam": "ipv4", 00:29:29.341 "trsvcid": "$NVMF_PORT", 00:29:29.341 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:29.341 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:29.341 "hdgst": ${hdgst:-false}, 00:29:29.341 "ddgst": ${ddgst:-false} 00:29:29.341 }, 00:29:29.341 "method": "bdev_nvme_attach_controller" 00:29:29.341 } 00:29:29.341 EOF 00:29:29.341 )") 00:29:29.341 04:36:06 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:29.341 04:36:06 -- target/dif.sh@82 -- # gen_fio_conf 00:29:29.341 04:36:06 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:29.341 04:36:06 -- target/dif.sh@54 -- # local file 00:29:29.341 04:36:06 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:29.342 04:36:06 -- target/dif.sh@56 -- # cat 00:29:29.342 04:36:06 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:29.342 04:36:06 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:29.342 04:36:06 -- common/autotest_common.sh@1330 -- # shift 00:29:29.342 04:36:06 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:29.342 04:36:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:29.342 04:36:06 -- nvmf/common.sh@542 -- # cat 00:29:29.342 04:36:06 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:29.342 04:36:06 -- target/dif.sh@72 -- # (( file <= files )) 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:29.342 04:36:06 -- nvmf/common.sh@544 -- # jq . 00:29:29.342 04:36:06 -- nvmf/common.sh@545 -- # IFS=, 00:29:29.342 04:36:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:29.342 "params": { 00:29:29.342 "name": "Nvme0", 00:29:29.342 "trtype": "tcp", 00:29:29.342 "traddr": "10.0.0.2", 00:29:29.342 "adrfam": "ipv4", 00:29:29.342 "trsvcid": "4420", 00:29:29.342 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:29.342 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:29.342 "hdgst": true, 00:29:29.342 "ddgst": true 00:29:29.342 }, 00:29:29.342 "method": "bdev_nvme_attach_controller" 00:29:29.342 }' 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:29.342 04:36:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:29.342 04:36:06 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:29.342 04:36:06 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:29.342 04:36:06 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:29.342 04:36:06 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:29.342 04:36:06 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:29.600 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:29.600 ... 00:29:29.600 fio-3.35 00:29:29.600 Starting 3 threads 00:29:29.600 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.859 [2024-11-28 04:36:07.150980] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:29.859 [2024-11-28 04:36:07.151046] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:42.068 00:29:42.068 filename0: (groupid=0, jobs=1): err= 0: pid=4034714: Thu Nov 28 04:36:17 2024 00:29:42.068 read: IOPS=196, BW=24.6MiB/s (25.8MB/s)(247MiB/10044msec) 00:29:42.068 slat (nsec): min=4788, max=60246, avg=20876.42, stdev=7269.03 00:29:42.068 clat (usec): min=9136, max=51343, avg=15203.68, stdev=1559.98 00:29:42.068 lat (usec): min=9154, max=51374, avg=15224.55, stdev=1560.97 00:29:42.068 clat percentiles (usec): 00:29:42.068 | 1.00th=[12387], 5.00th=[13566], 10.00th=[13960], 20.00th=[14353], 00:29:42.068 | 30.00th=[14615], 40.00th=[14877], 50.00th=[15139], 60.00th=[15401], 00:29:42.068 | 70.00th=[15664], 80.00th=[16057], 90.00th=[16450], 95.00th=[16909], 00:29:42.068 | 99.00th=[17957], 99.50th=[18482], 99.90th=[48497], 99.95th=[51119], 00:29:42.068 | 99.99th=[51119] 00:29:42.068 bw ( KiB/s): min=23808, max=26880, per=33.24%, avg=25256.90, stdev=775.45, samples=20 00:29:42.068 iops : min= 186, max= 210, avg=197.30, stdev= 6.06, samples=20 00:29:42.068 lat (msec) : 10=0.25%, 20=99.65%, 50=0.05%, 100=0.05% 00:29:42.068 cpu : usr=90.40%, sys=7.36%, ctx=390, majf=0, minf=235 00:29:42.068 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:42.068 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:42.068 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:42.068 issued rwts: total=1976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:42.068 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:42.068 filename0: (groupid=0, jobs=1): err= 0: pid=4034715: Thu Nov 28 04:36:17 2024 00:29:42.068 read: IOPS=195, BW=24.4MiB/s (25.6MB/s)(245MiB/10044msec) 00:29:42.068 slat (usec): min=4, max=119, avg=16.63, stdev= 5.73 00:29:42.068 clat (usec): min=11846, max=56930, avg=15323.04, stdev=2251.62 00:29:42.068 lat (usec): min=11865, max=56943, avg=15339.66, stdev=2251.53 00:29:42.068 clat percentiles (usec): 00:29:42.068 | 1.00th=[12649], 5.00th=[13566], 10.00th=[13960], 20.00th=[14353], 00:29:42.068 | 30.00th=[14746], 40.00th=[15008], 50.00th=[15139], 60.00th=[15401], 00:29:42.068 | 70.00th=[15664], 80.00th=[16057], 90.00th=[16581], 95.00th=[16909], 00:29:42.068 | 99.00th=[18220], 99.50th=[19006], 99.90th=[55313], 99.95th=[56886], 00:29:42.068 | 99.99th=[56886] 00:29:42.068 bw ( KiB/s): min=22272, max=26368, per=33.01%, avg=25077.65, stdev=954.69, samples=20 00:29:42.068 iops : min= 174, max= 206, avg=195.90, stdev= 7.47, samples=20 00:29:42.068 lat (msec) : 20=99.59%, 50=0.15%, 100=0.25% 00:29:42.068 cpu : usr=92.55%, sys=6.96%, ctx=32, majf=0, minf=288 00:29:42.068 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:42.068 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:42.068 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:42.068 issued rwts: total=1961,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:42.068 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:42.068 filename0: (groupid=0, jobs=1): err= 0: pid=4034716: Thu Nov 28 04:36:17 2024 00:29:42.068 read: IOPS=201, BW=25.2MiB/s (26.4MB/s)(253MiB/10047msec) 00:29:42.068 slat (usec): min=3, max=123, avg=17.81, stdev= 5.66 00:29:42.068 clat (usec): min=8961, max=55674, avg=14833.92, stdev=1658.60 00:29:42.068 lat (usec): min=8978, max=55687, avg=14851.73, stdev=1658.05 00:29:42.068 clat percentiles (usec): 00:29:42.068 | 1.00th=[11994], 5.00th=[12911], 10.00th=[13435], 20.00th=[13829], 00:29:42.068 | 30.00th=[14222], 40.00th=[14615], 50.00th=[14746], 60.00th=[15008], 00:29:42.068 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16188], 95.00th=[16581], 00:29:42.068 | 99.00th=[17695], 99.50th=[17957], 99.90th=[21627], 99.95th=[47973], 00:29:42.068 | 99.99th=[55837] 00:29:42.068 bw ( KiB/s): min=24576, max=26880, per=34.10%, avg=25907.20, stdev=777.37, samples=20 00:29:42.068 iops : min= 192, max= 210, avg=202.40, stdev= 6.07, samples=20 00:29:42.068 lat (msec) : 10=0.30%, 20=99.46%, 50=0.20%, 100=0.05% 00:29:42.068 cpu : usr=93.36%, sys=5.89%, ctx=229, majf=0, minf=170 00:29:42.068 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:42.068 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:42.068 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:42.068 issued rwts: total=2026,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:42.068 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:42.068 00:29:42.068 Run status group 0 (all jobs): 00:29:42.068 READ: bw=74.2MiB/s (77.8MB/s), 24.4MiB/s-25.2MiB/s (25.6MB/s-26.4MB/s), io=745MiB (782MB), run=10044-10047msec 00:29:42.068 04:36:17 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:42.068 04:36:17 -- target/dif.sh@43 -- # local sub 00:29:42.068 04:36:17 -- target/dif.sh@45 -- # for sub in "$@" 00:29:42.068 04:36:17 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:42.068 04:36:17 -- target/dif.sh@36 -- # local sub_id=0 00:29:42.068 04:36:17 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:42.068 04:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.068 04:36:17 -- common/autotest_common.sh@10 -- # set +x 00:29:42.068 04:36:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.068 04:36:17 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:42.068 04:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:42.068 04:36:17 -- common/autotest_common.sh@10 -- # set +x 00:29:42.068 04:36:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:42.068 00:29:42.068 real 0m11.157s 00:29:42.068 user 0m28.826s 00:29:42.068 sys 0m2.296s 00:29:42.068 04:36:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:42.068 04:36:17 -- common/autotest_common.sh@10 -- # set +x 00:29:42.068 ************************************ 00:29:42.068 END TEST fio_dif_digest 00:29:42.068 ************************************ 00:29:42.068 04:36:17 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:42.068 04:36:17 -- target/dif.sh@147 -- # nvmftestfini 00:29:42.068 04:36:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:42.068 04:36:17 -- nvmf/common.sh@116 -- # sync 00:29:42.068 04:36:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:42.068 04:36:17 -- nvmf/common.sh@119 -- # set +e 00:29:42.068 04:36:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:42.068 04:36:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:42.068 rmmod nvme_tcp 00:29:42.068 rmmod nvme_fabrics 00:29:42.068 rmmod nvme_keyring 00:29:42.068 04:36:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:42.068 04:36:17 -- nvmf/common.sh@123 -- # set -e 00:29:42.068 04:36:17 -- nvmf/common.sh@124 -- # return 0 00:29:42.068 04:36:17 -- nvmf/common.sh@477 -- # '[' -n 4028350 ']' 00:29:42.068 04:36:17 -- nvmf/common.sh@478 -- # killprocess 4028350 00:29:42.068 04:36:17 -- common/autotest_common.sh@936 -- # '[' -z 4028350 ']' 00:29:42.068 04:36:17 -- common/autotest_common.sh@940 -- # kill -0 4028350 00:29:42.068 04:36:17 -- common/autotest_common.sh@941 -- # uname 00:29:42.068 04:36:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:42.068 04:36:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4028350 00:29:42.068 04:36:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:42.068 04:36:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:42.068 04:36:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4028350' 00:29:42.068 killing process with pid 4028350 00:29:42.068 04:36:17 -- common/autotest_common.sh@955 -- # kill 4028350 00:29:42.068 04:36:17 -- common/autotest_common.sh@960 -- # wait 4028350 00:29:42.068 04:36:17 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:42.068 04:36:17 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:42.068 Waiting for block devices as requested 00:29:42.068 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:42.068 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:42.068 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:42.328 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:42.328 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:42.328 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:42.328 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:42.586 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:42.586 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:42.586 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:42.586 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:42.844 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:42.844 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:42.844 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:42.844 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:43.102 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:43.102 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:43.102 04:36:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:43.102 04:36:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:43.102 04:36:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:43.102 04:36:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:43.102 04:36:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:43.102 04:36:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:43.102 04:36:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:45.638 04:36:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:45.638 00:29:45.638 real 1m7.902s 00:29:45.638 user 6m29.121s 00:29:45.638 sys 0m18.454s 00:29:45.638 04:36:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:45.638 04:36:22 -- common/autotest_common.sh@10 -- # set +x 00:29:45.638 ************************************ 00:29:45.638 END TEST nvmf_dif 00:29:45.638 ************************************ 00:29:45.638 04:36:22 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:45.638 04:36:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:45.638 04:36:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:45.638 04:36:22 -- common/autotest_common.sh@10 -- # set +x 00:29:45.638 ************************************ 00:29:45.638 START TEST nvmf_abort_qd_sizes 00:29:45.638 ************************************ 00:29:45.638 04:36:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:45.638 * Looking for test storage... 00:29:45.638 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:45.638 04:36:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:45.638 04:36:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:45.638 04:36:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:45.638 04:36:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:45.638 04:36:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:45.638 04:36:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:45.638 04:36:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:45.638 04:36:22 -- scripts/common.sh@335 -- # IFS=.-: 00:29:45.638 04:36:22 -- scripts/common.sh@335 -- # read -ra ver1 00:29:45.638 04:36:22 -- scripts/common.sh@336 -- # IFS=.-: 00:29:45.638 04:36:22 -- scripts/common.sh@336 -- # read -ra ver2 00:29:45.638 04:36:22 -- scripts/common.sh@337 -- # local 'op=<' 00:29:45.638 04:36:22 -- scripts/common.sh@339 -- # ver1_l=2 00:29:45.638 04:36:22 -- scripts/common.sh@340 -- # ver2_l=1 00:29:45.638 04:36:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:45.638 04:36:22 -- scripts/common.sh@343 -- # case "$op" in 00:29:45.638 04:36:22 -- scripts/common.sh@344 -- # : 1 00:29:45.638 04:36:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:45.638 04:36:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:45.638 04:36:22 -- scripts/common.sh@364 -- # decimal 1 00:29:45.638 04:36:22 -- scripts/common.sh@352 -- # local d=1 00:29:45.638 04:36:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:45.638 04:36:22 -- scripts/common.sh@354 -- # echo 1 00:29:45.638 04:36:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:45.638 04:36:22 -- scripts/common.sh@365 -- # decimal 2 00:29:45.638 04:36:22 -- scripts/common.sh@352 -- # local d=2 00:29:45.638 04:36:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:45.638 04:36:22 -- scripts/common.sh@354 -- # echo 2 00:29:45.638 04:36:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:45.638 04:36:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:45.638 04:36:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:45.638 04:36:22 -- scripts/common.sh@367 -- # return 0 00:29:45.638 04:36:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:45.638 04:36:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:45.638 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.638 --rc genhtml_branch_coverage=1 00:29:45.639 --rc genhtml_function_coverage=1 00:29:45.639 --rc genhtml_legend=1 00:29:45.639 --rc geninfo_all_blocks=1 00:29:45.639 --rc geninfo_unexecuted_blocks=1 00:29:45.639 00:29:45.639 ' 00:29:45.639 04:36:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:45.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.639 --rc genhtml_branch_coverage=1 00:29:45.639 --rc genhtml_function_coverage=1 00:29:45.639 --rc genhtml_legend=1 00:29:45.639 --rc geninfo_all_blocks=1 00:29:45.639 --rc geninfo_unexecuted_blocks=1 00:29:45.639 00:29:45.639 ' 00:29:45.639 04:36:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:45.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.639 --rc genhtml_branch_coverage=1 00:29:45.639 --rc genhtml_function_coverage=1 00:29:45.639 --rc genhtml_legend=1 00:29:45.639 --rc geninfo_all_blocks=1 00:29:45.639 --rc geninfo_unexecuted_blocks=1 00:29:45.639 00:29:45.639 ' 00:29:45.639 04:36:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:45.639 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:45.639 --rc genhtml_branch_coverage=1 00:29:45.639 --rc genhtml_function_coverage=1 00:29:45.639 --rc genhtml_legend=1 00:29:45.639 --rc geninfo_all_blocks=1 00:29:45.639 --rc geninfo_unexecuted_blocks=1 00:29:45.639 00:29:45.639 ' 00:29:45.639 04:36:22 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:45.639 04:36:22 -- nvmf/common.sh@7 -- # uname -s 00:29:45.639 04:36:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:45.639 04:36:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:45.639 04:36:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:45.639 04:36:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:45.639 04:36:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:45.639 04:36:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:45.639 04:36:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:45.639 04:36:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:45.639 04:36:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:45.639 04:36:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:45.639 04:36:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:45.639 04:36:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:45.639 04:36:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:45.639 04:36:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:45.639 04:36:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:45.639 04:36:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:45.639 04:36:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:45.639 04:36:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:45.639 04:36:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:45.639 04:36:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.639 04:36:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.639 04:36:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.639 04:36:22 -- paths/export.sh@5 -- # export PATH 00:29:45.639 04:36:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:45.639 04:36:22 -- nvmf/common.sh@46 -- # : 0 00:29:45.639 04:36:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:45.639 04:36:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:45.639 04:36:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:45.639 04:36:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:45.639 04:36:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:45.639 04:36:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:45.639 04:36:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:45.639 04:36:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:45.639 04:36:22 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:45.639 04:36:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:45.639 04:36:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:45.639 04:36:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:45.639 04:36:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:45.639 04:36:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:45.639 04:36:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:45.639 04:36:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:45.639 04:36:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:45.639 04:36:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:45.639 04:36:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:45.639 04:36:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:45.639 04:36:22 -- common/autotest_common.sh@10 -- # set +x 00:29:47.541 04:36:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:47.541 04:36:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:47.541 04:36:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:47.541 04:36:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:47.541 04:36:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:47.541 04:36:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:47.541 04:36:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:47.541 04:36:24 -- nvmf/common.sh@294 -- # net_devs=() 00:29:47.541 04:36:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:47.541 04:36:24 -- nvmf/common.sh@295 -- # e810=() 00:29:47.541 04:36:24 -- nvmf/common.sh@295 -- # local -ga e810 00:29:47.541 04:36:24 -- nvmf/common.sh@296 -- # x722=() 00:29:47.541 04:36:24 -- nvmf/common.sh@296 -- # local -ga x722 00:29:47.541 04:36:24 -- nvmf/common.sh@297 -- # mlx=() 00:29:47.541 04:36:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:47.541 04:36:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:47.541 04:36:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:47.541 04:36:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:47.541 04:36:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:47.541 04:36:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:47.541 04:36:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:47.541 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:47.541 04:36:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:47.541 04:36:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:47.541 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:47.541 04:36:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:47.541 04:36:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:47.541 04:36:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:47.541 04:36:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:47.541 04:36:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:47.541 04:36:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:47.541 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:47.541 04:36:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:47.541 04:36:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:47.541 04:36:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:47.541 04:36:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:47.541 04:36:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:47.541 04:36:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:47.541 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:47.541 04:36:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:47.541 04:36:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:47.541 04:36:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:47.541 04:36:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:47.541 04:36:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:47.541 04:36:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:47.541 04:36:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:47.541 04:36:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:47.541 04:36:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:47.541 04:36:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:47.541 04:36:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:47.541 04:36:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:47.541 04:36:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:47.541 04:36:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:47.541 04:36:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:47.541 04:36:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:47.541 04:36:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:47.541 04:36:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:47.541 04:36:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:47.541 04:36:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:47.541 04:36:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:47.541 04:36:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:47.541 04:36:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:47.541 04:36:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:47.541 04:36:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:47.541 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:47.541 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.345 ms 00:29:47.541 00:29:47.541 --- 10.0.0.2 ping statistics --- 00:29:47.541 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:47.541 rtt min/avg/max/mdev = 0.345/0.345/0.345/0.000 ms 00:29:47.541 04:36:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:47.541 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:47.541 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:29:47.541 00:29:47.541 --- 10.0.0.1 ping statistics --- 00:29:47.541 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:47.541 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:29:47.541 04:36:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:47.541 04:36:24 -- nvmf/common.sh@410 -- # return 0 00:29:47.541 04:36:24 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:47.541 04:36:24 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:48.916 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:48.916 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:48.916 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:48.916 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:48.916 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:48.916 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:48.916 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:48.916 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:48.917 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:49.854 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:49.854 04:36:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:49.854 04:36:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:49.854 04:36:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:49.854 04:36:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:49.854 04:36:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:49.854 04:36:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:49.854 04:36:27 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:49.854 04:36:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:49.854 04:36:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:49.854 04:36:27 -- common/autotest_common.sh@10 -- # set +x 00:29:49.854 04:36:27 -- nvmf/common.sh@469 -- # nvmfpid=4040246 00:29:49.854 04:36:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:49.854 04:36:27 -- nvmf/common.sh@470 -- # waitforlisten 4040246 00:29:49.854 04:36:27 -- common/autotest_common.sh@829 -- # '[' -z 4040246 ']' 00:29:49.854 04:36:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:49.854 04:36:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:49.854 04:36:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:49.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:49.854 04:36:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:49.854 04:36:27 -- common/autotest_common.sh@10 -- # set +x 00:29:49.854 [2024-11-28 04:36:27.133214] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:49.854 [2024-11-28 04:36:27.133279] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:49.854 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.113 [2024-11-28 04:36:27.204810] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:50.113 [2024-11-28 04:36:27.340257] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:50.113 [2024-11-28 04:36:27.340418] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:50.113 [2024-11-28 04:36:27.340439] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:50.113 [2024-11-28 04:36:27.340454] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:50.113 [2024-11-28 04:36:27.343549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:50.113 [2024-11-28 04:36:27.343618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:50.113 [2024-11-28 04:36:27.343615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:50.113 [2024-11-28 04:36:27.343595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:51.047 04:36:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:51.047 04:36:28 -- common/autotest_common.sh@862 -- # return 0 00:29:51.047 04:36:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:51.047 04:36:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:51.047 04:36:28 -- common/autotest_common.sh@10 -- # set +x 00:29:51.047 04:36:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:51.047 04:36:28 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:51.047 04:36:28 -- scripts/common.sh@312 -- # local nvmes 00:29:51.047 04:36:28 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:51.047 04:36:28 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:51.047 04:36:28 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:51.047 04:36:28 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:51.047 04:36:28 -- scripts/common.sh@322 -- # uname -s 00:29:51.047 04:36:28 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:51.047 04:36:28 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:51.047 04:36:28 -- scripts/common.sh@327 -- # (( 1 )) 00:29:51.047 04:36:28 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:51.047 04:36:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:51.047 04:36:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:51.047 04:36:28 -- common/autotest_common.sh@10 -- # set +x 00:29:51.047 ************************************ 00:29:51.047 START TEST spdk_target_abort 00:29:51.047 ************************************ 00:29:51.047 04:36:28 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:51.047 04:36:28 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:51.047 04:36:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.047 04:36:28 -- common/autotest_common.sh@10 -- # set +x 00:29:54.325 spdk_targetn1 00:29:54.325 04:36:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:54.325 04:36:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:54.325 04:36:31 -- common/autotest_common.sh@10 -- # set +x 00:29:54.325 [2024-11-28 04:36:31.034648] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:54.325 04:36:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:54.325 04:36:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:54.325 04:36:31 -- common/autotest_common.sh@10 -- # set +x 00:29:54.325 04:36:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:54.325 04:36:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:54.325 04:36:31 -- common/autotest_common.sh@10 -- # set +x 00:29:54.325 04:36:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:54.325 04:36:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:54.325 04:36:31 -- common/autotest_common.sh@10 -- # set +x 00:29:54.325 [2024-11-28 04:36:31.066937] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:54.325 04:36:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:54.325 04:36:31 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:54.325 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.604 Initializing NVMe Controllers 00:29:57.604 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:57.604 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:57.604 Initialization complete. Launching workers. 00:29:57.604 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12210, failed: 0 00:29:57.604 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1221, failed to submit 10989 00:29:57.604 success 794, unsuccess 427, failed 0 00:29:57.604 04:36:34 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:57.604 04:36:34 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:57.604 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.885 [2024-11-28 04:36:37.505112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17fd740 is same with the state(5) to be set 00:30:00.885 Initializing NVMe Controllers 00:30:00.885 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:00.885 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:00.885 Initialization complete. Launching workers. 00:30:00.885 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8619, failed: 0 00:30:00.885 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1229, failed to submit 7390 00:30:00.885 success 340, unsuccess 889, failed 0 00:30:00.885 04:36:37 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:00.885 04:36:37 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:00.885 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.168 Initializing NVMe Controllers 00:30:04.168 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:04.168 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:04.168 Initialization complete. Launching workers. 00:30:04.168 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32367, failed: 0 00:30:04.168 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2715, failed to submit 29652 00:30:04.168 success 538, unsuccess 2177, failed 0 00:30:04.168 04:36:40 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:04.168 04:36:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.168 04:36:40 -- common/autotest_common.sh@10 -- # set +x 00:30:04.168 04:36:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.168 04:36:40 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:04.168 04:36:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.168 04:36:40 -- common/autotest_common.sh@10 -- # set +x 00:30:05.114 04:36:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.114 04:36:42 -- target/abort_qd_sizes.sh@62 -- # killprocess 4040246 00:30:05.114 04:36:42 -- common/autotest_common.sh@936 -- # '[' -z 4040246 ']' 00:30:05.114 04:36:42 -- common/autotest_common.sh@940 -- # kill -0 4040246 00:30:05.114 04:36:42 -- common/autotest_common.sh@941 -- # uname 00:30:05.114 04:36:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:05.114 04:36:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4040246 00:30:05.114 04:36:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:05.114 04:36:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:05.114 04:36:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4040246' 00:30:05.114 killing process with pid 4040246 00:30:05.114 04:36:42 -- common/autotest_common.sh@955 -- # kill 4040246 00:30:05.114 04:36:42 -- common/autotest_common.sh@960 -- # wait 4040246 00:30:05.114 00:30:05.114 real 0m14.190s 00:30:05.114 user 0m56.115s 00:30:05.114 sys 0m2.662s 00:30:05.114 04:36:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:05.114 04:36:42 -- common/autotest_common.sh@10 -- # set +x 00:30:05.114 ************************************ 00:30:05.114 END TEST spdk_target_abort 00:30:05.114 ************************************ 00:30:05.114 04:36:42 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:05.114 04:36:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:05.114 04:36:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:05.114 04:36:42 -- common/autotest_common.sh@10 -- # set +x 00:30:05.114 ************************************ 00:30:05.114 START TEST kernel_target_abort 00:30:05.114 ************************************ 00:30:05.114 04:36:42 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:05.114 04:36:42 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:05.114 04:36:42 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:05.114 04:36:42 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:05.114 04:36:42 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:05.114 04:36:42 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:05.114 04:36:42 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:05.114 04:36:42 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:05.114 04:36:42 -- nvmf/common.sh@627 -- # local block nvme 00:30:05.114 04:36:42 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:05.114 04:36:42 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:05.454 04:36:42 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:05.454 04:36:42 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:06.390 Waiting for block devices as requested 00:30:06.390 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:06.649 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:06.649 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:06.908 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:06.908 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:06.908 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:06.908 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:07.166 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:07.166 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:07.166 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:07.166 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:07.425 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:07.425 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:07.425 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:07.425 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:07.683 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:07.683 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:07.683 04:36:44 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:07.683 04:36:44 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:07.683 04:36:44 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:07.683 04:36:44 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:07.683 04:36:44 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:07.954 No valid GPT data, bailing 00:30:07.954 04:36:45 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:07.954 04:36:45 -- scripts/common.sh@393 -- # pt= 00:30:07.954 04:36:45 -- scripts/common.sh@394 -- # return 1 00:30:07.954 04:36:45 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:07.954 04:36:45 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:07.954 04:36:45 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:07.954 04:36:45 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:07.954 04:36:45 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:07.954 04:36:45 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:07.954 04:36:45 -- nvmf/common.sh@654 -- # echo 1 00:30:07.954 04:36:45 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:07.954 04:36:45 -- nvmf/common.sh@656 -- # echo 1 00:30:07.954 04:36:45 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:07.954 04:36:45 -- nvmf/common.sh@663 -- # echo tcp 00:30:07.954 04:36:45 -- nvmf/common.sh@664 -- # echo 4420 00:30:07.954 04:36:45 -- nvmf/common.sh@665 -- # echo ipv4 00:30:07.954 04:36:45 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:07.954 04:36:45 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:07.954 00:30:07.954 Discovery Log Number of Records 2, Generation counter 2 00:30:07.954 =====Discovery Log Entry 0====== 00:30:07.954 trtype: tcp 00:30:07.954 adrfam: ipv4 00:30:07.954 subtype: current discovery subsystem 00:30:07.954 treq: not specified, sq flow control disable supported 00:30:07.954 portid: 1 00:30:07.954 trsvcid: 4420 00:30:07.954 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:07.954 traddr: 10.0.0.1 00:30:07.954 eflags: none 00:30:07.954 sectype: none 00:30:07.954 =====Discovery Log Entry 1====== 00:30:07.954 trtype: tcp 00:30:07.954 adrfam: ipv4 00:30:07.954 subtype: nvme subsystem 00:30:07.954 treq: not specified, sq flow control disable supported 00:30:07.954 portid: 1 00:30:07.954 trsvcid: 4420 00:30:07.954 subnqn: kernel_target 00:30:07.954 traddr: 10.0.0.1 00:30:07.954 eflags: none 00:30:07.954 sectype: none 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:07.954 04:36:45 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:07.955 04:36:45 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:07.955 04:36:45 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:07.955 04:36:45 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:07.955 04:36:45 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:07.955 04:36:45 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:07.955 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.233 Initializing NVMe Controllers 00:30:11.233 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:11.233 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:11.233 Initialization complete. Launching workers. 00:30:11.233 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 40036, failed: 0 00:30:11.233 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 40036, failed to submit 0 00:30:11.233 success 0, unsuccess 40036, failed 0 00:30:11.233 04:36:48 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:11.233 04:36:48 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:11.233 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.513 Initializing NVMe Controllers 00:30:14.513 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:14.513 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:14.513 Initialization complete. Launching workers. 00:30:14.513 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 74905, failed: 0 00:30:14.513 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18890, failed to submit 56015 00:30:14.513 success 0, unsuccess 18890, failed 0 00:30:14.513 04:36:51 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:14.513 04:36:51 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:14.513 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.792 Initializing NVMe Controllers 00:30:17.792 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:17.792 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:17.792 Initialization complete. Launching workers. 00:30:17.792 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 73088, failed: 0 00:30:17.792 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18246, failed to submit 54842 00:30:17.792 success 0, unsuccess 18246, failed 0 00:30:17.792 04:36:54 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:17.792 04:36:54 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:17.792 04:36:54 -- nvmf/common.sh@677 -- # echo 0 00:30:17.792 04:36:54 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:17.792 04:36:54 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:17.792 04:36:54 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:17.792 04:36:54 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:17.792 04:36:54 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:17.792 04:36:54 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:17.792 00:30:17.792 real 0m12.105s 00:30:17.792 user 0m5.468s 00:30:17.792 sys 0m2.515s 00:30:17.792 04:36:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:17.792 04:36:54 -- common/autotest_common.sh@10 -- # set +x 00:30:17.792 ************************************ 00:30:17.792 END TEST kernel_target_abort 00:30:17.792 ************************************ 00:30:17.792 04:36:54 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:17.792 04:36:54 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:17.792 04:36:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:17.792 04:36:54 -- nvmf/common.sh@116 -- # sync 00:30:17.792 04:36:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:17.792 04:36:54 -- nvmf/common.sh@119 -- # set +e 00:30:17.792 04:36:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:17.792 04:36:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:17.792 rmmod nvme_tcp 00:30:17.792 rmmod nvme_fabrics 00:30:17.792 rmmod nvme_keyring 00:30:17.792 04:36:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:17.792 04:36:54 -- nvmf/common.sh@123 -- # set -e 00:30:17.792 04:36:54 -- nvmf/common.sh@124 -- # return 0 00:30:17.792 04:36:54 -- nvmf/common.sh@477 -- # '[' -n 4040246 ']' 00:30:17.792 04:36:54 -- nvmf/common.sh@478 -- # killprocess 4040246 00:30:17.792 04:36:54 -- common/autotest_common.sh@936 -- # '[' -z 4040246 ']' 00:30:17.792 04:36:54 -- common/autotest_common.sh@940 -- # kill -0 4040246 00:30:17.792 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4040246) - No such process 00:30:17.792 04:36:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4040246 is not found' 00:30:17.792 Process with pid 4040246 is not found 00:30:17.792 04:36:54 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:17.792 04:36:54 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:18.728 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:18.728 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:18.728 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:18.728 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:18.728 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:18.728 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:18.728 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:18.728 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:18.728 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:18.728 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:18.728 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:18.728 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:18.728 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:18.728 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:18.728 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:18.728 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:18.728 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:18.985 04:36:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:18.985 04:36:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:18.985 04:36:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:18.985 04:36:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:18.985 04:36:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:18.985 04:36:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:18.985 04:36:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:20.891 04:36:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:20.891 00:30:20.891 real 0m35.675s 00:30:20.891 user 1m4.121s 00:30:20.891 sys 0m8.625s 00:30:20.891 04:36:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:20.891 04:36:58 -- common/autotest_common.sh@10 -- # set +x 00:30:20.891 ************************************ 00:30:20.891 END TEST nvmf_abort_qd_sizes 00:30:20.891 ************************************ 00:30:20.891 04:36:58 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:20.891 04:36:58 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:20.891 04:36:58 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:20.891 04:36:58 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:20.891 04:36:58 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:20.891 04:36:58 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:20.891 04:36:58 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:20.891 04:36:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:20.891 04:36:58 -- common/autotest_common.sh@10 -- # set +x 00:30:20.891 04:36:58 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:20.891 04:36:58 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:20.891 04:36:58 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:20.891 04:36:58 -- common/autotest_common.sh@10 -- # set +x 00:30:22.793 INFO: APP EXITING 00:30:22.793 INFO: killing all VMs 00:30:22.793 INFO: killing vhost app 00:30:22.793 INFO: EXIT DONE 00:30:24.169 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:24.169 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:24.169 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:24.169 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:24.169 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:24.169 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:24.169 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:24.169 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:24.169 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:24.169 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:24.169 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:24.169 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:24.169 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:24.169 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:24.169 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:24.169 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:24.169 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:25.548 Cleaning 00:30:25.548 Removing: /var/run/dpdk/spdk0/config 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:25.548 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:25.548 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:25.548 Removing: /var/run/dpdk/spdk1/config 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:25.548 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:25.548 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:25.548 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:25.548 Removing: /var/run/dpdk/spdk2/config 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:25.548 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:25.548 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:25.548 Removing: /var/run/dpdk/spdk3/config 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:25.548 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:25.548 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:25.548 Removing: /var/run/dpdk/spdk4/config 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:25.548 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:25.548 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:25.548 Removing: /dev/shm/bdev_svc_trace.1 00:30:25.548 Removing: /dev/shm/nvmf_trace.0 00:30:25.548 Removing: /dev/shm/spdk_tgt_trace.pid3770324 00:30:25.548 Removing: /var/run/dpdk/spdk0 00:30:25.548 Removing: /var/run/dpdk/spdk1 00:30:25.548 Removing: /var/run/dpdk/spdk2 00:30:25.548 Removing: /var/run/dpdk/spdk3 00:30:25.548 Removing: /var/run/dpdk/spdk4 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3768608 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3769389 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3770324 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3770854 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3772170 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3773120 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3773444 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3773658 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3773999 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3774328 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3774489 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3774646 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3774844 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3775427 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3777980 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3778163 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3778452 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3778594 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3778911 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3779051 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3779462 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3779504 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3779795 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3779937 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3780101 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3780245 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3780630 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3780786 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3781145 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3781407 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3781539 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3781614 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3781760 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3782036 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3782203 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3782786 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3783112 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3783270 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3783424 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3783685 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3783844 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3784005 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3784188 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3784423 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3784572 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3784745 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3784991 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3785159 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3785300 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3785580 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3785726 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3785890 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3786149 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3786312 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3786457 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3786736 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3786878 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3787044 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3787254 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3787463 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3787608 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3787786 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3788032 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3788196 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3788348 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3788619 00:30:25.548 Removing: /var/run/dpdk/spdk_pid3788773 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3788969 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3789199 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3789359 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3789516 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3789783 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3789932 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3790193 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3792428 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3850155 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3852824 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3860073 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3863436 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3865946 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3866365 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3871584 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3871872 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3874656 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3879081 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3881191 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3887952 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3893384 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3894730 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3895412 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3906053 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3908306 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3911267 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3912600 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3914478 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3914748 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3914903 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3915046 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3915643 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3917029 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3918030 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3918485 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3922106 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3925656 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3929276 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3953648 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3956502 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3960485 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3961580 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3962701 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3965410 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3967950 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3972353 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3972355 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3975413 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3975707 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3976216 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3976592 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3976601 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3977705 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3978931 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3980141 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3981358 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3982641 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3983912 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3987811 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3988154 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3989592 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3990354 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3994148 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3996319 00:30:25.808 Removing: /var/run/dpdk/spdk_pid3999941 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4003808 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4007973 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4008424 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4008840 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4009313 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4009987 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4010539 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4011090 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4011644 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4014241 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4014471 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4018337 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4018520 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4020256 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4025456 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4025463 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4028532 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4029898 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4031433 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4032193 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4033651 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4034569 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4040683 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4041083 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4041487 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4043095 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4043383 00:30:25.808 Removing: /var/run/dpdk/spdk_pid4043792 00:30:25.808 Clean 00:30:26.066 killing process with pid 3740321 00:30:34.197 killing process with pid 3740318 00:30:34.197 killing process with pid 3740320 00:30:34.197 killing process with pid 3740319 00:30:34.197 04:37:11 -- common/autotest_common.sh@1446 -- # return 0 00:30:34.197 04:37:11 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:34.197 04:37:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:34.197 04:37:11 -- common/autotest_common.sh@10 -- # set +x 00:30:34.197 04:37:11 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:34.197 04:37:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:34.197 04:37:11 -- common/autotest_common.sh@10 -- # set +x 00:30:34.456 04:37:11 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:34.456 04:37:11 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:34.456 04:37:11 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:34.456 04:37:11 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:34.456 04:37:11 -- spdk/autotest.sh@383 -- # hostname 00:30:34.456 04:37:11 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:34.456 geninfo: WARNING: invalid characters removed from testname! 00:31:01.001 04:37:37 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:04.294 04:37:41 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:06.833 04:37:43 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:09.369 04:37:46 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:11.906 04:37:49 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:14.445 04:37:51 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:17.057 04:37:54 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:17.057 04:37:54 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:17.057 04:37:54 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:17.057 04:37:54 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:17.057 04:37:54 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:17.057 04:37:54 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:17.057 04:37:54 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:17.057 04:37:54 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:17.057 04:37:54 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:17.057 04:37:54 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:17.057 04:37:54 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:17.057 04:37:54 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:17.057 04:37:54 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:17.057 04:37:54 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:17.057 04:37:54 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:17.057 04:37:54 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:17.057 04:37:54 -- scripts/common.sh@343 -- $ case "$op" in 00:31:17.057 04:37:54 -- scripts/common.sh@344 -- $ : 1 00:31:17.057 04:37:54 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:17.057 04:37:54 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:17.057 04:37:54 -- scripts/common.sh@364 -- $ decimal 1 00:31:17.057 04:37:54 -- scripts/common.sh@352 -- $ local d=1 00:31:17.057 04:37:54 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:17.057 04:37:54 -- scripts/common.sh@354 -- $ echo 1 00:31:17.057 04:37:54 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:17.057 04:37:54 -- scripts/common.sh@365 -- $ decimal 2 00:31:17.057 04:37:54 -- scripts/common.sh@352 -- $ local d=2 00:31:17.057 04:37:54 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:17.057 04:37:54 -- scripts/common.sh@354 -- $ echo 2 00:31:17.057 04:37:54 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:17.057 04:37:54 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:17.057 04:37:54 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:17.057 04:37:54 -- scripts/common.sh@367 -- $ return 0 00:31:17.057 04:37:54 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:17.057 04:37:54 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:17.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.057 --rc genhtml_branch_coverage=1 00:31:17.057 --rc genhtml_function_coverage=1 00:31:17.057 --rc genhtml_legend=1 00:31:17.057 --rc geninfo_all_blocks=1 00:31:17.057 --rc geninfo_unexecuted_blocks=1 00:31:17.057 00:31:17.057 ' 00:31:17.057 04:37:54 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:17.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.057 --rc genhtml_branch_coverage=1 00:31:17.057 --rc genhtml_function_coverage=1 00:31:17.057 --rc genhtml_legend=1 00:31:17.057 --rc geninfo_all_blocks=1 00:31:17.057 --rc geninfo_unexecuted_blocks=1 00:31:17.057 00:31:17.057 ' 00:31:17.057 04:37:54 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:17.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.057 --rc genhtml_branch_coverage=1 00:31:17.057 --rc genhtml_function_coverage=1 00:31:17.057 --rc genhtml_legend=1 00:31:17.057 --rc geninfo_all_blocks=1 00:31:17.057 --rc geninfo_unexecuted_blocks=1 00:31:17.057 00:31:17.057 ' 00:31:17.057 04:37:54 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:17.057 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:17.057 --rc genhtml_branch_coverage=1 00:31:17.057 --rc genhtml_function_coverage=1 00:31:17.057 --rc genhtml_legend=1 00:31:17.057 --rc geninfo_all_blocks=1 00:31:17.057 --rc geninfo_unexecuted_blocks=1 00:31:17.057 00:31:17.057 ' 00:31:17.058 04:37:54 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:17.058 04:37:54 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:17.058 04:37:54 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:17.058 04:37:54 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:17.058 04:37:54 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.058 04:37:54 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.058 04:37:54 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.058 04:37:54 -- paths/export.sh@5 -- $ export PATH 00:31:17.058 04:37:54 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:17.058 04:37:54 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:17.058 04:37:54 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:17.058 04:37:54 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732765074.XXXXXX 00:31:17.058 04:37:54 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732765074.zml7zF 00:31:17.058 04:37:54 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:17.058 04:37:54 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:17.058 04:37:54 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:17.058 04:37:54 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:17.058 04:37:54 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:17.058 04:37:54 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:17.058 04:37:54 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:17.058 04:37:54 -- common/autotest_common.sh@10 -- $ set +x 00:31:17.058 04:37:54 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:17.058 04:37:54 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:17.058 04:37:54 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:17.058 04:37:54 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:17.058 04:37:54 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:17.058 04:37:54 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:17.058 04:37:54 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:17.058 04:37:54 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:17.058 04:37:54 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:17.058 04:37:54 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:17.318 04:37:54 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:17.318 + [[ -n 3697892 ]] 00:31:17.318 + sudo kill 3697892 00:31:17.328 [Pipeline] } 00:31:17.343 [Pipeline] // stage 00:31:17.348 [Pipeline] } 00:31:17.364 [Pipeline] // timeout 00:31:17.369 [Pipeline] } 00:31:17.383 [Pipeline] // catchError 00:31:17.388 [Pipeline] } 00:31:17.403 [Pipeline] // wrap 00:31:17.410 [Pipeline] } 00:31:17.424 [Pipeline] // catchError 00:31:17.434 [Pipeline] stage 00:31:17.436 [Pipeline] { (Epilogue) 00:31:17.450 [Pipeline] catchError 00:31:17.452 [Pipeline] { 00:31:17.465 [Pipeline] echo 00:31:17.467 Cleanup processes 00:31:17.473 [Pipeline] sh 00:31:17.757 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:17.757 4055763 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:17.771 [Pipeline] sh 00:31:18.052 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:18.053 ++ grep -v 'sudo pgrep' 00:31:18.053 ++ awk '{print $1}' 00:31:18.053 + sudo kill -9 00:31:18.053 + true 00:31:18.063 [Pipeline] sh 00:31:18.343 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:30.554 [Pipeline] sh 00:31:30.839 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:30.839 Artifacts sizes are good 00:31:30.857 [Pipeline] archiveArtifacts 00:31:30.866 Archiving artifacts 00:31:31.014 [Pipeline] sh 00:31:31.303 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:31.320 [Pipeline] cleanWs 00:31:31.332 [WS-CLEANUP] Deleting project workspace... 00:31:31.332 [WS-CLEANUP] Deferred wipeout is used... 00:31:31.340 [WS-CLEANUP] done 00:31:31.342 [Pipeline] } 00:31:31.365 [Pipeline] // catchError 00:31:31.381 [Pipeline] sh 00:31:31.664 + logger -p user.info -t JENKINS-CI 00:31:31.673 [Pipeline] } 00:31:31.689 [Pipeline] // stage 00:31:31.695 [Pipeline] } 00:31:31.711 [Pipeline] // node 00:31:31.718 [Pipeline] End of Pipeline 00:31:31.756 Finished: SUCCESS